This job type is useful for waiting for a condition to be met.
Your SQL statement must be written so that it only returns “true” or “false”
This job Type runs an Athena Query and checks the result.
eg:
select true
eg:
select case when 1=1 then true else false end as result
Only once the result returns “true” will the pipeline continue with subsequent job steps.
Otherwise the pipeline will keep checking every minute up to a current maximum of 20 minutes.
If the statement does not return true within this time frame the pipeline will quit.
In order to have the job step continue checking past the 20 minute maximum you can increase the “Number of Runs per day”
“Run Time” is the Time in UTC time zone when you want the job to run.
“Number of Runs per day” is the number of times per day you want the job to run. This could be anywhere from 1 to 1440 times per day (every minute is currently the maximum)
Fill in the “Email address” to be receive job run notifications by email. This only works if you’ve signed up for SendGrid and completed the details in the SendGrid section.
“Pipeline Name” groups jobs together to run consecutively and dependently. This means subsequent job steps eg: Step 2 will only run once Step 1 has completed successfully. To change the Pipeline that the job belongs to, simply change the Pipeline Name field.
“Region” is the AWS region where you want the query to run.
“Job Name” is the unique name of the job. It can’t exist even in a different pipeline.
“Athena SQL Statement” is the path to the file in S3 containing the Athena query
“Athena Query Result Location” is the S3 location where you want the query results saved.
“Athena Database” is the database to use in Athena.