This job type lets you run multiple Athena queries in one step:
“Run Time” is the Time in UTC time zone when you want the job to run.
“Number of Runs per day” is the number of times per day you want the job to run. This could be anywhere from 1 to 1440 times per day (every minute is currently the maximum)
Fill in the “Email address” to be receive job run notifications by email. This only works if you’ve signed up for SendGrid and completed the details in the SendGrid section.
“Pipeline Name” groups jobs together to run consecutively and dependently. This means subsequent job steps eg: Step 2 will only run once Step 1 has completed successfully. To change the Pipeline that the job belongs to, simply change the Pipeline Name field.
“Region” is the AWS region where you want the query to run.
“Job Name” is the unique name of the job. It can’t exist even in a different pipeline.
“Prefix”, “Middle variable” and “Suffix” let you specify where your query files are located in S3.
“Prefix” should be entered once. This is the bucket name together with any “folders” or prefix where all the query files are located.
All files containing the queries you want to run should be stored in the same place ie: bucket and “folder”
“Middle variable” is where you specify the part that is different in each file name. These differences must be separated with a pipe ie “|” or shift backslash on Windows.
“Suffix” is the static part that every file ends in.
Eg:
“Athena Query Result Location” is the S3 location where you want the query results saved.
“Athena Database” is the database to use in Athena.