Month: November 2020

S3 Delete Objects

This job type delete objects from the bucket with the optional prefix you supply. This is useful for clearing a staging area (eg: after processing with other Athena job types) “Run Time” is the Time in UTC time zone when you want the job to run. “Number of Runs per day” is the number of times per …

S3 Delete Objects Read More »

S3 Copy Objects

This job type allows you to copy S3 objects from one bucket to another. This is useful for staging purposes, especially for running other Athena job types using this location. “Run Time” is the Time in UTC time zone when you want the job to run. “Number of Runs per day” is the number of times per …

S3 Copy Objects Read More »

Athena Boolean

This job type is useful for waiting for a condition to be met. Your SQL statement must be written so that it only returns “true” or “false” This job Type runs an Athena Query and checks the result. eg: select true eg: select case when 1=1 then true else false end as result Only once …

Athena Boolean Read More »

Athena Query

This is a simple no frills query that you want to run using Athena: “Run Time” is the Time in UTC time zone when you want the job to run. “Number of Runs per day” is the number of times per day you want the job to run. This could be anywhere from 1 to 1440 …

Athena Query Read More »