Mike Houston

Release Notes

v 1.7.4 Using Amazon Linux 2 Launch the product via 1-click.Once the instance is running access the frontend via http://:8090Remember to use PORT 8090Do not use “https://” it must be “http://:8090″Additional detailed configuration and usage instructions at: https://birockstar.com/getting-started/ Change the source IP to YOUR-IP! eg: 169.0.249.252/32

Why rockstarETL?

Orchestration tools like Apache Airflow are great but are also more general purpose. You have the option of hosting yourself or using a managed service from GCP and AWS. However these tools require Python programming skills to use. rockstarETL only requires that you know SQL. There is no programming language required. rockstarETL is focused on …

Why rockstarETL? Read More »

Using the Athena Batch Partition Insert Job Type

So we’ve got our raw data in s3: And we have an Athena table over this data: The Athena query statement used to create this table: CREATE EXTERNAL TABLE invoices (invoiceid int,customerid int,billtocustomerid int,orderid int,deliverymethodid int,contactpersonid int,accountspersonid int,salespersonpersonid int,packedbypersonid int,invoicedate date,customerpurchaseordernumber string,iscreditnote int,totaldryitems int,totalchilleritems int,deliveryrun string,runposition string,confirmeddeliverytime timestamp,confirmedreceivedby string,lasteditedby int,lasteditedwhen timestamp)ROW FORMAT DELIMITEDFIELDS TERMINATED BY …

Using the Athena Batch Partition Insert Job Type Read More »

S3 Delete Objects

This job type delete objects from the bucket with the optional prefix you supply. This is useful for clearing a staging area (eg: after processing with other Athena job types) “Run Time” is the Time in UTC time zone when you want the job to run. “Number of Runs per day” is the number of times per …

S3 Delete Objects Read More »