Getting Started

Launch the product via 1-click.

Select “Continue to Subscribe”:

Select “Accept Terms”:

Wait for the subscription to activate:

After a minute or two the subscription will complete:

Select “Continue to Configuration”:

Select “Continue to Launch”:

On the launch page, under “Choose Action”, select “Launch through EC2”:

A t3.medium machine type is recommended:

You could also experiment with a t3.small or t3.micro depending on your use case.

Then select “Next: Configure Instance Details”:

You would then need to create or use an existing IAM role:

This image has an empty alt attribute; its file name is image-178.png

The role would need to have the following policies attached. This enables rockstarETL to access S3 and Athena to execute the jobs and pipelines you create:

If new, then create role:

This image has an empty alt attribute; its file name is image-179-1024x97.png

Choose “EC2” under “Common use cases” then click “Next: Permissions”

This image has an empty alt attribute; its file name is image-182.png

Attach the following policies:

AmazonS3FullAccess
AmazonAthenaFullAccess

Then click “Next: Tags”

This image has an empty alt attribute; its file name is image-184.png

Then click: “Next: Review”

This image has an empty alt attribute; its file name is image-185.png

Give the role a name then click “Create Role”:

Select the newly created role in the “IAM role” drop down:

This image has an empty alt attribute; its file name is image-220.png

Untick unlimited credit specification:

This image has an empty alt attribute; its file name is image-223.png

Then click “Next: Add Storage”

This image has an empty alt attribute; its file name is image-188.png
This image has an empty alt attribute; its file name is image-189-1024x167.png

Then click “Next: Add Tags”

This image has an empty alt attribute; its file name is image-190.png
This image has an empty alt attribute; its file name is image-191-1024x302.png

Then click “Next: Configure Security Group”

This image has an empty alt attribute; its file name is image-192.png

Use an existing or create a new security group specifying your IP address as the source:

Then click “Review and Launch”

This image has an empty alt attribute; its file name is image-195.png

Then click “Launch”

This image has an empty alt attribute; its file name is image-197.png

Create a new key pair if you don’t already have one:

This image has an empty alt attribute; its file name is image-201.png
This image has an empty alt attribute; its file name is image-202.png

If you created a new keypair and use putty on windows, you’ll need to convert the pem file to ppk as per:

https://aws.amazon.com/premiumsupport/knowledge-center/convert-pem-file-into-ppk/

In PuTTY:

Specify your newly converted ppk file:

This image has an empty alt attribute; its file name is image-16.png

If you have an existing key pair, select it then click “Launch Instances”

Then click “View Instances”

This image has an empty alt attribute; its file name is image-209-1024x420.png
This image has an empty alt attribute; its file name is image-210.png

Once your instance is running:

This image has an empty alt attribute; its file name is image-204-1024x274.png

You can obtain your IP address by selecting the instance:

This image has an empty alt attribute; its file name is image-206.png
This image has an empty alt attribute; its file name is image-207.png

You can then open an SSH session:

This image has an empty alt attribute; its file name is image-208.png

You’ll receive a host fingerprint warning on first connection:

This image has an empty alt attribute; its file name is image-211.png
This image has an empty alt attribute; its file name is image-212.png

Login as: ec2-user

The AMI is based on Amazon Linux 2.

https://aws.amazon.com/amazon-linux-2/

To log onto the web front end:

Copy the IP address (don’t use the open address):

Use port 8090

Access the frontend via http://<EC2_Instance_Public_DNS>:8090 Do not use “https://” it must be “http://

You should see this:

The Landing Page is simple and spartan:

This image has an empty alt attribute; its file name is LandingPage.png

Or:

To receive email notifications sign up with SendGrid then select “SendGrid Email” on the landing page.

You’ll arrive at this page:

This image has an empty alt attribute; its file name is SendGrid_blank.png

Select the “Setup SendGrid Mail” button:

This image has an empty alt attribute; its file name is SendGrid_form-1024x496.png

Enter the e-mail address which emails will be sent from and the SendGrid API key then select the “Save” button.

This image has an empty alt attribute; its file name is SendGrid_form_completed_obscurred.png

Now time to create some pipelines:

This image has an empty alt attribute; its file name is image-216-1024x652.png

Pipelines are created by creating jobs:

This image has an empty alt attribute; its file name is image-218.png
This image has an empty alt attribute; its file name is image-217.png

Or:

To monitor logs live:

sudo tail -f /var/log/tomcat/catalina.out

You can also monitor your memory and cpu from the command line using command: “free-m” and “top -i”

To instead monitor the logs in Amazon CloudWatch:

https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/install-CloudWatch-Agent-on-EC2-Instance.html

Leave a Comment