AWS, Big Data, Cloud, Hadoop

First Look ETL in the AWS Cloud – Data Pipelines

I tried out creating a data pipeline (ETL process) on the AWS cloud this morning.  This currently works with AWS data sources, such as S3, DynamoDB and RDS.

AWS Services
AWS Services

I found that I did need to read the AWS documentation in order to create even a simple pipeline.  Below is an example of a simple copy job in the data pipeline designer.

AWS copy job data pipeline
AWS copy job data pipeline

Enjoy the screencast

One thought on “First Look ETL in the AWS Cloud – Data Pipelines

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s