Getting ready for the first stream

Streaming de dados com AWS Kinesis e Lambda

Maksim Pecherskiy

Data Engineer

End goal

End goal

End goal

End goal

dcUser

A destination S3 bucket

s3 = boto3.client('s3', 
                  aws_access_key_id=AWS_KEY_ID, 
                  aws_secret_access_key=AWS_SECRET, 
                  region_name='us-east-1')

s3.create_bucket(Bucket='sd-vehicle-data')

Add permissions to user

Add permissions to user

Add permissions to user

Add permissions to user

Add permissions to user

Add permissions to user

New powers

A note on security

A note on security

New powers

Firehose stream permissions

Roles vs users

• Live in IAM
• Have permissions policies
• Only attach to other services
• Do not have keys nor login

• Live in IAM
• Have permissions policies
• Can act on their own
• Can have keys or login

Review - end goal

Review

Review

Review

Let's do it!

Streaming de dados com AWS Kinesis e Lambda