Introduction to AWS Boto in Python
Maksim Pecherskiy
Data engineer
df = pd.read_csv('https://gid-staging.potholes.csv')

Oprávnění uděleno!
# Generate the boto3 client for interacting with S3 s3 = boto3.client('s3', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET)# Use client to download a file s3.download_file( Filename='potholes.csv', Bucket='gid-requests', Key='potholes.csv')









Nahrání souboru
s3.upload_file(
Filename='potholes.csv', Bucket='gid-requests', Key='potholes.csv')
Nastavení ACL na 'public-read'
s3.put_object_acl(
Bucket='gid-requests', Key='potholes.csv', ACL='public-read')
Nahrání souboru s ACL 'public-read'
s3.upload_file(
Bucket='gid-requests',
Filename='potholes.csv',
Key='potholes.csv',
ExtraArgs={'ACL':'public-read'})
Šablona URL objektu S3
https://{bucket}.{key}
URL pro Key='2019/potholes.csv'
https://gid-requests.2019/potholes.csv
Sestavení URL objektu
url = "https://{}.{}".format(
"gid-requests",
"2019/potholes.csv")
'https://gid-requests.2019/potholes.csv'
# Read the URL into Pandas
df = pd.read_csv(url)






Nastavení ACL na 'public-read'
s3.put_object_acl(
Bucket='gid-requests', Key='potholes.csv', ACL='public-read')
Nastavení ACL na 'private'
s3.put_object_acl(
Bucket='gid-requests', Key='potholes.csv', ACL='private')
Nahrání souboru s ACL 'public-read'
s3.upload_file(
Bucket='gid-requests',
Filename='potholes.csv',
Key='potholes2.csv',
ExtraArgs={'ACL':'public-read'})
Sestavení URL objektu
url = "https://{}.{}".format(
"gid-requests",
"2019/potholes.csv")
'https://gid-requests.2019/potholes.csv'
# Read the URL into Pandas
df = pd.read_csv(url)
Introduction to AWS Boto in Python