I would like to understand how to get data sets from registry.opendata.aws to my S3 bucket.
I could access the Public S3 Bucket for Openaq(air quality) data sets at https://openaq-fetches.s3.amazonaws.com/index.html ( https://openaq-fetches.s3.amazonaws.com/realtime/2019-09-20/ )
That folder has around 30 files, and I want to copy all these files from Public S3 bucket of registry.opendata.aws to My local(My aws account) S3 bucket.
Please share if you could find a way to easily copy these to another(your own) S3 bucket.
Appreciate your help!
1 Answers
Hi Arjun,
You could probably copy the data using the AWS CLI presuming the OpenAQ bucket has public read, which I think it does. Something like:
aws s3 sync s3:/path-to-openaq-files/ s3:/path-to-my-bucket/
Yes it has the S3 bucket public
aws s3 sync s3://openaq-fetches/realtime/2019-09-20/ s3://path-to-my-bucket/
Hello,