Hi I have run the crawler(s) many times, but no table is created at the end of the scan and no errors reported. Cannot see where it is going wrong. the S3 bucket path is s3://openaq-fetches/realtime/2018-10-09/. When I look at the DB after the crawler has finished there is just empty space. Any Ideas?
Almost every time this issue comes up, it has to do with insufficent permissions in the IAM role given to the crawler on the S3 buckets. Be sure you explicitly grant access to the OpenAQ Fetches bucket.
I had to leave this for a while and come back to it. But yes I have the IAM as
And it still does not work. (forget the lack indentations just a cut and paste). The Pole was created by the glue console.