We need to copy the contents of a bucket to a new account in a different AWS region.

I have a python script running in Windows that downloads files from an AWS S3 bucket to a Windows File Explorer folder. Before the download, I am trying to check if the file is already there. The section of My code is below. It is writing empty files after adding code to check if file exists. This code worked fine before I added the code to check if file exists (if not os.path.isfile(checkfileexists):).

It works fine with up to 21 files, takes a couple of seconds. But if I try feeding it more than 21, it hangs indefinitely and times out (> 30 seconds). From what I saw online, I am very far from hitting the S3 concurrent requests limit (which should be in the thousands), so I’m really not sure what could be happening.

Hi guys Im currently integrating my local ETL Pipeline into AWS cloud platform. Im using Amazon MWAA service for this. I currently have a problem with loading my retrieved data into an excel file which is inside my s3 bucket. With my local pipeline I use openpyxl to manipulate the excel file, below are the code for my local etl pipeline (this function is to load the data into the excel file in my local folder.