Josh01/22/2021, 10:25 PM
tasks. My suspicion is that the flow is not releasing the memory of the files being transferred. Is there any way to ensure the file contents are being released from memory?
Spencer01/22/2021, 10:35 PM
to disk and then
. Highly suggest using the built-in
library to simplify management of disk space.
with tempfile.NamedTemporaryFile('w+') as f: s3_client.download_fileobj(bucket, key, f) f.flush() f.seek(0) blob.upload_from_filename(f.name)