Rohan Chutke

08/13/2022, 12:25 AM
Hi All, I am using Prefect Cloud. In one of the flows, its trying to upload a file to s3 which is about ~900MB. And the flow is stuck since hours trying to upload that file to s3. Any solutions/ suggestions would really be appreciated. Thanks

Ron Schulz

08/13/2022, 1:09 AM
Hey @Rohan Chutke, It may be the case that the file is too large. You may want to try breaking it down into 4-5 smaller files and flows. This article could be helpful.

Rohan Chutke

08/13/2022, 1:27 AM
Hey @Ron Schulz, I initially used prefect server and it ran without any delays/ stalling. Its just happening with prefect cloud? Is it something like cloud specific?

Anna Geller

08/13/2022, 11:57 AM
Could be an issue with S3 permissions - worth checking with a small file to validate
In 1.0 you can pass checkpoint=False to disable persistence - this might help too