I am testing deploying flow to S3 using storage block in prefect 2.0. When I start running flow using Prefect Cloud UI. The agent acknowledged flow run submitted, but wait for 3+ minutes before it starts executing flow run. Does the agent download code in S3 before it starts the execute flow run?

Hi Patrick! Yeah the flow will only move to a running state when your code is about to be executed.

Typically I starts 30-40 flow run concurrently. Isn't it redundant to download same code for every flow run?

Perhaps there’s some room for optimization there! Generally people are running their flows on isolated infrastructure like containers.

Currently we run our flow in one AWS ECS container, The purpose of moving storage to S3 is to scale with running multiple containers. However, Development is in macbook. I tested running agent in an empty folder and flow run failed, I expected code to be download to the empty folder but I do not see anything there. Where does the code download to?

It gets downloaded to a temporary directory

How do you handle PYTHONPATH?If it is in a temporary directory, I cannot specify PYTHONPATH

I believe we push the temporary directory onto the PYTHONPATH