Hummm.. so I am using Prefect Cloud and I am deploying my flows to an S3 storage block.
The folder structure is like this:
Copy code
~/my-project$ ls -la
total 108
drwxr-xr-x 13 me me 4096 Jun 16 17:52 .
drwxr-xr-x 6 me me 4096 Jun 12 14:51 ..
drwxr-xr-x 3 me me 4096 Jun 15 09:39 etls
drwxr-xr-x 5 me me 4096 Jun 16 17:48 flows
drwxr-xr-x 3 me me 4096 Jun 15 09:39 lib
When I build and apply a flow, I do it from this folder and the etls and libs are all sent to S3.
There is a lib/util.py module that is shared across all flows.
My question is:
What is the proper Prefect way to deploy changes for this lib/util.py module?
If I have 1000 flows that use lib.util, am I supposed to re-deploy every flow whenever this shared util module changes?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.