I'm trying to migrate Dask cluster from prefect-1 to prefect-2.
Is there a way to define the storage block for the Dask worker? or a way to transfer the project files from prefect flow container into the dask worker container? We have a flow that imports methods from a separate .py file and we get ModuleNotFoundError when trying to run the flow
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.