Hey all,
we recently updated our prefect cluster from version 0.15.10 to major version 1.0.0.
We used an existing DaskCluster to distribute our flowruns, which we could simply do by setting envs
PREFECT__EXECUTOR__DEFAULT_CLASS
and
PREFECT__EXECUTOR__DASK__ADDRESS
in our agent.
Unfortunately, this approach doesn't seem to work anymore. I'm pretty sure we could initialize a DaskExecutor in our code
and attach it to our flow somehow, but this would be undisireable, as it requires changing each of our existing flows, but also
for each flow to come.
Is it possible to achieve the same kind behaviour as before, i.e. defining the execution engine for the agent, by simply setting 1 or 2 envs?
a
Anna Geller
03/21/2022, 10:32 AM
The environments have been deprecated since 0.14 and in 1.0 they have been removed completely. Also, the imports for executor have changed, so instead of
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.