tom
10/08/2020, 5:27 PMprefect server start
) and my flows are executing via the agent (prefect agent start
). I was wondering how I could get them to run on Dask? I have dask-scheduler
and a few dask-worker
processes running. When I run my flow using flow.run(executor=DaskExecutor(address="<tcp://xxx:8786>"))
everything works well, but when I run the flow via prefect server’s UI it doesn’t run on Dask. What am I missing? I tried running the server and agent with export PREFECT__ENGINE__EXECUTOR__DEFAULT_CLASS="prefect.engine.executors.DaskExecutor"
and export PREFECT__ENGINE__EXECUTOR__DASK__ADDRESS="<tcp://xxx:8786>"
set but this didn’t help.Chris White
tom
10/08/2020, 6:30 PMSuchindra
02/18/2021, 2:08 AMwith Flow("...", run_config=LocalRun(), executor=executor) as flow: