Lewis Bails
09/22/2020, 9:54 AMflow.environment = LocalEnvironment(
executor=DaskExecutor(
adapt_kwargs={
"minimum": 1,
"maximum": 5,
},
),
)
FWIW, I'm using prefect 0.13.2, dask 2.26.0, distributed 2.26.0Jim Crist-Harif
09/22/2020, 1:56 PMflow.run(executor=...)
with the same executor configured above?
• Does your flow run fine with a local environment configured with a DaskExecutor
(without the adapt_kwargs
)? This will create a local cluster based on the amount of cores available to your local run. If this works, there's a bug in adaptive scaling for the local cluster (unlikely, but possible).Lewis Bails
09/24/2020, 8:27 AMJim Crist-Harif
09/24/2020, 1:37 PMNo luck getting it going with the Agent after removing the DaskExecutor arguments.Just to check, did you re-register the flow after making that change (to make sure you were using the updated code)? --- A few other questions: • Can you successfully run any flow on the agent (one that doesn't use dask at all?) • What agent are you using? If you're using the local agent, can you use
--show-flow-logs
when starting the agent to get stdout from the flow runs? This will let you see all stdout output from prefect, not just log messages (dask logs generally aren't picked up by prefect, but will aid in debugging). Using the following executor would also give you more log output:
executor = DaskExecutor(cluster_kwargs={"silence_logs": 10})
Lewis Bails
09/25/2020, 5:48 AM