Ayla Khan
06/14/2021, 6:18 PMLocalDaskExecutor
? I tried running this code but haven't seen any output from Dask in Prefect Cloud:
with Flow(
"simple_aggregate_flow",
executor=LocalDaskExecutor(
scheduler="processes", **{
"distributed.logging.distributed": "debug",
}),
) as simple_aggregate_flow:
...
Kevin Kho
Ayla Khan
06/14/2021, 6:42 PMKevin Kho
LocalDaskExecutor
does not rely on distributed
which is why this isn’t working. It is a multithreaded/multiprocessing scheduler, and there’s no straightforward way to get the logs here.Ayla Khan
06/14/2021, 8:53 PMLocalDaskExecutor
on Prefect Cloud?Kevin Kho
Ayla Khan
06/14/2021, 8:57 PM