https://prefect.io logo
Title
a

Ayla Khan

06/14/2021, 6:18 PM
Has anyone gotten Dask debug logging working with
LocalDaskExecutor
? I tried running this code but haven't seen any output from Dask in Prefect Cloud:
with Flow(
        "simple_aggregate_flow",
        executor=LocalDaskExecutor(
            scheduler="processes", **{
                "distributed.logging.distributed": "debug",
            }),
) as simple_aggregate_flow:
...
k

Kevin Kho

06/14/2021, 6:25 PM
Hey @Ayla Khan, I’ll look into this
a

Ayla Khan

06/14/2021, 6:42 PM
Thank you!
k

Kevin Kho

06/14/2021, 7:50 PM
The
LocalDaskExecutor
does not rely on
distributed
which is why this isn’t working. It is a multithreaded/multiprocessing scheduler, and there’s no straightforward way to get the logs here.
a

Ayla Khan

06/14/2021, 8:53 PM
Ok, thank you for following up. Are there other techniques I could use to debug a flow using
LocalDaskExecutor
on Prefect Cloud?
k

Kevin Kho

06/14/2021, 8:56 PM
I am not seeing a way unfortunately.
a

Ayla Khan

06/14/2021, 8:57 PM
Thank you anyways!