are there any downsides to using the dask executor? I’m curious why the

DaskLocalExecutor

isn’t the default executor, if dask is a dep of prefect anyways.

Hey, the answer is to have the defaults be the simplest. Similar to the spirit of this tweet.

Also, I think you have to spin up a local dask cluster (the scheduler and the workers) to be able to use dask locally, while the local executor should run a thread or something (simple, easy), but I’m not too sure really

I think the scheduler - worker is when you bring in dask and distributed. The LocalDaskExecutor is a multiprocessing pool.

Hmmm, I thought I had the worker alive when I used the local executor. But maybe you just need dask installed.

Local: An executor that runs all functions locally using dask and a configurable dask scheduler.

Dask: An executor that runs all functions using the dask.distributed scheduler.

Ah I see. Yeah you’re right

The local dask executor works for me without a dask cluster

So probably I was just over complicating the execution really.