Hi there - I have a flow with a few root nodes (nodes with no dependencies) and noticed that they didn’t all kick off when the flow started - a few of them waited several hours to start. It looks suspiciously like they waited for other root nodes to complete even though they don’t depend on them. I’m using the

LocalDaskExecutor

with

threads

. Is there a max parallelization parameter of some kind that I’m unaware of?

Hey @Kevin Weiler, the answer is kind of (there will be different defaults). If you test it on your machine, I think the default is 4 threads, but if you run it on ECS, the default will be 2 threads. You can bump it up though explicitly with

LocalDaskExecutor(num_workers=4)

if you know you have more hardware.

Ah nice - yep 4 workers track. Will this default also apply to processes?

Yes you can use the

num_workers

with processes.

sorry @Kevin Kho - forgot to thank you again for this - it worked. Cheers!

Nice! 🙂