Also, Im using DaskLocalExecutor and I'm using scheduler=processes as I believe that's recommend. I'm also specifying the number of workers, but will each worker spin up more than one thread?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
