Ben Muller12/05/2022, 6:15 AM
with no cluster. It seems like about two tasks run at a time and then another two start, my assumption was that all 8 would start and Dask handles them and they finish when they are ready? I know this would be limited by the threads too, but the machine it is running on should have more than enough threads to handle those 8 tasks.
Tim Galvin12/05/2022, 6:19 AM
interface. However, as a work around, you could consider providing the specifications to a dask schedular yourself to the
so that there is an explicit number of dask workers spawned. I do this with a
Ben Muller12/05/2022, 6:35 AM
Tim Galvin12/05/2022, 8:52 AM
Mason Menges12/06/2022, 5:31 PM