Martim Lobao
09/08/2021, 5:23 PMKevin Kho
Martim Lobao
09/08/2021, 6:26 PMLocalDaskExecutor
for this particular flowKevin Kho
flow.executor = LocalDaskExecutor(scheduler="threads", num_workers=8)
Are you specifying the num_workers
? Are you running on local or ECS? I have seen cases where local uses the CPU count (4) and then ECS just uses 2 by default.Martim Lobao
09/09/2021, 11:43 AMMartim Lobao
09/09/2021, 11:43 AMMartim Lobao
09/09/2021, 11:45 AMscheduler="threads"
? this is the default value for the scheduler, right?Kevin Kho
Martim Lobao
09/09/2021, 2:17 PMKevin Kho