Anyone ran into weird behaviour with Task Concurrency? When the limit is 4, it will use all of these available slots (expected behaviour), but as soon as we set 6 or 8 it only allows 2 tasks to run at a time (not 100% of the potential slot capacity). The difference in total flow runtime (concurrency = 4 vs 8 ) also follows the pattern, of course
n
nicholas
09/24/2020, 6:23 AM
Hi @Arsenii - sorry you're running into that! I haven't seen this before but we'll look into it first thing in the morning.
🙇♂️ 1
d
Dylan
09/24/2020, 1:21 PM
Hi @Arsenii, is this running in Cloud? If so, can you send me the URL to this flow run?
a
Arsenii
09/25/2020, 1:35 AM
Hey everyone, I'm investigating right now if the issue has something to do with our DaskExecutor configuration instead -- will keep you posted. Thanks!