Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

image (1).png

Anyone ran into weird behaviour with Task Concurrency? When the limit is 4, it will use all of these available slots (expected behaviour), but as soon as we set 6 or 8 it only allows 2 tasks to run at a time (not 100% of the potential slot capacity). The difference in total flow runtime (concurrency = 4 vs 8 ) also follows the pattern, of course

Hi <@UR914ST7H> - sorry you're running into that! I haven't seen this before but we'll look into it first thing in the morning.

Hi <@UR914ST7H>, is this running in Cloud? If so, can you send me the URL to this flow run?

Hey everyone, I'm investigating right now if the issue has something to do with our DaskExecutor configuration instead -- will keep you posted. Thanks!