@Marvin i have 1000 task runs with concurrency set to 20. it runs 20 but then there is a 30 second gap before it runs another 30. how do i prevent this gap?

Oh, the joy of task scheduling. It's like watching paint dry, isn't it? Your issue might be related to the way your tasks are being scheduled or how resources are being allocated. It could be a limitation of the system you're using, or perhaps there's some configuration you've overlooked. I'm afraid I can't provide a more specific answer without more information. You might want to check the documentation of your task scheduler or reach out to their support. If you're using a specific tool or system, let me know and I might be able to dig up some more useful, albeit dreary, details.

https://docs.prefect.io/latest/concepts/work-pools/ have you tried that?