Hi all, Is it possible to control how many mapped tasks are running at any one time? I have a memory issue, as my mapped task requires loading in some data, and no matter how many workers or threads I specify in the DaskExecutor, the tasks just keep spawning.

Hi Lewis, Prefect Cloud has a task concurrency feature that allows you to limit concurrent task runs by tag. Core does not have a way to do the same (it requires a coordinated backend).

And prefect cloud can only work with docker storage from what I remember?

No, thanks to our hybrid model Prefect Cloud can work with any storage — all execution takes place on infrastructure you control, exactly the same as with Core or Server. Cloud is primarily an orchestration platform, not an execution platform.

@Jeremiah I tried getting in contact with your sales team about setting up a custom plan so I can use the task concurrency limit feature you mentioned, but i didnt manage to get a reply. Would you be able to put me in contact with someone that can help me with that?

Absolutely, someone will be in touch right away - sorry!

Hi @Lewis Bails - pleasure to meet you. Do you mind sharing where you reached out? I'm looking in our inbox, contact us form, and our website messenger and can't seem to locate your inquiry. Thanks in advance as we want to ensure we are not missing something.

@David Abraham Hey David, I sent the message via the contact form at https://www.prefect.io/get-prefect#pricing. I wouldve used my work email, not that connected to my Slack account, if that helps at all.