@Marvin If I have a deployment with a schedule to run every minute, is there a risk that multiple jobs could be running simultaneously? If so, is there a way to ensure that only one flow run is executing at a time before new ones are scheduled?
m
Marvin
10/22/2024, 6:54 PM
To address your query regarding Prefect, we first need to determine the version of Prefect you are using, as the solution might differ between versions. Could you please confirm whether you are using Prefect 2.x or 3.x?
a
Adam Eury
10/22/2024, 6:55 PM
I'm using Prefect 2.x
n
Nate
10/22/2024, 6:56 PM
concurrency limits are the answer! in newest 2.x or in 3.x you can set a concurrency limit on the deployment itself
otherwise you're always free to on the work pool or work queue level as well
Nate
10/22/2024, 6:56 PM
also you have to tag @Marvin for it to respond 🙂
m
Marvin
10/22/2024, 6:56 PM
Of course! Please let me know which version of Prefect you are using, either 2.x or 3.x, and I will be happy to help you address the scheduling and concurrency control for your flow runs.