https://prefect.io logo
Title
z

Ziyao Wei

04/25/2020, 4:34 PM
Do prefect support Airflow’s
max_active_runs
or similar options?
n

nicholas

04/25/2020, 4:39 PM
Hi @Ziyao Wei - at the flow level, not right now. Task tag concurrency is a Platform-level feature of Prefect Cloud but isn't quite the same thing. However! @Alex Cano has a work in progress PR here that would introduce this functionality to Prefect Server, which I believe will match the same DAG restrictions that
max_active_runs
has in Airflow 🙂
👋 1
z

Ziyao Wei

04/25/2020, 4:43 PM
That sounds nice, thanks @Alex Cano and @nicholas!
😄 1
p

Pedro Machado

04/28/2020, 1:55 AM
A related question ... what is the recommended pattern to rate limit access to an API? Suppose you have a task that returns items and you want to map that output to a task that queries the API for each item. What is the recommended way to rate limit those calls to the API?
n

nicholas

04/28/2020, 1:57 AM
Hi @Pedro Machado! Would you mind asking your question in the general #prefect-community channel so we can start a new thread? 🙂