Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Do prefect support Airflow’s `max_active_runs` or similar options?

Hi <@U010HRLNEBV> - at the flow level, not right now. <https://docs.prefect.io/orchestration/concepts/task-concurrency-limiting.html#task-concurrency-limiting|Task tag concurrency> is a Platform-level feature of Prefect Cloud but isn't quite the same thing.

However! <@ULL3EMPDL> has a work in progress <https://github.com/PrefectHQ/prefect/pull/2382|PR here> that would introduce this functionality to Prefect Server, which I believe will match the same DAG restrictions that `max_active_runs` has in Airflow :slightly_smiling_face:

That sounds nice, thanks <@ULL3EMPDL> and <@UN6FTLFAS>!

A related question ... what is the recommended pattern to rate limit access to an API?

Suppose you have a task that returns items and you want to map that output to a task that queries the API for each item.

What is the recommended way to rate limit those calls to the API?

Hi <@U012CK03GBA>! Would you mind asking your question in the general <#CL09KU1K7|> channel so we can start a new thread? :slightly_smiling_face: