Hi @Ziyao Wei - at the flow level, not right now. Task tag concurrency is a Platform-level feature of Prefect Cloud but isn't quite the same thing.
However! @Alex Cano has a work in progress PR here that would introduce this functionality to Prefect Server, which I believe will match the same DAG restrictions that
has in Airflow 🙂
04/25/2020, 4:43 PM
That sounds nice, thanks @Alex Cano and @nicholas!
04/28/2020, 1:55 AM
A related question ... what is the recommended pattern to rate limit access to an API?
Suppose you have a task that returns items and you want to map that output to a task that queries the API for each item.
What is the recommended way to rate limit those calls to the API?
04/28/2020, 1:57 AM
Hi @Pedro Machado! Would you mind asking your question in the general #prefect-community channel so we can start a new thread? 🙂