Hi everyone, I need to build a service which runs a couple of the same workflows for about 10 000 b2b clients on a daily basis. It will take and process data from their APIs on schedule according to the clients' off-hours. So I want to write that workflows with a CLIENT_ID parameter and get the same control and functionality of them (e.g. UI, parallelism, logging) as if there were personal workflows for every client. It seems there is no such possibility in Airflow. Is there one in Prefect?

Hi @Sergey Maslov! There is! You can use a

Parameter

to exactly what you’ve described. You can also use a parent flow to pull the list of client ids from somewhere and start the flow runs for each client at the time required. I’d suggest keeping the required time with the configuration for the ids. https://docs.prefect.io/core/concepts/parameters.html https://docs.prefect.io/core/idioms/flow-to-flow.html#running-dependent-flows

Dylan, thank you!

Anytime!