and use a single "orchestrating" flow to run each flow in turn. If the orchestrating flow is run with a
flows will be executed at a time. For example:
See https://docs.prefect.io/core/idioms/flow-to-flow.html#scheduling-a-flow-of-flows for more information on using
start_flow_run = StartFlowRun("your-csv-flow", wait=True) with Flow("orchestrating-flow") as flow: # run_parameters takes a list of dicts of parameters to run your-csv-flow with run_parameters = Parameter("run_parameters") start_flow_run.map(parameters=run_parameters) flow.executor = LocalDaskExecutor(num_workers=8) # only 8 flows will run concurrently
) would handle manage your resources, ensuring that tasks only run when resources are free. Either pattern works, depends on how you intend to use these flows.