Can prefect run flows in parallel? I know in tasks you can run <task_function>.submit. Can this be done for flows/subflows?

hi @Charles Leung -

my_task.submit()

will execute tasks concurrently using the

ConcurrentTaskRunner

by default, if you want actual parallelism you'd have to use

DaskTaskRunner

or

RayTaskRunner

. as of now, there is not a

my_flow.submit()

method, but you can

asyncio.gather(*subflow_calls)

there is also experimental behavior to run many subflows in at the same time on a served process does one of the above suit your use case?

If the flows have deployments created, I think

run_deployment

will run them in parallel and then you can use

gather

to wait until they all finish.

We want to use flows because we have a large deployment that encompasses a lot of deployments