I feel like this must be pretty basic: Is there a way to combine/string together multiple flows?

Hi Tobias, not at the moment. If you want to express dependencies, your best bet is to do so using tasks within a flow. You can also call

flow.run()

in a task, but I'm not sure if that's what you're looking for.

Hi Tobias, can you tell me a little more about your use case? In what way are your flows dependent on one another?

Not in any sort of deep way. I had thought of a flow as a distinct sequence of steps and had thought that it’d be easy to compose these sequences such that one must run after another

would either of these options work?

interesting - the

set_upstream

pattern with

reference_tasks

that @Luke Orland is suggesting, coupled with

flow.update(other_flow)

might do the trick: https://docs.prefect.io/api/unreleased/core/flow.html#prefect-core-flow-flow-update

I've been able to do this successfully (at least for a PoC) using

.update

and

.replace

. The result is correct but not entirely satisfying since routing the results correctly requires some a priori knowledge of the task names. It looks like

set_upstream

may be a better approach?

@Luke Orland Yeah, both of those would work. setting an entire flow as upstream would mean that the entire flow has concluded vs. just requiring that its reference tasks have run to completion?

It appears that making a

class FlowTask(prefect.Task)

where the run method is running another flow as @Zachary Hughes suggests works reasonably well. I'm not sure if this hinders optimizations, though.