Hey folks, I'm thinking about using Prefect at a medium-sized company. I'm looking for guidelines on how to set up a flow that spans multiple teams / code repos. For example, node A in the dag may be owned by team A, runs in container A, outputs a large dataset to be consumed by the node B, owned by team B, in container B. Does anyone know of best practices for such a situation?

What about committing to specific flow names between teams and using the StartFlowRun from within Team “A”’s Flow to start Team “B” Flow? https://docs.prefect.io/api/latest/tasks/prefect.html#startflowrun

Hm that might work too

@Robert Sokolowski I like @Raphaël Riel's idea of separate Flows as that will get you the best isolation / independence and be very simple. If you really need code from multiple teams to be in one Flow you might look at using git submodules. We do this in several cases, not specifically for Prefect Flows, but in principle I think it could address your needs. Nice intro that also includes some caveats/cautions: https://github.blog/2016-02-01-working-with-submodules/

Thanks for the suggestions, I'll try them both and ask the team what we prefer