I have a sub_flow that needs to be called by several parent flows. I can do this programmatically and treat the flow as a module and import into each parent flow, but, is there a way I can leverage prefect to do this? For example, can I 'register' a sub flow in prefect and then call it from a parent flow, where the subflow would run within the parent flows infrastructure (not it's own k8s job)? I see that I can use a deployment to deploy the sub flow with the
process
infrastructure setting, but then the sub flow is run by an agent, not the parent flows infrastructure.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.