hi, we're trying to compose a flow of flows as sho...
# prefect-community
v
hi, we're trying to compose a flow of flows as shown here: https://docs.prefect.io/core/idioms/flow-to-flow.html. we'd like to able to say "task A1 in flow A needs the outputs from task B1 of flow B". how can we accomplish this? the examples on that page seem to indicate that basically we have to wait for upstream flows to finish before the downstream flows can get triggered, but it doesn't show how to pick out individual outputs from an upstream flow and feed them into specific tasks in downstream flows. any pointers/suggestions? looking for an idiomatic prefect way to accomplish this, if possible...cheers
j
Hi @Verun Rahimtoola currently there isn’t a way built into the StartFlowRun task for sharing these flow-to-flow dependencies however it is something that is on our radar! I know some people in the recent past have accomplished what you are after by using output caching via targets https://docs.prefect.io/core/concepts/persistence.html#output-caching-based-on-a-file-target https://docs.prefect.io/core/idioms/targets.html This allows you to persist result data in flow B and then you can have a task in flow A load data from that target
v
got it. thanks @josh!
j
hi @Verun Rahimtoola and @josh, does this remain the best strategy for passing data between tasks across different flows i.e.: caching targets?