Hi there, I have a flow of flows (a, b, and parent flow p). Flows a and b both query different databases, build a dataframe, do some processing, and then store them elsewhere. I want to make a third flow, c, that merges these dataframes. Is it possible to input the dataframes into flow c without having to load them from the new db or read them from a csv? In other words, can I pass them into flow c, e.g. using the parent flow?

Hey @Blake List, quick answer is no. In-memory data transfer is confined to a flow and the subflows spin up new processes (executors) so it has to be persisted somewhere then loaded in. The best thing you can probably do is save it as a parquet.

i believe 0.15.0 added a task to facilitate this, although i haven't used it yet and can't be sure it's exactly what is required here