Are there any patterns we should follow for exposing the output of a flow to other flows? As I understand it this isn’t very simple right now, but if we have a flow that outputs some data to S3 and returns the path to that data as a Result, how would we consume it downstream? i.e
Copy code
with Flow() as flow:
s3_path = get_output_from_task(project="abc", flow="test-flow")
dataframe = read_data_from_s3(s3_path=s3_path)
I see this is kind of supported by directly using the graphql API, and maybe having some convention around terminal output tasks, but I was wondering if there was a better way
k
Kevin Kho
06/29/2021, 3:24 PM
Hey @Tom Forbes, right now it is centered around using the GraphQL API to query that flow run and get the output but in the next release (0.15.0), there will be mechanisms that simplify this process removing the need to write GraphQL queries yourself.
t
Tom Forbes
06/29/2021, 3:25 PM
That is awesome to hear 😍 - is there an ETA on the release out of interest? Or perhaps a development version of the docs I can take a look at?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.