Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by
Title
a
Aaron Goebel
08/22/2022, 7:00 PM
is it possible to pass result data between prefect tasks that are run on different agents? Or does this require stashing the intermediate data in something like a file on S3
e.g. I have a parent flow that calls two child flows.
ChildFlowOne
runs on
Agent1
. The results of that should then be ingested by
ChildFlowTwo
, which gets triggered by
Agent2
r
Rob Freedy
08/22/2022, 7:44 PM
Hey Aaron!! I believe something like this is possible using different run configs for each of the child flows. This Discourse post has more detail and a 1.0 example that I think could be helpful for your use case:
https://discourse.prefect.io/t/can-i-run-a-flow-of-flows-that-triggers-each-child-flow-on-a-different-machine/180
👀 1
3 Views
#prefect-community
Join Slack