https://prefect.io
Join Slack
Let me ask one more. I have 2 set of tasks, and I'd like to execute the second set after the first s...
# ask-community
a
Let me ask one more. I have 2 set of tasks, and I'd like to execute the second set after the first set finished. There's nothing to be passed from the first set to the second, to setup dependence or order. I guessed that set_upstream() should be used, but still the second set starts before the first set finishes. How could I handle that?
k
Could you show me how you used it? 
set_upstream
should work
a
This is how
but the schema becomes this
k
If you want all tasks to map, can you try 
script_names.set_upstream(unmapped(save_results))
upvote 1
Or you can surely do 
script_names = list_run_scripts(upstream_tasks=unmapped(save_results)
a
The suggested things did not worked, but referring the upstream by a variable did solved the problem
I would not state the I understand why does this makes a difference
k
Oh thanks for circling back. I guess because a copy of the task is created and maybe the 
set_upstream
just didn’t set correctly. From experience, this is certainly more reliable.
2 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by