Question about setting

upstream_tasks

to the same task being called twice with different arguments. I have something like

A(abcd)
B.set_dependencies(upstream_tasks=[A], keyword_tasks=...)
A(defg)
B.set_dependencies(upstream_tasks=[A], keyword_tasks=...)

where B must run after A, and each gets called with two separate sets of Parameters. If I call

B.set_dependencies(upstream_tasks=[A])

twice, will the second B wait on the second A? And is this the idiomatic way to do this?

Hi @Andrew Vaccaro! I think an easy way to handle that would be to assign task

A

to a variable each time, and then reference that variable like such:

a1 = A(abcd)
B().set_dependencies(upstream_tasks=[a1], keyword_tasks=...)
a2 = A(defg)
B().set_dependencies(upstream_tasks=[a2], keyword_tasks=...)

Oh duh I forgot you could use dummy/empty result variables to track the results of specific tasks.

Of course! 😄

Hmm actually I think only our last call to each task is actually being executed.

Oh so sorry! I wasn't looking closely enough at the code. You'll need to add another

()

to those B tasks, otherwise it's referencing the same object! I've amended the code above, sorry again!