? is this just another way of applying mapping, or should we always be setting
mapped=True
if the upstream task is mapped? (we usually use
Task.map()
when mapping tasks)
k
Kevin Kho
08/19/2021, 5:19 PM
Hey @Kathryn Klarich, are the two tasks related? Do you want the upstream to finish all the mapped runs before proceeding to the downstream task?
Kevin Kho
08/19/2021, 5:22 PM
I think the purpose of that is if you have task A with mapped runs A1, A2, and A3. And then you have B1, B2, and B3, You can chain B1 as the downstream to A1 so B1 will run after A1 finished if
mapped=True
k
Kathryn Klarich
08/19/2021, 8:07 PM
Thanks Kevin! I'm not 100% sure I understand but we are testing it out right now.
k
Kevin Kho
08/19/2021, 8:10 PM
The short answer I think is that you should set
mapped=True
is the upstream task is mapped.
k
Kathryn Klarich
08/19/2021, 9:46 PM
Ok i think doing this did what we were hoping it would do!
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.