Hi everyone — I have a task that is mapped over a list, and I have a subsequent task that must only run after all the branches of the previous task map are done, however the tasks are not data dependant. I’m trying to specify “upstream_tasks” but it’s giving me a weird error as it appears it is trying to run the task?
1 year ago
Hey again, I believe this thread is exactly your issue and the solution is to just add a reduce step at the end
As long as you have the reduce at the end, this should work. The reduce can even just be a logging step. that returns None.