Bruno Murino

    Bruno Murino

    1 year ago
    Hi everyone — I have a task that is mapped over a list, and I have a subsequent task that must only run after all the branches of the previous task map are done, however the tasks are not data dependant. I’m trying to specify “upstream_tasks” but it’s giving me a weird error as it appears it is trying to run the task?
    Kevin Kho

    Kevin Kho

    1 year ago
    Hey again, I believe this thread is exactly your issue and the solution is to just add a reduce step at the end
    As long as you have the reduce at the end, this should work. The reduce can even just be a logging step. that returns None.
    Bruno Murino

    Bruno Murino

    1 year ago
    nice! It worked quite well, thanks!