Ryan Connolly
01/19/2020, 4:17 PMLOOP
mechanism from the functional api... but I was having a harder time grokking that concept.
I'll attach an example of the prefect-core code if anyone is interested.emre
01/19/2020, 9:34 PMLOOP
is that a looping task would be represented as a single task, tasks generated in the middle of the loop cant have their own downstream tasks. You want a single model task that loops to generate model[0], model[1]
and so forth, but attaching the model task as an upstream task to post
or cmp
would only attach it to the final task of the loop.LOOP
ing model
task, then use a dummy task that maps over the result list, to which cmp
and post
are downstream to. With a little bit of custom logic, you could handle the case of cmp[n]
being downstream of post[n-1]
. You could probably get rid of the dummy task as well, its too late here to properly think about it