Kyle Hansen
08/20/2021, 6:40 PM.map
within prefect. Is it guaranteed that the order is preserved across multiple maps, like a python multiprocessing.pool.map
? Or is it not a guarantee that the order is preserved, like multiprocessing.pool.imap_unordered
. I couldn't find whether this was guaranteed or not in the prefect docs
.Kevin Kho
Kyle Hansen
08/20/2021, 6:45 PMfunc.map([a, b, c])
the result I get back might be [result_b, result_c, result_a]
?
I know they might not finish computing in the same order, but from my small scale tests, it seems I'm getting back [result_a, result_b, result_c]
which I'm guessing is just an odd artifact of being lucky?Kevin Kho
a = A.map()
and B.map(a)
, the output and input will connect as expectedKyle Hansen
08/20/2021, 6:50 PMlist = [[a, b, c], [d, e, f]]
and do a func.map(flatten(list))
then my results back will be of the order [result_a, result_b, result_c, result_d, result_e, result_f]
?Kyle Hansen
08/20/2021, 6:52 PMmapping
section of the documentation and subsequent examples (eg. Flat-mapping), but I couldn't find anywhere it explicitly says that is guaranteed to be true.Kevin Kho
Kevin Kho
Kyle Hansen
08/20/2021, 7:39 PM