Question on Prefect 2.0... how is work on a

map

operator coming? That is a big stumbling block for us adopting 2.0. Thanks!

Why doesn’t a for loop suffice for your use case? Map would probably be a bit further because it would need to integrate with Ray/Dask

The for loop doesn't seem to be actually parallel in my testing. and that is what we use

map

for. to parallelize across a local Dask cluster. We have some flows that have to make a lot of API calls and they already take an hour or so in 5x parallel

Ah ok i know what you mean but you can try list comprehension:

[task_one(x) for x in items]

this will be parallel compared to the for loop because for loop makes it easy to block execution

hmm, thank you. I will look into it!

for item in items:
    a = task_one(item)
    b = task_two(a).result()

will wait for a to complete from the previous loop iteration i think because of the result call. Very easy to run into this