Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi, trying out some simple map reduce stuff on latest prefect on a dask cluster. Should I use task.submit() or can I also use task.map()?

Is there any difference in terms of what happens in the backend? Or are they identical in the sense that map just hides away the for loop?

I believe map just hides away the for loop. But maybe you can answer this better than me <@U01CEUST9B5>, <@U02H1A95XDW>

`map` is a bit more performant than a for loop as we gather all upstream dependencies concurently.

If you’re calling `map` without any upstream tasks as inputs, it’s probably going to be the same as a for loop. I believe in the future we’ll collapse mapped tasks in the UI and such to make the graph clearer.