@Marvin does map use Dask automatically?

In Prefect, when you use

.map()

it provides an implementation that automatically creates a task run for each element of its input data. However, the provided documentation does not explicitly state that Dask is used automatically with the map operation. The

.map()

mechanism in Prefect facilitates the parallel execution of tasks over a collection of inputs, but whether Dask is involved under the hood would likely depend on the execution environment you're using. Some Prefect executors do use Dask for distributed execution, so if you're using one of those executors, then Dask might be utilized indirectly when mapping. For definitive information, you should consult the specific documentation or configuration for the execution environment you're using with your Prefect flows. You may find further details in the Prefect Task documentation.

> does map use Dask automatically? yes, if you have specified a

DaskTaskRunner

since

map

will call

submit

for you under the hood for each item in the iterable

@Nate if I designate a top level TaskRunner....does that mean that all tasks in the flow need to be submitted? For example, if I have a snowflake query task I run and then use the results to map over chunks for submitting tasks to the Dask Cluster