Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi community, how is the best practice for implementing parallel dbt jobs using Prefect 1.0? Basically, I need to send different client_id to dbt jobs and trigger dbt run for each client_id (pseudo code as following)

```with Flow as flow:
  for i in id_list:
    dbt_run_function(i)```
 (I’m wondering if a simple for loop would achieve parallelism?)

Just posting this here also: <https://docs.prefect.io/core/concepts/mapping.html>

If we dont have a DaskExecutor, will mapping be achieved? We are using snowflake for data warehousing

I’m wondering if the mapping is the same as for loop? (no reduce needed)

Mapping will just run sequentially if you have no parallelism

But yes it is the DAG equivalent of the for loop

To ensure parallelism, i need to add daskexecutor for example right?

Thank you Kevin! I haven't use dask executor before, will that cause some fees or require some computing infra? Or i can just import it in python and it will function  

No fees because we bill per task anyway. You can just use it