Hi community, how is the best practice for implementing parallel dbt jobs using Prefect 1.0? Basically, I need to send different client_id to dbt jobs and trigger dbt run for each client_id (pseudo code as following)

with Flow as flow:
  for i in id_list:
    dbt_run_function(i)

(I’m wondering if a simple for loop would achieve parallelism?)

Just posting this here also: https://docs.prefect.io/core/concepts/mapping.html

If we dont have a DaskExecutor, will mapping be achieved? We are using snowflake for data warehousing

Mapping will just run sequentially if you have no parallelism

To ensure parallelism, i need to add daskexecutor for example right?

or LocalDask, yep

Thank you Kevin! I haven't use dask executor before, will that cause some fees or require some computing infra? Or i can just import it in python and it will function

No fees because we bill per task anyway. You can just use it