Hi community, how is the best practice for implementing parallel dbt jobs using Prefect 1.0? Basically, I need to send different client_id to dbt jobs and trigger dbt run for each client_id (pseudo code as following)
Copy code
with Flow as flow:
for i in id_list:
dbt_run_function(i)
(Iām wondering if a simple for loop would achieve parallelism?)
k
Kevin Kho
07/19/2022, 7:34 PM
Hey Chu, you want mapping. For Prefect help, #CL09KU1K7 is the better channel
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.