Hello, Is there any way to integrate Prefect "natively" with dbt, like Dagster-dbt or Airflow-dbt? (like instead of dbt run command in a task, each dbt model become a task, and we can oversee DAG of dbt)

Yep! @Kevin Grismore is best to chat about it with

@Kevin Grismore Can you point me to some helpful tutorials/links?

dbt model become a task, and we can oversee DAG of dbt

this isn't something the dbt integration does right now - we actually tried that solution and all it ended up doing was slowing down dbt's execution without offering much in return to users. Prefect's in-process task concurrency is built around running multiple threads, which is something that's already built directly into dbt. I'm curious to know how the other approaches help. Is it just about visualizing dbt's DAG without having to do

docs generate / serve

, or is there some kind of scaling benefit you get too?

a couple of things come to mind: 1. first, being able to visualize the dbt DAG and see the status of each step, like whether it completed or failed. 2. second, from an operations standpoint, I'd like to monitor and get alerts when specific dbt's ETL processes fail, and then easily re-run them in Prefect. Right now, Prefect shows everything as successful, even if parts of the dbt pipeline are failing.