How can I include logs from dbt in the prefect logs? I tried setting PREFECT_LOGGING_EXTRA_LOGGERS=d...
a
How can I include logs from dbt in the prefect logs? I tried setting PREFECT_LOGGING_EXTRA_LOGGERS=dbt
Copy code
from prefect import task, flow, get_run_logger
from dbt.cli.main import dbtRunner, dbtRunnerResult


@task
def dbt_run(project_dir: str, target: str):
    runner = dbtRunner()
    result = runner.invoke(
        ["run",
         "--project-dir", project_dir,
         "--profiles-dir", project_dir,
         "--target", target])
s
Hi Andreas, if you use prefect-dbt, those logs will be included by default. For example:
Copy code
@flow
def trigger_dbt_flow() -> str:
    result = DbtCoreOperation(
        commands=["pwd", "dbt debug", "dbt run"],
        project_dir="your_project",
        profiles_dir="~/.dbt"
    ).run()
    return result
will produce these logs in Prefect: