I'm trying to trigger a cli dbt command in prefect but getting this error

[0m20:39:10  Encountered an error:
Compilation Error
  dbt found 3 package(s) specified in packages.yml, but only 0 package(s) installed in dbt_packages. Run "dbt deps" to install package dependencies.

here's my command

trigger_dbt_cli_command.with_options(name=f"transform").submit(
        command=f"dbt run --models some_model",
        profiles_dir=dir,
        project_dir=dir,
    )

I see the dbt deps get installed when I build my docker container so not quite sure what's happening

I'd speculate that the dependencies aren't getting installed in the correct directory.

hmmm that's definitely possible. let me tweak some stuff in my dockerfile and confirm. thank you for the suggestion @Sean Williams!

It might be easier to use

DbtCoreOperation

because you can supply more than one dbt command, and manage the dependencies that way.

from prefect_dbt.cli.commands import DbtCoreOperation
from prefect import flow

@flow
def trigger_dbt_flow() -> str:
    result = DbtCoreOperation(
        commands=["dbt deps", "dbt build -t prod"],
        project_dir="prefect_demo",
        profiles_dir="~/.dbt"
    ).run()
    return result

if __name__ == "__main__":
    trigger_dbt_flow()

can I stream the output using DbtCoreOperation? or would I need to wait for the task to complete before seeing the output?

You should be able to see the logs as they're generated

yes! I'm able to see the output of the dbt run now, just not the dbt deps but running them both in one is working for me now

The top level target in your

profiles.yml

file is the default. You only need to supply a target if you have additional targets and you want to override the default

correct, we have a default profile we use for local dev, and I want to apply the prod profile in my flow

How are you creating that file in your container for production?

it's in our profiles.yml in our repo, not via a block

Yep!

thank you again sean!!