Hey I struggle a little bit with DBT Do I need to add dbt co

Question

Hey I struggle a little bit with DBT Do I need to add dbt core amp amp dbt postgres if I added prefect dbt

Kevin Kho · Answer

Hey Maverick I need to get someone with more dbt knowledge than me to respond Could you move the code to the thread though when you get the chance

Maverick Humbert · Answer

Yes of course

Maverick Humbert · Answer

I pull my DBT project amp copy profiles yml in ~ dbt `def pull dbt repo ` `github token = os environ get GITHUB ACCESS TOKEN ` `shutil rmtree dbt ignore errors=True Delete folder on run ` `dbt repo name = dbt thesandbox ` `dbt repo = ` `f https github token <mailto x oauth basic github com|x oauth basic github com> xxx dbt repo name ` ` ` `pygit2 clone repository dbt repo dbt ` `pathlib Path os path expanduser ~ dbt mkdir parents=True exist ok=True ` `shutil copy dbt dbt thesandbox profiles yml os path expanduser ~ dbt ` I setup the dbt task amp link profiles dir to ~ dbt `dbt = DbtShellTask ` `profiles dir=os path expanduser ~ dbt ` `log stdout=True ` `log stderr=True ` `overwrite profiles=True ` `profile name= dbt thesandbox ` `helper script= cd dbt dbt thesandbox ` ` ` Execute a specific dbt model `try ` `history marts = dbt ` `command= dbt run select models marts tsb history ` `upstream tasks= transfer final ` ` ` `except Exception as e ` `print e ` Result with prefect dbt ` tmp prefect q5dqm2jn line 2 dbt command not found` `FAIL signal raised FAIL Command failed with exit code 127 ` Result with dbt core amp dbt postgres dependencies + prefect dbt `Could not run dbt Command failed with exit code 2` BUT it s working with `dbt debug config dir` amp fail with `dbt run select models marts tsb history` Is my helper script wrong Is the path wrong somewhere Should I delete deps dbt core amp dbt postgres Thanks for your help

Nate · Answer

hey < Maverick Humbert> there isn t actually a `dbt` extra for the `prefect` pypi distribution you should have seen something like ``` pip install prefect dbt Collecting prefect dbt WARNING prefect 1 2 2 does not provide the extra dbt ``` when trying to install it so you d need to install `dbt core` and any other dbt packages yourself to your venv

Maverick Humbert · Answer

Thanks That s what I though so I quickly added the dependencies for that My flow is now working but I don t understand something looks like my `helper script` is not linked with my `command` My ` select` should be wrong with that `helper script` right `dbt = DbtShellTask ` `profiles dir=os path join os path expanduser ~ dbt ` `log stdout=True ` `log stderr=True ` `overwrite profiles=False ` `profile name= dbt thesandbox ` `helper script= cd dbt dbt thesandbox ` ` ` `schedule = Schedule clocks= CronClock 30 0 ` `with Flow LAND s Old amp Current Create history schedule=schedule as flow ` `pull repo = pull dbt repo ` `transfer final = tx receipt ` `history marts = dbt ` `command= dbt run select dbt dbt thesandbox models marts tsb history ` `upstream tasks= transfer final ` ` `