New to using Prefect there s gotta be something I m missing

Question

New to using Prefect there s gotta be something I m missing in setting up Deployed in GCP using Prefect CLI and dbt and BigQuery Just trying to write a simple flow for testing I used the server UI to save a block for the link to my test dbt repo The repo is public I m trying to reference that block in my flow and I just keep getting an error that the project dir path is invalid

Kevin Ruprecht · Answer

Screen Shot 2023 05 01 at 3 45 30 PM png

Sean Williams · Answer

What happens if you change line 11 to `project dir=github block get directory `

Kevin Ruprecht · Answer

Screen Shot 2023 05 01 at 4 33 28 PM png Screen Shot 2023 05 01 at 4 33 51 PM png

Kevin Ruprecht · Answer

if i used ` github block ` as the value for project dir that at least moved the error to profiles dir

Kevin Ruprecht · Answer

and the error i get using github block for the project dir is `ValueError Since overwrite profiles is True or profiles path is empty need `dbt cli profile` to write a profile`

Kevin Ruprecht · Answer

which i don t really understand because i m using dbt cli profile

Sean Williams · Answer

That is a confusing message I think it wants a new line below line 14 explicitly specifying `overwrite profiles = True`

Kevin Ruprecht · Answer

I get `profiles dir value is not a valid path`

Kevin Ruprecht · Answer

i may need to try defining credentials profile values manually instead of using blocks just to make sure my definitions work

Sean Williams · Answer

Ah try changing `profiles dir` to `dbt cli profile`

Sean Williams · Answer

`dbt cli profile=dbt cli profile`

Kevin Ruprecht · Answer

Oh ok I will try that later tonight Thank you

Kevin Ruprecht · Answer

Tried it and now I m getting the same error as this thread <https prefect community slack com archives C0470L5UV2M p1681118539881009> But I m using BigQuery GCP not Snowflake

Kevin Ruprecht · Answer

ultimately i think the problem is that my code for the dbtCoreOperation is not correctly utilizing the GitHub block I may have gotten beyond the dbt profile issue but trying to use a remote GitHub repo for the actual dbt code to execute doesn t seem to be working Don t know why I get this error `project dir value is not a valid path type=type error path `

Kevin Ruprecht · Answer

I kinda think having prefect related code and my dbt project code in the same repo would be advisable here