https://prefect.io logo
Title
a

Adam

10/31/2022, 1:37 PM
Hi friends, I have separate git repos for dbt and prefect. Iā€™d like to start using prefect to schedule dbt runs but trying to understand how best to do that. Should I just make prefect first do a
git clone
of the dbt repo? Currently just using dbt cloud to run on a schedule but thinking of moving away from that towards the above solution.
k

Kevin Grismore

10/31/2022, 1:53 PM
I added a prefect flow to my dbt repo that uses prefect-dbt tasks and blocks, with the github storage block so it gets cloned at flow run time. That way when the flow runs, it can point to dbt projects that are in adjacent folders.
a

Anna Geller

10/31/2022, 2:14 PM
you can use the GitHub block for it
a blog post about it is on my radar, and will be out in 1-2 weeks
šŸ‘ 2
a

Adam

10/31/2022, 3:51 PM
Thank you both
šŸ™Œ 1
b

Ben Doremus

11/04/2022, 7:23 PM
Git submodules suck to deal with, but can work.
šŸ’Æ 1
:gratitude-thank-you: 1
m

Matthew Ferry

12/07/2022, 12:53 PM
Hi @Anna Geller! Did this blog post come out? I'm dealing with the same question and it's not clear to me exactly what (agent? Orion API? flow container?) gets access to the storage block. Would love to read more to better understand.
a

Anna Geller

12/07/2022, 9:33 PM
yup it did https://medium.com/the-prefect-blog/modular-data-stack-build-a-data-platform-with-prefect-dbt-and-snowflake-part-6-7e6d69296649 shameless self-promotion, but you can subscribe on Medium to me and Prefect blog to get email notification any time we ship a new post šŸš€
šŸ™Œ 2