https://prefect.io logo
Title
m

madhav

03/07/2022, 2:24 PM
Is there any documentation/examples/recipes for how to deploy custom private modules in a github repo with a flow?
k

Kevin Kho

03/07/2022, 2:25 PM
Github storage doesn’t pull the custom modules. You need to package it as a Docker container. This may help with that
m

madhav

03/07/2022, 2:25 PM
got it, thank you. Will take a look at this!
thanks Kevin, this is really helpful. I suppose the pattern is to develop/deploy docker images on code changes. I am new to doing this - do you have a recommended resource that has strategies for that? (I've found some myself, but curious if there are some you think fit well with prefect)
k

Kevin Kho

03/07/2022, 3:23 PM
Depends. If the custom module doesn’t change a lot, you only need to deploy the docker image one, and then you can use Github Storage + DockerRun to run the Flow on top of the Docker image. You may also find some insight here about CI/CD but it’s highly dependent on what stack you use. Maybe look into Github Actions? But also, DockerStorage can do it for you to build upon registration
m

madhav

03/07/2022, 3:28 PM
Got it, thanks
adding to this thread - are there any examples of how to authenticate to github packages. We are using ghcr.io as our container registry, using docker storage. We need to authenticate to ghcr.io since our container/image is private.
k

Kevin Kho

03/28/2022, 5:47 PM
As long as the agent is authenticated, you will be able to pull/push from a private repo
m

madhav

03/28/2022, 6:13 PM
Got it. that makes sense, thank you!