Is it possible to use GitHub storage for a codebase that spans multiple files with the Kubernetes agent? Im getting moduleNotFound errors when I try to run flows from Prefect Cloud. I have tried a few variations of the file structure, but I was unable to shell in to the pod to verify that all the files are being fetched from github, as it is terminating right away. Do I need to be using docker storage or is this probably an issue with my settings?
k
Kevin Kho
01/13/2022, 10:41 PM
Hi @Justin Grosvenor, no Git/GitHub storage is not intended for that. Even if we cloned it, it wouldn’t be installed as a module so we leave the package management to the user. So you need Docker storage for this, or you can use GitHub storage and then use DockerRun to run the flow on top of an image that contains the dependencies
j
Justin Grosvenor
01/13/2022, 10:42 PM
Thanks for the quick reply! Thats exactly what I needed to know. Cheers
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.