https://prefect.io logo
a

Alexander Melkoff

02/09/2022, 10:57 AM
Hello! I'm trying to figure out the way to organize code in my flow. I'm using Kubernetes agent and GitLab storage so my flow code is being pulled from GitLab into kubernetes pod. The problem is that while Prefect clones the whole repo, other python modules from the same repo are not available for import. It is not an option to store the whole flow code in a single file as it can get enormously large. How do you handle code organization within your flows?
k

Kevin Kho

02/09/2022, 2:09 PM
You like need to use Docker storage to package everything. I saw someone clone and pip install his repo as the entrypoint to his Docker container. Maybe you can find something in this discussion also
2 Views