Hey team, potentially a simple answer here but I’m trying to get Prefect set up on EC2. I’m wanting flow code to be on Github and downloaded at flow runtime (essentially CI/CD). I’m wanting to run both the server and the agents in Docker containers. The repo has all flows in a subdirectory (
repo-sub-path
below) but the code is not in the container. I’m running this command from within the container, and am getting this message:
prefect deployment build flow_test.py:flow_test --name test --storage-block github/flow-repository --path repo-sub-path
.
What am I doing wrong? Do I need to have the code sitting in the container locally to set up the deployment? Or can I have it pull from Github when first generating the deployment yaml? Is this actually possible or do I need to push my code to a docker image and manually pull that each time I update my flows?
Appreciate any insight here.
b
Brijesh
06/09/2023, 9:37 PM
Hi Liam, ideally prefect agent will run on the server and it will manage docker containers required to execute code from repository.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.