Kelvin DeCosta
10/07/2022, 12:11 PMdataflow-ops
repo and I am planning to create an ECS service for a Prefect Agent that submits ECS Tasks that run the Prefect Deployments.
In the repo, as per my understanding, the agent runs as an ECS based on an ECS Task Definition which requires a Docker Image.
Does this Docker image need the different Python packages required by the flows
?
Or can it be lightweight and only include packages necessary for prefect
?prefect-3.10
base image?
I'd like to have:
⢠1 Docker Image with the bare minimum for a Prefect Agent
⢠1 Docker Image with all the dependencies and private modules (edit: for the flows)Anna Geller
10/07/2022, 12:20 PMOr can it be lightweight and only include packages necessary forThis is correct, it can be totally lightweight and you can build an ECR image that needs custom packages separately and supply that image to your?prefect
ECSTask
blockKelvin DeCosta
10/07/2022, 12:21 PMAnna Geller
10/07/2022, 12:21 PMKelvin DeCosta
10/07/2022, 12:22 PMAnna Geller
10/07/2022, 12:22 PMimage=${{ needs.ecr-repo.outputs.image }}
this was deliberate so that you can run the flows directly in the agent container if you need to do that for low latency workflowsKelvin DeCosta
10/07/2022, 12:27 PM