Has anyone got any recommendations on how best to deploy the Prefect agent in AWS? We’re leveraging the ECS Agent to execute flow runs within our ECS cluster (great, that all works fine). But, we’re contemplating whether the agent service itself is best run on EC2 vs. a long-running container in Fargate? Any help appreciated 🙂.

Hi @Joseph Ellis, I think either way will be fine. Just a thought that EC2 will require some management in terms of patching (potentially upgrading Prefect version), while Fargate might be easier to maintain.

Thanks Kevin, do you know if there are existing resources / documentation available for creating a docker-ised Prefect agent?

Unfortunately, I don’t have any detailed documentation besides this post .

@Joseph Ellis This project is still under development but here is our initial setup for running the Prefect Agent as an ECS Service with Fargate compute https://github.com/pangeo-forge/pangeo-forge-aws-bakery/blob/main/cdk/bakery_stack.py#L88-L150

Nice @Sean Harkins!

Wonderful, thanks. This community is great 🙂