Hi, is there a possibility to scale prefect ECS-agents (auto scaling) and if so can someone point me in the right direction, Im struggling to understand how a new agent would register with prefect (and with existing flows)

Do you use Fargate or EC2 launch type? In general, one ECS agent is enough because the agent is a lightweight process and the actual execution takes place on the ECS cluster. When you use EC2 launch type, you may need autoscaling of worker nodes (EC2 instances). When you use Fargate, you don’t need to do anything, it scales automatically serverless.

planing to use fargate. i found your article https://annageller.com/blog/serverless-data-pipelines-made-easy-with-prefect-and-aws-ecs-fargate#10d9e5c6d4444350961d2deca9d30b06 going to go through this first and give it a try. Thank you for the feedback

btw there is an updated version here https://towardsdatascience.com/how-to-cut-your-aws-ecs-costs-with-fargate-spot-and-prefect-1a1ba5d2e2df - it’s a better walkthrough because it sets up the agent as ECS service