Joe McDonald

04/09/2021, 5:52 AM
Anyone had this show up when using the ECS agent? We are running an ECS cluster with three agents and prefect server in a separate ecs cluster all running 3 instances of all services. It seems in the deprecated fargate agent you could have it create new family for each run, but looks like ECS agent doesn’t do that, it reuses the same family for task definition and increments version so when running a lot of flows at the same time we run into this.
Copy code
An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Too many concurrent attempts to create a new revision of the specified family.

Kevin Kho

04/09/2021, 2:05 PM
Hey @Joe McDonald! Thanks for the Pull Request! I invite you to join the #prefect-contributors channel, and someone from our core team will review this.