Hi, I have a job configured with ECS agent and flow runs in Fargate. It works fine, but when 10 jobs got triggered simultaneously (externally with lambda), couple of the jobs failed with

State message: An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Too many concurrent attempts to create a new revision of the specified family.

Any advices?

Hey @Maria, yep this is because of the low limits for that endpoint with ECS. See this and there is also an issue at the end there where the discussion continued that ends with something you might be able to try

thanks!

Hi @Kevin Kho, we're also hitting this limit. Especially when trying to programmatically trigger a bunch of backfill flows. Looks like the github issue has gone stale? I tried setting the ENV vars suggestion on the ECS Agent's container definition, but still seeing this error occasionally. ECS Agent is the correct place to put those env vars correct? Any news on what sounds like the more thorough fix of appending a unique UUID? I could take a look / consider a PR if you point me in the right direction.

Thanks for the interest in contributing Ryan! the issue linked is stale but at the end of it, there was a new issue opened here (I think you saw it). Feel free to chime in there with your thoughts. I would not know about the fix immediately. I think commenting there would be the place to start, or you can link that and post in the #C0106HZ1CMS channel also