Hi there having a slight issue with the ECS agent,...
# prefect-server
r
Hi there having a slight issue with the ECS agent, StartFlowRun, and running in parallel. As the ECS agent registers and deregisters a task definition every time it starts a flow, when starting multiple flows in parallel I get the following AWS error:
Copy code
An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Too many concurrent attempts to create a new revision of the specified family."
k
Hey @Robert Hales, Prefect needs to register/deregister when it starts a Flow to be able to support changes in RunConfig. I am not sure it’s feasible to not register/deregister when the RunConfig is the same. I suggest you open a ticket for this.
r
Thanks for the reply @Kevin Kho, I will do đŸ™‚
Ah I seem to have found an already open ticket https://github.com/PrefectHQ/prefect/issues/4402
k
Oh yeah that’s true. Feel free to chime in there