Joshua Grant01/25/2023, 4:33 PM
Our workflow is that we are using an
botocore.errorfactory.ClientException: An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Too many concurrent attempts to create a new revision of the specified family.
block with github storage.
This is mainly caused when a mother flow fires off a subflow via
, but can occur when trying to invoke a standalone flow
Ben Muller01/25/2023, 10:07 PM
Joshua Grant01/31/2023, 2:17 PM
Ben Muller01/31/2023, 6:09 PM
Joshua Grant02/01/2023, 2:18 PM
, logic used within the Dockerfile:
FROM prefecthq/prefect:2.7.10-python3.9 RUN pip install prefect-aws==0.2.4 RUN prefect block register -m prefect_aws.ecs
Ben Muller02/01/2023, 7:16 PM
Joshua Grant02/01/2023, 7:17 PM
ecs_task_fg = ECSTask( aws_credentials=aws_credentials_block, image=docker_image, cpu=4096, memory=8192, stream_output=True, configure_cloudwatch_logs=False, cluster=os.getenv('ECS_CLUSTER'), execution_role_arn=os.getenv('FLOW_EXECUTION_ROLE'), task_role_arn=os.getenv('FLOW_TASK_ROLE'), vpc_id=os.getenv('VPC_ID'), env=flow_environment, task_definition=task_def, )
is read with `pyaml-env`'s
function and is a dictionary that describes sidcars loaded with the task, it also contains logging configuration for the task container as well (we use DataDog to handle logging).
is a dict of envars.
is a string of the ECR-stored image
Ben Muller02/02/2023, 8:07 AM
Anna Geller02/02/2023, 1:54 PM
Joshua Grant02/02/2023, 2:59 PM
argument was the issue. With that completely removed (not just the sidecars), we are not seeing this issue.
Anna Geller02/03/2023, 2:48 PM
Joshua Grant02/13/2023, 6:06 PM
argument), then went on vacation. When I returned, the too-many-revisions error (which we have been calling this) resurfaced while I was gone. Would love to get some insight into why this is happening.
infrastructure block. This method also allows for the loading of sidecars.