Ray Shi
01/13/2022, 4:33 AMKevin Kho
01/13/2022, 4:49 AMRay Shi
01/13/2022, 5:29 AMKevin Kho
01/13/2022, 5:40 AMRay Shi
01/13/2022, 5:45 AMKevin Kho
01/13/2022, 5:48 AMRay Shi
01/13/2022, 5:59 AMKevin Kho
01/13/2022, 6:02 AMDockerRun
and docker agent
with Prefect? Or do you just run local agent
inside a Docker container?Anna Geller
01/13/2022, 10:00 AMRay Shi
01/13/2022, 4:58 PMSTORAGE = S3(bucket="aven-etl-workflows")
RUN_CONFIG = ECSRun(
task_definition_arn="prefect-ecs-ml-tasks:2",
labels=["prod", "ecs"],
run_task_kwargs=dict(
cluster="prefect-ecs-tasks",
launchType="FARGATE",
networkConfiguration={
'awsvpcConfiguration': {
'subnets': [
'subnet-0a989b19518b3206e', 'subnet-0f893d51e54868283', 'subnet-0859b2ff39561515b',
],
'securityGroups': [
'sg-0090032547625a7c2',
],
'assignPublicIp': 'DISABLED'
}
},
),
)
Kevin Kho
01/13/2022, 5:03 PMAnna Geller
01/13/2022, 5:07 PM