jcozar
02/20/2022, 1:49 PM51ec0178-bd12-43c4-8b00-fa4ae61300ef
was cancelled because of that automation. But in the dashboard that flow run does not exists, and a flow run was correctly executed at expected time. Do you know what might be happening?
Thank you in advance!Anna Geller
02/20/2022, 1:54 PMjcozar
02/20/2022, 8:42 PMAnna Geller
02/20/2022, 10:02 PMjcozar
02/21/2022, 7:32 AMmain
) has been correctly executed, so it is kind of scheduled twice. I put the example with today’s flow executions. The flow run 2eacfb3e-0300-4988-89e5-7eec59fe4013
failed (scheduled for more than one hour), but flow run 312d9de6-d23f-4a30-82fb-958f4c00c66f
executed correctly (flow main sheduled at 5:00 am). Also I don’t see any cancelled flow run in the dashboard for the flow main
.
The run configuration for this flow is:
{
"cpu": "1024",
"env": null,
"type": "ECSRun",
"image": null,
"labels": [
"iebs-analytics-prefect-prod"
],
"memory": "2048",
"__version__": "0.14.20",
"task_role_arn": "arn:aws:iam::XXXX",
"run_task_kwargs": null,
"task_definition": null,
"execution_role_arn": "arn:aws:iam::XXXX",
"task_definition_arn": null,
"task_definition_path": null
}
Anna Geller
02/21/2022, 9:41 AMjcozar
02/21/2022, 9:49 AMAnna Geller
02/21/2022, 10:05 AMauto_scheduled
flag is set to False in the logs, so something looks suspicious here.jcozar
02/21/2022, 10:47 AMrun_config = ECSRun(task_role_arn=TASK_ROLE_ARN, execution_role_arn=EXECUTION_ROLE_ARN, cpu=PREFECT_AGENT_CPU, memory=PREFECT_AGENT_MEMORY)
storage = docker.Docker(registry_url=REGISTRY_BASE_URL, image_name=REGISTRY_IMAGE_NAME, image_tag=FLOW_NAME, base_image="prefecthq/prefect:0.14.20-python3.8, ...)
result=S3Result(bucket=BUCKET_PREFECT_RESULTS)
executor=LocalDaskExecutor(scheduler="processes", num_workers=8)
schedule = Schedule(clocks=[CronClock("0 5 * * *", start_date=pendulum.datetime(2021, 1, 1, tz="Europe/Madrid"))])
with Flow(FLOW_NAME, run_config=run_config, storage=storage, result=result, executor=executor, schedule=schedule) as flow:
...
Anna Geller
02/21/2022, 11:12 AMjcozar
02/21/2022, 11:18 AMAnna Geller
02/21/2022, 11:33 AMECSRun(env={"PREFECT__LOGGING__LEVEL": "DEBUG"})
jcozar
02/21/2022, 11:37 AMAnna Geller
02/24/2022, 10:46 AM