Mike Vanbuskirk
05/17/2022, 8:32 PMSubmitted for execution: Task arn:<task-arn>
with no further logs generated. In cloudwatch, it only shows:
2022-05-17T16:18:52.575-04:00 [2022-05-17 20:18:52,575] INFO - agent | Deploying flow run f2f45aac-ccfb-4bb9-88db-fb1d00426989 to execution environment...
2022-05-17T16:18:53.805-04:00 [2022-05-17 20:18:53,805] INFO - agent | Completed deployment of flow run f2f45aac-ccfb-4bb9-88db-fb1d00426989
Kevin Kho
05/17/2022, 8:38 PMMike Vanbuskirk
05/17/2022, 8:39 PM2022-05-17T16:18:52.575-04:00 [2022-05-17 20:18:52,575] INFO - agent | Deploying flow run f2f45aac-ccfb-4bb9-88db-fb1d00426989 to execution environment...
2022-05-17T16:18:53.805-04:00 [2022-05-17 20:18:53,805] INFO - agent | Completed deployment of flow run f2f45aac-ccfb-4bb9-88db-fb1d00426989
2022-05-17T16:38:47.650-04:00 [2022-05-17 20:38:47,650] INFO - agent | Deploying flow run f2f45aac-ccfb-4bb9-88db-fb1d00426989 to execution environment...
2022-05-17T16:38:48.748-04:00 [2022-05-17 20:38:48,748] INFO - agent | Completed deployment of flow run f2f45aac-ccfb-4bb9-88db-fb1d00426989
Kevin Kho
05/17/2022, 8:41 PMMike Vanbuskirk
05/17/2022, 8:42 PMKevin Kho
05/17/2022, 8:43 PMMike Vanbuskirk
05/17/2022, 8:43 PMKevin Kho
05/17/2022, 8:55 PMLocalExecutor
. I was asking because the LocalDaskExecutor
with processes was not sending logs recently. If the Flow is still stuck in Submitted on the Prefect UI, I think we have a different issue though.
Looking at this again, it feels like the container may not have started right. This is the log associated with the agent. Do you have logs associated with the Flow?Mike Vanbuskirk
05/17/2022, 8:57 PMKevin Kho
05/17/2022, 8:58 PMMike Vanbuskirk
05/17/2022, 8:59 PMKevin Kho
05/17/2022, 9:02 PMMike Vanbuskirk
05/17/2022, 9:05 PMKevin Kho
05/17/2022, 9:09 PMMike Vanbuskirk
05/17/2022, 9:15 PMKevin Kho
05/17/2022, 9:23 PMMike Vanbuskirk
05/17/2022, 9:54 PMKevin Kho
05/17/2022, 9:56 PMMike Vanbuskirk
05/17/2022, 9:57 PM@task
def hello_task():
logger = prefect.context.get("logger")
<http://logger.info|logger.info>("Hi from Prefect %s from flow %s", prefect.__version__, FLOW_NAME)
return
with Flow(FLOW_NAME, run_config=RUN_CONFIG) as flow:
hello_task()
flow.register(project_name="mike-test")
Kevin Kho
05/17/2022, 9:58 PMMike Vanbuskirk
05/17/2022, 10:00 PMKevin Kho
05/17/2022, 10:01 PMMike Vanbuskirk
05/17/2022, 10:01 PMKevin Kho
05/17/2022, 10:04 PMMike Vanbuskirk
05/17/2022, 10:04 PMAn error occurred (ServerException) when calling the RunTask operation (reached max retries: 2): Service Unavailable. Please try again later.
Kevin Kho
05/17/2022, 10:07 PMMike Vanbuskirk
05/17/2022, 10:08 PMTo provide your own task definition template, you can use theflag. This takes a path to a job template YAML file. The path can be local to the agent, or stored in cloud storage on S3.--task-definition
Kevin Kho
05/17/2022, 10:11 PMMike Vanbuskirk
05/17/2022, 10:12 PMKevin Kho
05/17/2022, 10:13 PMwith Flow(...) as flow:
...
flow.storage.add_default_labels = False
Mike Vanbuskirk
05/17/2022, 10:16 PMKevin Kho
05/17/2022, 10:18 PMMike Vanbuskirk
05/17/2022, 10:22 PMKevin Kho
05/17/2022, 10:23 PMMike Vanbuskirk
05/17/2022, 10:32 PMKevin Kho
05/17/2022, 10:36 PMMike Vanbuskirk
05/17/2022, 10:37 PMKevin Kho
05/17/2022, 10:40 PMMike Vanbuskirk
05/17/2022, 10:48 PMKevin Kho
05/17/2022, 10:49 PMMike Vanbuskirk
05/17/2022, 11:00 PMKevin Kho
05/17/2022, 11:05 PMMike Vanbuskirk
05/17/2022, 11:08 PMKevin Kho
05/17/2022, 11:10 PMMike Vanbuskirk
05/17/2022, 11:21 PMKevin Kho
05/17/2022, 11:22 PMMike Vanbuskirk
05/18/2022, 12:29 AM