https://prefect.io logo
s

Stephen Herron

01/21/2022, 3:13 PM
quick question - i set-up my ecs agent with what I think is a custom image - say prefect with pandas. I then try to run a flow from cloud, simple hello-world with
import pandas
This doesn’t seem to work unless I specifically supply the custom image (and the task execution arn). I would have expected if run_config:image is null it would use the one from the task_definition? Does it default to something other than the container def?
k

Kevin Kho

01/21/2022, 4:02 PM
Hey @Stephen Herron, I think it shouldn’t. I’ll take a good. What version are you on?
s

Stephen Herron

01/21/2022, 4:07 PM
Copy code
{
  "cpu": null,
  "env": null,
  "type": "ECSRun",
  "image": null,
  "labels": [
    "test"
  ],
  "memory": null,
  "__version__": "0.15.9",
  "task_role_arn": "arn:aws:iam::XXXXX:role/prefect-task-role",
  "run_task_kwargs": {
    "cluster": "prefect-ecs-cluster",
    "launchType": "FARGATE"
  },
  "task_definition": null,
  "execution_role_arn": null,
  "task_definition_arn": null,
  "task_definition_path": null
}
^^ failed run_config
k

Kevin Kho

01/21/2022, 4:07 PM
Ok thanks, will go through and see.
What is your storage?
So the agent sets the image here . In priority order, it will use • Image of Docker Storage • Image on RunConfig if exists • containerDefinition • prefecthq/prefect So I am suspecting the RunConfig is right but the task_definition is not setting it right. Could you share the task definition with me?
Resolved via DM. There was confusion between the agent image and the flow image
7 Views