Any idea how I can progress with: ```Failed to load and execute Flow's environment: StorageError("An...

ciaran

03/25/2021, 5:38 PM

Any idea how I can progress with:

Copy code

Failed to load and execute Flow's environment: StorageError("An error occurred while unpickling the flow:\n  TypeError('code() takes at most 15 arguments (16 given)')\nThis may be due to one of the following version mismatches between the flow build and execution environments:\n  - python: (flow built with '3.8.6', currently running with '3.7.10')")

? For background I'm using an ECS Agent.

Josh Greenhalgh

03/25/2021, 5:40 PM

What agent image are you using?

ciaran

03/25/2021, 5:41 PM

prefecthq/prefect:0.14.13-python3.8

is the image we're running on ECS

Josh Greenhalgh

03/25/2021, 5:42 PM

Definitely? That seems to suggest you built and registered with 3.8 but that the agent is actually runing 3.7

Josh Greenhalgh

03/25/2021, 5:43 PM

I saw a similar error and I was defo using the wrong python version

Josh Greenhalgh

03/25/2021, 5:43 PM

So if your not then no bloody idea

ciaran

03/25/2021, 5:43 PM

Well. The agent is definitely that image, as I'm telling CDK to deploy that image

ciaran

03/25/2021, 5:43 PM

I dont know what image it then uses to spawn flows

ciaran

03/25/2021, 5:45 PM

prefecthq/prefect:0.14.13

looks like this one

ciaran

03/25/2021, 5:46 PM

Hmmm I wonder how I change that.

Josh Greenhalgh

03/25/2021, 5:48 PM

I assume you use ECSrun?

Josh Greenhalgh

03/25/2021, 5:49 PM

That has an arg image so probably there?

Josh Greenhalgh

03/25/2021, 5:49 PM

Or I imagine as part of the task_def that gets passed in?

ciaran

03/25/2021, 5:50 PM

We were just using Universal Run

ciaran

03/25/2021, 5:50 PM

But we might have to use ECSRun now...

ciaran

03/25/2021, 5:55 PM

Thanks for the call @Josh Greenhalgh - Changing to ECSRun and pinning the image to

prefecthq/prefect:0.14.13-python3.8

did the job 🦜

Jim Crist-Harif

03/25/2021, 5:55 PM

By default, the agent will use the default

prefecthq/prefect

image that corresponds with the prefect release your flow was registered with. Currently this is a python 3.7 image (though we should update that to 3.8). If you manually specify an image to use, or use script based storage (https://docs.prefect.io/orchestration/flow_config/storage.html#script-based-storage )) you won't have this issue.

ciaran

03/25/2021, 5:57 PM

Cool, thanks folks!

5 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.