Hi, we have suddenly getting these errors in our cluster `ImportError: cannot import name 'SecretFie...

Ankit

07/05/2023, 3:56 PM

Hi, we have suddenly getting these errors in our cluster

ImportError: cannot import name 'SecretField' from 'pydantic' (/usr/local/lib/python3.8/dist-packages/pydantic/__init__.py)

✅ 1

Christopher Boyd

07/05/2023, 4:57 PM

that looks like an import error with Pydantic

Christopher Boyd

07/05/2023, 4:57 PM

Did your package installs change recently?

Nikhil Jain

07/05/2023, 8:39 PM

We started getting this too. No dependencies changed on our end.

👀 1

Christopher Boyd

07/05/2023, 8:41 PM

are you using a default prefect image? are you using a pinned version, or latest?

Nikhil Jain

07/05/2023, 8:42 PM

For our flows, we are using a pinned version.

prefect==2.8.0

For the prefect-agent (running in AWS) we are using the latest image.

Christopher Boyd

07/05/2023, 8:46 PM

are you installing pydantic?

Christopher Boyd

07/05/2023, 8:48 PM

I’m not sure if it’s something that changed in container, or in the build or elsewhere - checking Pydantic, https://docs.pydantic.dev/dev-v2/changelog/#v1100-2022-08-30

Copy code

v1.10.0 - 2022-08-30 - Adds the SecretField abstract class so that all the current and future secret fields like SecretStr and SecretBytes will derive from it, #3409 by @expobrain

Nate

07/06/2023, 8:22 PM

did we figure this out? those docs linked are for pydantic v2 which is very different (written in rust etc) perhaps an upper bound

pydantic<2.0

would be a temporary fix - i would anticipate prefect breaking if it tried to use v2, but we have an upper bound

Nate

07/06/2023, 8:23 PM

perhaps the agent is spawning jobs that don't pin and are pulling pydantic v2

Ankit

07/07/2023, 11:44 AM

I explicitly added pydantic==1.10.6 to fix this

Ankit

07/07/2023, 11:45 AM

We use prefect 2.8.4 pinned tag, just started breaking but fixed with ^

🙌 1

Tom Klein

07/10/2023, 7:18 AM

it’s breaking since the release of Pydantic 2. this issue has been fixed (with a pin to Pydantic<2) in the latest releases of Prefect or you can add the constraint yourself as Ankit has

👍 2

🙌 1

580 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.