Hi everyone . Data are being collected using prefect 2.0. However, when a flow-run is executed with ...

jaehoon

02/02/2023, 5:39 AM

Hi everyone . Data are being collected using prefect 2.0. However, when a flow-run is executed with a specific parameter, there is often a problem that it fails without recording any log. Since none of the internal logic is executed and logs are not accumulated, it is difficult to identify the problem. If anyone has any ideas why this is happening, please help.

Timo Vink

02/02/2023, 5:42 AM

Looks like there's half an error message on the far right under

State Message

which looks relevant

👍 1

jaehoon

02/02/2023, 5:46 AM

oh i missed that one thank you! Then why does this submission error occur? Do any of you know...

jaehoon

02/02/2023, 5:47 AM

Submission failed. Traceback (most recent call last): File "/home/ubuntu/prefect/venv/lib/python3.10/site-packages/prefect/infrastructure/docker.py", line 89, in _get_docker_client docker_client = docker.from_env() AttributeError: module 'docker' has no attribute 'from_env' During handling of the above exception, another exception occurred: AttributeError: module 'docker' has no attribute 'errors'

Timo Vink

02/02/2023, 6:01 AM

Looks like some sort of confusion with the import of

docker

. Do you have an incompatible version installed (looks like prefect needs >=4.0), a custom library called

docker

, or a file like

docker.py

docker/__init__.py

❤️ 1

Christopher Boyd

02/02/2023, 2:38 PM

Agree with Timo (thank you for chiming in !)

AttributeError: module 'docker' has no attribute 'errors

indicates a likely versioning mismatch on docker between where you built the flow, and where it is executing. You aren’t seeing other logs in the UI, because the flow hasn’t started due to infrastructure not being started

❤️ 1

jaehoon

02/03/2023, 1:56 AM

Thank you all for your replies. Did you mean the docker version you mentioned, the docker engine version or the docker package version in python?

Christopher Boyd

02/03/2023, 1:58 PM

The docker page version for starters that is being referenced. This behavior and error message in particular is not Docker or Prefect, but a very common error in ANY package with version mismatches. I would pin your versions ideally

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.