cloudpickle

v2.1.0 was just released an hour ago and it has broken the healthcheck when we try to register a flow. We're using the

prefecthq/prefect:0.15.6-python3.7

as a base image. We now get this error when building the docker image.

Step 21/21 : RUN python /opt/prefect/healthcheck.py '["/opt/prefect/flows/prefect-dbt-run-modelling.prefect"]' '(3, 7)'
 ---> Running in 1d14c333ced9
Beginning health checks...
System Version check: OK
Traceback (most recent call last):
  File "/opt/prefect/healthcheck.py", line 152, in <module>
    flows = cloudpickle_deserialization_check(flow_file_paths)
  File "/opt/prefect/healthcheck.py", line 44, in cloudpickle_deserialization_check
    flows.append(cloudpickle.loads(flow_bytes))
AttributeError: Can't get attribute '_make_function' on <module 'cloudpickle.cloudpickle' from '/usr/local/lib/python3.7/site-packages/cloudpickle/cloudpickle.py'>

Will try to replicate and will create a ticket for it

This sounds like mismatched cloudpickle versions

Interesting - so update the version of cloudpickle in the pipeline env to also be 2.1.0?

I think more like make your registration

cloudpickle

version the same as the one in the

prefecthq/prefect:0.15.6-python3.7

container

Thanks for the advice all - downgrading didn't work, but updating the version to 2.1.0 in the Dockerfile (in an

extra_dockerfile_command

) did! Yeah must have been a version mismatch as stated

Thank you everyone in this thread, helped us out 🙂 Specifically adding the following command to our docker storage extra_dockerfile_command per James’ suggestion:

RUN pip install cloudpickle==2.1.0

Same issue. Just to confirm, is it the cloud pickle version in server or agent that needs to be the same

@Kevin Kho let’s open an issue / discourse topic for this so it’s discoverable, I ran into a cloudpickle compat issue today too.

Base image for Docker storage and flow registration (and probably agent). I will turn this into Discourse