Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

image.png

Hi, my question is what “pickle” and “cloudpickle” mean？I am not a Python expert

Hey Zheng, i’m gonna have to compress these images to keep the main channel is cleaner. Pickle makes a python object into binary representation. It compresses the object and it’s part of the Python installation.

Cloudpickle is a more robust version (and often used instead of the native pickle). If you use something like Dask also, cloudpickle is used to package the function/data to send it across the cluster.

Will post other messages in this, it just really helps us in responding, especially if there are more replies like 1 or 2 days later because it gets hard to scroll up to see the other parts of the message

From Zheng:
&gt; <https://orion-docs.prefect.io/concepts/tasks/>