Hi all I m running into a issue with RunGreatExpectationsVal Prefect Community #prefect-community

Hi all, I'm running into a issue with RunGreatExp...

Niels Prins

02/09/2022, 4:25 PM

Hi all, I'm running into a issue with RunGreatExpectationsValidation, hope you can help. When I run it directly

flow.run()

it works fine. When I register the same flow to a local server and run it with a local prefect agent I get the following error.

Copy code

File "/home/prinsn/Code/prefect/repo/gima-prefect-cicd/.env/lib/python3.8/site-packages/cloudpickle/cloudpickle_fast.py", line 602, in dump
    return Pickler.dump(self, obj)
TypeError: 'NoneType' object is not callable

I' m using: ge api V3 prefect==0.15.13 great_expectations==0.14.5 Any pointers? =D

alex

02/09/2022, 4:39 PM

Hi @Niels Prins! Where are you storing your Great Expectations project? Is it on your local machine?

Niels Prins

02/09/2022, 4:41 PM

Yes, in my demo setup it is stored on my local machine. Tried it with the flow in the great_expections folder and with the flow on the same level

alex

02/09/2022, 5:36 PM

What type of storage are you using for your flow?

Niels Prins

02/09/2022, 5:50 PM

Currently running with the default, also tried Docker storage. Both times with the pickled option

Niels Prins

02/09/2022, 5:53 PM

Found this one in the community

<https://gitlab.com/hashmapinc/oss/great-expectations-poc>

Will check if this runs in my local server and than slowly upgrade it to the latest versions. For now I will call it a night =D

Niels Prins

02/10/2022, 8:00 AM

@alex woke up fresh this morning, switched the flow to a 'stored_as_script' flow and it worked straight out of the box =P Seems that the GreatExpectationObject can not be de-serialized or something?

Niels Prins

02/10/2022, 8:01 AM

thnxs for your help =D

alex

02/10/2022, 12:26 PM

I’m glad that you were able to get it working!

Open in Slack

Previous Next