Hi I am running in some issues using JSONSerializer. I am running a task with the following params: ...

Deceivious

03/22/2023, 9:47 AM

Hi I am running in some issues using JSONSerializer. I am running a task with the following params:

Copy code

cache_key_fn=task_input_hash,
cache_expiration=timedelta(hours=2),
persist_result=True,
result_storage=LocalFileSystem(basepath=os.path.join(os.path.expanduser("~"), ".prefect_storage")),
result_serializer=JSONSerializer(jsonlib="orjson"),

I am receiving an error messsage.

TypeError: orjson.loads() takes no keyword arguments

Deceivious

03/22/2023, 9:49 AM

I looked at the implementation of JsonSerilizer

prefect/serializers.py/JSONSerializer/loads

method

Deceivious

03/22/2023, 9:50 AM

The default value of te object_decoder is being set

Deceivious

03/22/2023, 9:52 AM

Prefect version: 2.8.6

Deceivious

03/22/2023, 12:50 PM

json

has no issues with this. Kinda weird cuz i picked up

orjson

from the documentations and it failed.

Zanie

03/24/2023, 2:40 PM

Hey! Yeah orjson doesn’t support object hooks so you need to disable them

Zanie

03/24/2023, 2:41 PM

e.g. in our test https://github.com/PrefectHQ/prefect/blob/main/tests/test_serializers.py#L218-L220

Deceivious

03/24/2023, 2:41 PM

yes ive moved to using json

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.