Hi all, has anyone tried using pydantic models as objects exchanged between tasks? It seems that it is not supported (exceptions are thrown). I am using the latest Prefect 2 release.

There is a discussion about this here https://github.com/PrefectHQ/prefect/issues/5883 Response from our Senior engineer: "we include pydantic validation for flows so we can JSON parameters from the API but task runs do not track their parameters this way as they are always passed inline. It seems like it'd be weird to add this to tasks as an option and have it off by default but on by default for flows?"

Hi @Anna Geller, thanks for the prompt reply; I am trying to return pydantic objects after running tasks and pass them to other tasks. Upon trying to return the pydantic object an exception is thrown. I don't need task parameter validation, I just want to be able to pass pydantic objects between tasks.

I see; thanks for that background. Does it mean you are getting cloudpickle errors? Can you share the code you were using and the error you were getting? also curious, why would you pass a pydantic model between tasks? I usually see pydantic being used to define a data structure, not as an object being passed in data pipelines - I'm definitely curious to hear about your use case and what you are trying to do

Hi, it seems relevant to issue #5891, the model is generated in internal code elsewhere and just has to be passed between tasks. I will try the suggestion provided on github and let you know.

makes sense, great to see you found the relevant issue

It seems I still get an exception but I will try to investigate it further

awesome, thanks a lot for that!