Hi I have an earlier pipeline set up on prefect ui which run

Question

Hi I have an earlier pipeline set up on prefect ui which runs without a problem now i intend to register a separate pipeline to the same project but it s throwing cloudpickle error could it be due to setup or any datatype not using dask executor thanks

Kevin Kho · Answer

Hey < KhTan> this indicates that you are passing something that cannot be pickled between tasks like a Client database or boto3

Kevin Kho · Answer

If you are not using Dask you can bypass this by using <https docs prefect io orchestration flow config storage html pickle vs script based storage|script based storage>

KhTan · Answer

thanks < Kevin Kho> the last task of the pipe is write to database which worked fine in the other pipe in between tasks i m passing lists and dataframes could that cause issues

KhTan · Answer

it also works in flow run mode but not in flow register mode

Kevin Kho · Answer

Lists and DataFrames are serializeable so that it normally not the issue Yes this happens because `register ` serializes the flow by default

Kevin Kho · Answer

The traceback here says you are returning a Google Client somewhere Or maybe passing it to a Task

Kevin Kho · Answer

You can move that code inside the task instead

KhTan · Answer

indeed due to a Google Client thanks and problem fixed