Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

image.png

hi all - i am getting a pickling error on something related to SQLAlchemy when i go to register my flows to s3 (AWS prefect cloud setup). I recently tweaked some db connections (snowflake) to make them more performant; but can't find anything in SO related to this. has anyone ever seen something like this before?

Hi <@U0305VCQ8N6>, you can store your Flow as a script to avoid it. The thing is you have something like a global client used by tasks that is getting serialized along with your Flow

You can learn more abotu <https://docs.prefect.io/core/idioms/script-based.html|script> based storage. You can just say `stored_as_script=True` and give the path of the script to upload