Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

hello! is there a way to deploy flows with non-JSON serializable arguments?

technically no
practically (in terms of solving a problem) yes - you can e.g. point to a file in S3 when you need to point to a large object

thanks Anna, I came up with an S3-based solution as you described it but it felt quite hacky, so I wanted to double check

is there a plan to support it in the future, assuming an argument is pickleable, let’s say?

not hacky at all, it's actually way more scalable, parameters are not meant to pass large objects

you can however pass data between subflows, so you could have one parent flow retrieving some data and then passing it as data dependency to child flows