Hi there everyone! I am wondering what people have been using for passing data between prefect 2 tasks if the data is a tf.dataset or one of it's subtypes, does anyone have any experience with trying to pass those through tasks? Or would I be better off simply using the tensorflow provided methods for saving and loading to a file, and just use prefect results for file paths etc?

For prefect 1 or 2?

2 sorry (I will update my original question)

Ah yeah you’d need to control the writing of that because we are still checkpointing by default and it can’t be turned off easily but it is on the roadmap to make that toggle-able