Hey everyone, I am getting the following error:

TypeError: can't pickle generator objects

on a task that returns a generator. Now this task is not persisted using a

Result

, there is no Result or checkpointing enabled on the task. When I run locally the flow works just fine. However when I trigger via the Prefect UI, and use S3 Storage it tries to persist all tasks I think. This is what this line in the documentation refers to I believe (see image). How can I get this task to not be persisted by default if that is what is causing this.

I’ve also had this question, I learnt there is a task kwarg

checkpoint

that should disable it.

This seems to have done it. Thank you @Noah Holm.