on a task that returns a generator. Now this task is not persisted using a
Result
, there is no Result or checkpointing enabled on the task. When I run locally the flow works just fine. However when I trigger via the Prefect UI, and use S3 Storage it tries to persist all tasks I think. This is what this line in the documentation refers to I believe (see image).
How can I get this task to not be persisted by default if that is what is causing this.
n
Noah Holm
04/15/2021, 12:58 PM
I’ve also had this question, I learnt there is a task kwarg
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.