Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

image.png

What if I don't want to store a result? Is it possible to store in memory just in that one run? My concern is that running this data loader every day, I was seeing 1GB result files each day

You can turn off checkpointing for that particular result. See the task decorator:
<https://docs.prefect.io/core/concepts/persistence.html#persisting-output>