Hi all. Some of my flows started failing overnight and after investigation I have found that the EC2 instance that the flows run on has run out of disk space. After a bit of digging I realised that the prefect flow results are filling up the C: drive. What is the best practice for persisting these results? I don't think we really even need them, except maybe in the event of a failure where we might rerun failed jobs.
a
Anna Geller
04/13/2022, 12:18 AM
you can disable checkpointing to prevent storing results:
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.