Marcus Hughes
08/09/2021, 11:05 PM~/.prefect/results
without me specifically telling it to. That's fine in the short term, but after letting things run I discovered I had over 800 gigabytes of results. Is there an automated way to delete these after some given time elapses built into Prefect? I could just make another flow that cleans up results that are older than a day or something to keep us from ballooning out of drive space. Just curious what the best practice is here. Also, is it safe for me to just delete entries from this directory or will it corrupt a database somewhere?Chris White
08/09/2021, 11:25 PMMarcus Hughes
08/10/2021, 3:14 PMChris White
08/10/2021, 3:35 PMfrom prefect.engine.results import LocalResult
with Flow(..., result=LocalResult(location="{task_name}.prefect")):
⢠to turn checkpointing off entirely you can set checkpoint=False
on each individual task:
@task(checkpoint=False)
def my_task(...):
Marcus Hughes
08/10/2021, 3:36 PMChris White
08/10/2021, 3:37 PM