Hi all, I know I'm in the minority using both local storage and local infra to run my flows, but it has been working well for us until I discovered that prefect was eating up my local storage. Are the files being generated in the directory .prefect/storage the log files? This is much larger than I would have expected it to be. I also noticed that the tmp files being generated for flow code don't always get deleted once the flow has completed. I can write a flow to auto-delete these tmp files for me, but is there a better way to do this?

are you returning large objects out of your flow runs/task runs? this is likely from result persistence as opposed to logs?

I am logging my results, but several tasks in several of my flows return dataframes with up to ~50,000 rows to be used in passing to other tasks. I don't have any parameters set to persist the results, but do the results persist by default?

It depends what you're doing: https://docs.prefect.io/2.11.2/concepts/results/#persisting-results most of the time

result_persistence

is off, but theres a few features would toggle it on

Good to know, thank you! I'll take a look at the docs, I wrote a script that cleans that directory for me but I wanted to make sure that was necessary.

no problem! let me know if that resolves what you're seeing

@Jake Kaplan that solved my problem! I wish I would have found that documentation sooner. Thanks again so much!