I'm having some issues with the orion.db growing too large.
I'm using Prefect Orion 2.06b with a persistent local sqlite database with the environment variable:
The culprit for the growing size seems to be that I use large Pandas DataFrames and pass them through several flows.
Is there any way to reduce the size of the orion.db? Can the output of a nested flow be deleted upon completion of the parent flow?
Thanks for your help!
07/02/2022, 4:58 PM
We are aware of the problem and we have an issue open internally to allow disabling task run results persistence. Until then you may use Postgres DB instead