https://prefect.io logo
Title
m

Matt Allen

08/31/2020, 8:32 PM
Are logs from flow runs stored in the postgres instance for the prefect server? If so, is there any kind of retention policy or cleanup process in place to delete them if they pass a certain age? I'm wondering about running out of space as runs accumulate in the history
k

Kyle Moon-Wright

08/31/2020, 8:49 PM
Hey @Matt Allen, To answer your questions directly: yes and not per se. If you are using the
--use-volume
flag with your instance of Prefect Server, then everything should be stored in your
~/.prefect/pg_data
directory. From here, all of the configurations for your database should be stored in the
postgresql.conf
file, which you should be able to adjust for the logging configurations you need. So no policy in place per se, but you should be able to adjust your db configurations there. Otherwise, deleting a flow should also delete its logs.
m

Matt Allen

08/31/2020, 8:50 PM
Awesome, thanks
I'm running with an RDS postgres, so I imagine I'll have to set something up to delete old flows if this becomes a problem
m

Mikael

09/04/2020, 4:37 AM
@Matt Allen how do you use RDS with prefect? 🤔
m

Matt Allen

09/04/2020, 3:30 PM
I'm using a custom helm chart based on this https://github.com/szelenka/prefect-server-k8 to deploy the different parts of the server to kubernetes
👍 1