Piotr
07/03/2025, 7:26 AMMarvin
07/03/2025, 7:27 AMMarvin
07/03/2025, 7:28 AMpg_cron
3. Best Practices for Self-Hosted Setups:
- Implement your own retention policy using database maintenance scripts
- Be careful when deleting data due to foreign key relationships
- Focus on cleaning up:
- Old flow run logs
- Completed flow runs beyond your needed retention period
- Task run data that's no longer relevant
4. Configuration Options:
- The server's event retention period can be configured via server.events.retention_period (defaults to "P7D" - 7 days)
- This primarily affects real-time events, not historical logs
If you need to implement a cleanup strategy, you'll need to create database maintenance scripts that carefully handle the relationships between tables. When deleting data, it's recommended to:
1. Start with logs (safest to delete)
2. Then handle flow runs and related data
3. Ensure your cleanup respects foreign key constraints
For a robust solution, consider implementing a rolling retention policy based on your specific needs (e.g., keeping the last 30 days of logs, or the last 90 days of flow runs).Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by