Does anyone have any advice on configuring their postgres server for high write i/o type workflows? I am beginning to really get going with some prefect deployments in my HPC telescope environment, but occasionally am seeing the database stumble every so often when there is a sudden influx on newly registered or executed tasks.
Not clear to me what the best way to go about addressing this. Likely some configuration settings, just unsure which knobs to turn
For reference my startup of postgres is below, which is where I am setting the appropriate configurables
apptainer run --cleanenv --bind "$POSTGRES_SCRATCH":/var postgres_latest.sif -c max_connections=2096 -c shared_buffers=8000MB \
-c min_wal_size=8096 -c max_wal_size=32384 -c synchronous_commit=off -c wal_buffers=16MB