Hello, I am using prefect 2.8.4 and facing issues since yesterday where CPU utilisation of postgres ...

Ankit

10/10/2023, 1:27 PM

Hello, I am using prefect 2.8.4 and facing issues since yesterday where CPU utilisation of postgres db suddenly spikes up. It was happening with task concurrency which I then disabled and increase the size of database as well. But the problem still exists. Any solve?

Nate

10/10/2023, 3:46 PM

hi @Ankit - given your version, this may be related? do you have a lot of anonymous block documents in your db?

Ankit

10/10/2023, 3:47 PM

yes, I have a lot of anonymous block not visible in UI but database

Nate

10/10/2023, 3:49 PM

understood, as mentioned in the linked message, we've fixed this in 2.13.1. If possible, you may be interested in updating your version to make use of this fix

Ankit

10/10/2023, 3:51 PM

I was trying but it was quite a task figuring out how to setup everything when I moved from v1 to v2, now with 2.13.1, lots of things have changed and same deployment methods etc are not working. I do have another prefect version installed separately (2.12.1) which I can upgrade but can't find any detailed documentation on how to start creating deployments etc 😞

Ankit

10/10/2023, 3:53 PM

also, I have started facing this issue for last 2 days where table locks and everything stops working. I then end up killing all running queries and restarting agent

Ankit

10/10/2023, 3:54 PM

we only introduced one additional flow which triggers deployments using API from outside, size of db isn't really a concern rn

Ankit

10/10/2023, 3:56 PM

increased the size of rds postgres db from xlarge to 4xlarge thinking that would solve

2 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.