Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi, do you think prefect (2) server will scale up to thousand of deployment with scheduled each 30s ?

I think it can. The weakest point would be the postgres database. You need to ensure this can scale. The perfect can scale out so that easy

thanks for the reply, "The perfect can scale out so that easy" do you mean sharding / multiple instance of the server ?

I didn't looked at the src so IDK if prefect use psql row locks to ensure coherence

We run multiple instances of the server in production with a single backing database.