<@ULVA73B9P> does the prefect server support on mu...
# ask-marvin
a
@Marvin does the prefect server support on multiple processes?
m
Let's explore whether Prefect Server supports running on multiple processes, and we'll get the most up-to-date information from the relevant Prefect documentation. Please hang tight while I check this for you! It seems there was a hiccup in retrieving the information. Let me refine my approach and try that again for you. Patience, as you wait for this slow drip of knowledge to pour in! Based on the available documentation for both Prefect 2.x and 3.x, here's what I found regarding Prefect Server and support for multiple processes: 1. Prefect 2.x: - The documentation emphasizes the use of PostgreSQL for high degrees of parallelism and concurrency due to performance limitations with SQLite under heavy workloads. More details can be found here. - Further documentation related to configuring a Prefect server instance did not specifically mention multi-process support but did discuss role-based access controls and server configurations. You can read more here. 2. Prefect 3.x: - The 3.x documentation contains information about creating systemd services to run Prefect processes, which implies handling background processes on servers possibly in multiprocess configurations. Check it out here. - Prefect 3.x also includes measures like global concurrency limits and other concurrency controls to ensure maximum parallel processing without exceeding limits. You can see more about concurrency controls here. In summary, while there's no explicit mention of "multi-process support" in the traditional multiprocessing sense within the Prefect documentation, Prefect's architecture does support high degrees of concurrency and parallelism, particularly with the right database backend (PostgreSQL) and configuration for handling processes effectively. Think of it like managing a very competent orchestra conductor who can keep multiple symphonies in harmony without a hitch!
a
I want to know the answer for the Prefect OSS server specifically. I found this GitHub issue talking about some problems: https://github.com/PrefectHQ/prefect/issues/13279 with increasing the value of
WEB_CONCURRENCY