Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
v
Vitaliy Kotik
01/20/2023, 5:14 PMWondering if I can run multiple instances of Orion server behind a load balancer for high availability?
c
Christopher Boyd
01/20/2023, 5:15 PMYou can run Orion as a replicaset in kubernetes
The main consideration for scaling is your database
v
Vitaliy Kotik
01/20/2023, 5:16 PMI don’t use k8s, but since it’s possible in k8s, then I assume I can do it with other technologies, right?
c
Christopher Boyd
01/20/2023, 5:17 PMOf course , although I expect that particular scenario might have a little less engagement from the community as most who need HA and scaling like this do use k8s
v
Vitaliy Kotik
01/20/2023, 5:18 PMthanks!
c
Christopher Boyd
01/20/2023, 5:18 PMWe don’t have tutorials or docs to set up this specific deployment approach, so it might be a good opportunity for a discourse !
v
Vitaliy Kotik
01/20/2023, 5:20 PMI guess my question was if Prefect Orion is stateless. If it’s stateless then I can run multiple intances behind a balancer, if not — then not 🙂
z
Zanie
01/20/2023, 5:23 PMYou’ll probably want to run services separately
The API itself is stateless, but you’ll also need to manage the number of database connections as you scale up.
Here are all the services we run normally: https://github.com/PrefectHQ/prefect/blob/main/src/prefect/orion/api/server.py#L375
You can disable them in the API pod then run them directly to scale them.
I believe most of them can run duplicates but we replace many of them wholesale in Cloud for performance.
v
Vitaliy Kotik
01/20/2023, 5:30 PMthan’s very helpful, thanks!
do you know if prefect supports pgbouncer in transaction mode?
Here is the list of postgres features that are supported and not depending on the mode https://www.pgbouncer.org/features.html
z
Zanie
01/20/2023, 5:31 PMHm I know we explored pgbouncer during development, but I think we moved away from it.
You can run the test suite against an arbitrary database though, so it should be feasible to find out.
v
Vitaliy Kotik
01/20/2023, 5:32 PMreally good point!!
z
Zanie
01/20/2023, 5:33 PMWe can’t prioritize support for this kind of setup right now, but we’re happy to help out if you run into issues! Curious to see how it goes 🙂
v
Vitaliy Kotik
01/20/2023, 5:41 PMI looked through the https://github.com/PrefectHQ/prefect-helm and I didn’t find code that disables any of these services https://github.com/PrefectHQ/prefect/blob/main/src/prefect/orion/api/server.py#L375
z
Zanie
01/20/2023, 5:43 PMYeah running those separately is definitely the a more advanced performance optimization
✅ 1