Hello guys!! Anyone has Prefect Server in AWS running in EC2 but with a HA setup? main and backup? I´m wondering which would be the best setup using an ALB in front and a RDS ddbb…Thanks!
12/14/2021, 10:30 PM
I will ping a community member who may provide insight. I think they run Server on HA
12/14/2021, 10:32 PM
@Raúl Mansilla the first issue would be to ensure that your database is deployed using Multi-AZ Deployment
making it truly HA would be more challenging, but if all you ask for is more resilience, you could schedule taking automated snapshot of your instance and you can provide everything you need to start and configure your Server using user data
12/14/2021, 11:04 PM
Thanks @Kevin Kho, about RDS, @Anna Geller, I have setup multiAZ in the ones we´re using for our “old” prefect servers. And about snapshots, that´s what I thought, like a cold backup to spin up a new ec2 if there are problems with main one, but guessing if there is anything else more “hot”, for more resilency you can have the server in an ASG with 1 targeted and 1 desire host so it will be maintained running…but may be anyone else did the trick before! 🙂
12/15/2021, 12:12 AM
interesting idea! but I think ASG would be more appropriate to scale compute e.g. for your Kubernetes agent.
In general, if you would go for the Kubernetes deployment option with Helm chart and you would deploy it on AWS EKS with managed node groups - this would allow that EKS can ensure HA on the instance-level (e.g. restarting broken EC2 nodes) and Kubernetes would ensure HA on the deployment level (e.g. restarting broken pods). Then, when you use a multi-AZ RDS on top with automatic backup configured, this sounds already quite “robust” and automated.
12/15/2021, 10:49 AM
@Kevin Kho if you gather some info from your contact, pls let me know 🙂