What are currently suggested ways of how to deploy prefect server on AWS?
Ideally, someone already has a pulumi template repository for how to set up prefect server on EC2, AWS Fargate or ECS/EKS? 🙂
a
Amruth VVKP
06/07/2024, 3:57 PM
I have setup ECS Fargate containers to run my Prefect server, where is it you've been stuck with?
r
Robin
06/07/2024, 4:28 PM
Wondering whether to build sth from scratch or using a template repo or recipe. But did not yet find a template.
ECS Fargate sounds good 👍
How did you set up the database?
With postgres?
a
Amruth VVKP
06/08/2024, 8:18 AM
I've used RDS for the DB. My cluster has server running as a service with service discovery open to all other services in the same cluster. Work pools and agents run as separate services within the cluster with access to the server through the mapped dns. You can serve it out to internal or external with an application load balancer and cloud front with WAF enabled. I'd you need external access to API, consider routing API Gateway as a proxy that forwards requests to the Prefect server
r
Robin
06/08/2024, 8:49 AM
Alright, sounds great!
Do you plan to switch to prefect 3.0.0 to leverage automations and events?
a
Amruth VVKP
06/08/2024, 9:16 AM
Yes I plan to once a stable release of Prefect 3 comes out
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.