Hey, prefect 1 here. I'm close to put etl flows in...
# best-practicesf
Florian Guily
07/11/2022, 12:56 PMHey, prefect 1 here. I'm close to put etl flows in production. I'm currently using eks with a k8's agent on a fargate node to deploy flows. This agents is only used for dev but i'm creating a staging and prod env. Should i deploy a new agent for each env in this cluster or can i stick with one agent that will handle deployed flows with label
"dev", "staging", "prod"✅ 1
a
Anna Geller
07/11/2022, 12:58 PM
it depends on your preference - check this for some guidance https://discourse.prefect.io/tag/environments
in 2.0 this is much easier thanks to profiles and workspaces
Anna Geller
07/11/2022, 12:59 PM
specifically for AWS, the AWS best practice is to separate environments through different accounts https://docs.aws.amazon.com/whitepapers/latest/organizing-your-aws-environment/organizing-your-aws-environment.pdf
Anna Geller
07/11/2022, 1:00 PM
this way, there's no need to hardcode environment names anywhere in your code or infrastructure configuration - it's all handled on an account level this way
f
Florian Guily
07/11/2022, 1:01 PMseems like i'll have to get aws certified 😅
Florian Guily
07/11/2022, 1:01 PMthanks i'll have a look at this !
a
Anna Geller
07/11/2022, 1:01 PM
haha my cert actually expires soon, I should probably remove my AWS cert title soon unless I recertify 😂
😂 1
b
Benjamin.bgx
07/11/2022, 1:20 PMI used Terraform on AWS in order to sync my different AWS Env for Prefect and a Data Lake. It should help you to re build env faster (like a minute or two 😛 ) !
👍 1
🙏 1
7 Views