https://prefect.io logo
Title
d

Dat Tran

09/08/2022, 3:07 PM
hey is there any “easy” tutorial on how to use Prefect 2.0 with AWS EKS, so far I haven’t found any and it’s kind of discovery mode for me.
1
a

Anna Geller

09/08/2022, 3:26 PM
yup! still WIP but it's already working - you can create EKS cluster and deploy a Prefect agent with one click from here https://github.com/anna-geller/dataflow-ops-aws-eks/blob/main/.github/workflows/eks_prefect_agent.yml
d

Dat Tran

09/08/2022, 3:55 PM
hmm okay then the job will be picked via the agent then? Or will it scale up the pods. That was the usp in prefect 1.0 with ECS that you have an agent and then it starts the job as a task that stops after it’s done
a

Anna Geller

09/08/2022, 4:26 PM
You asked about EKS though. ECSTask is on the roadmap and recipe for using ECS is available here https://github.com/anna-geller/dataflow-ops
d

Dat Tran

09/08/2022, 4:29 PM
yeh I saw that there was nothing that was similar to what we used before with ECSTask that’s why I’m figuring this out how we could do it on EKS now
a

Anna Geller

09/08/2022, 4:33 PM
sure, check what works best for you, both repos work already, ECSTask block will be released as experimental block most likely next week https://github.com/PrefectHQ/prefect-aws/pull/85
d

Dat Tran

09/08/2022, 4:38 PM
thanks good to know I will try out your github action now and then see whether this is something that we can use
🙌 1