Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by
Title
d
Dat Tran
09/08/2022, 3:07 PM
hey is there any “easy” tutorial on how to use Prefect 2.0 with AWS EKS, so far I haven’t found any and it’s kind of discovery mode for me.
✅ 1
a
Anna Geller
09/08/2022, 3:26 PM
yup! still WIP but it's already working - you can create EKS cluster and deploy a Prefect agent with one click from here
https://github.com/anna-geller/dataflow-ops-aws-eks/blob/main/.github/workflows/eks_prefect_agent.yml
d
Dat Tran
09/08/2022, 3:55 PM
hmm okay then the job will be picked via the agent then? Or will it scale up the pods. That was the usp in prefect 1.0 with ECS that you have an agent and then it starts the job as a task that stops after it’s done
a
Anna Geller
09/08/2022, 4:26 PM
You asked about EKS though. ECSTask is on the roadmap and recipe for using ECS is available here
https://github.com/anna-geller/dataflow-ops
d
Dat Tran
09/08/2022, 4:29 PM
yeh I saw that there was nothing that was similar to what we used before with ECSTask that’s why I’m figuring this out how we could do it on EKS now
a
Anna Geller
09/08/2022, 4:33 PM
sure, check what works best for you, both repos work already, ECSTask block will be released as experimental block most likely next week
https://github.com/PrefectHQ/prefect-aws/pull/85
d
Dat Tran
09/08/2022, 4:38 PM
thanks good to know I will try out your github action now and then see whether this is something that we can use
🙌 1
3 Views
#prefect-community
Join Slack