Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
b
Ben McNeill
04/23/2020, 2:32 PMHi everyone! I am new here, wandered my way over here after reading up on dask etl jobs that leverage prefect. Anyone running their ETL jobs like that?
👋 4
d
Dylan
04/23/2020, 2:34 PMHi @Ben McNeill, welcome! I’m Prefect’s internal Data Engineer and I run my ETL jobs using our
DaskKubernetesEnvironmentj
Jeremiah
04/23/2020, 2:34 PMHi @Ben McNeill, and welcome!
b
Ben McNeill
04/23/2020, 2:38 PMHi @Dylan @Jeremiah
Is there a resource you recommend for "where do I start?"
I am trying to solve an ETL process for relational database systems. 🐍
d
Dylan
04/23/2020, 2:39 PM@Ben McNeill give this tutorial a shot: https://docs.prefect.io/core/tutorial/02-etl-flow.html
updated to go to the correct step
If you start here and continue, you’ll build up to including the Dask executor for task parallelization
b
Ben McNeill
04/23/2020, 2:43 PMok thanks !
d
Dylan
04/23/2020, 2:44 PMOf course! Let us know how we can help =]