Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by
Title
a
Ashton
11/03/2020, 4:57 PM
Hey all! My name is Ashton and I'm an ML Engineer at Sobeys, one of the main grocery retailers in Canada. I'm also one of the contributors that helped implement the Databricks tasks into Prefect. I wrote a blog post about how you can use these tasks in your Prefect flows to manage your Databricks jobs. Medium:
https://towardsdatascience.com/tutorial-integrating-prefect-databricks-af426d8edf5c
Personal Blog:
https://ashton-sidhu.github.io/blog/prefect/databricks/etl/tutorial/guide/spark/2020/11/02/prefect-databricks.html
If you have any questions or any feedback, feel free to shoot me a message! If you have any feedback or thoughts on the Databricks tasks (such as moving the connection string initialization inside the Databricks task 😉 ), I would love to hear them!
💯 6
🙌 1
👏 16
🚀 7
j
Jeremiah
11/03/2020, 6:06 PM
Awesome,
@Ashton
- thanks for sharing!
3 Views
#show-us-what-you-got
Join Slack