https://prefect.io logo
Title
o

Oliver Mannion

07/12/2022, 10:27 AM
Some Prefect Orion examples running self-contained in a local kubernetes cluster. Flows • Dask flow using a dask local cluster • Dask kubes flow using an ephemeral dask cluster on Kubernetes • Parameterized flow using a custom Docker image containing additional modules • Ray flow that runs on an existing ray cluster • Sub flow that is trigger by a parent flow Deployments to Kubernetes using • the default OrionPackager to store the flow source in Orion • the default OrionPackager to store the flow import path in Orion • the FilePackager to store the flow source in S3 (minio) Batteries (mostly) included. 🔋
❤️ 10
:thank-you: 7
🙌🏼 1
:oh-yeah: 3
🎉 3
🙌 12
:upvote: 7
a

Anna Geller

07/12/2022, 11:36 AM
I love those examples, thank you for sharing @Oliver Mannion - I'll cross-post on Discourse
:upvote: 1
Discourse
:thank-you: 1
m

Matthias

07/12/2022, 7:23 PM
Omg this is amazing! Thanks for sharing @Oliver Mannion. I did not realize
OrionPackager(serializer=ImportSerializer())
allows to have flow code, task modules etc all in one container image!
:thank-you: 1