https://prefect.io logo
g

Gowtham Manne

05/03/2022, 5:22 PM
Hi All, General Question - Can we deploy prefect on open shift ? Is there a doc for this ? Appreciate your help!
discourse 1
k

Kevin Kho

05/03/2022, 5:25 PM
I am not sure. No content but you might be able to use the helm chart. Any reason why you can’t use Cloud though? It will be a lot easier and there are 20k task runs, which is more than enough to get started with
g

Gowtham Manne

05/03/2022, 5:28 PM
Thanks for reply! We have our own cloud, and cannot install docker-compose in VMs. So wanted to check if we can deploy on OpenShift
a

Anna Geller

05/03/2022, 5:29 PM
are you asking for Prefect 2.0 or 1.0? you can always use OpenShift as your execution layer and leverage Prefect Cloud as your orchestration layer
if you have privacy concerns regarding Cloud-based SaaS, check this page about Prefect's Hybrid Execution Model
g

Gowtham Manne

05/03/2022, 5:40 PM
Hi Anna, Thanks for the links above. We are just planning on migrating from dagster to prefect, I am new to prefect with basic knowledge. From Hybrid Model step 3 is what we are unable to do. we cannot install docker on the VM. So is there any otherway of deploying prefect on openshift ?
or containerize prefect for openshift ?
a

Anna Geller

05/03/2022, 5:45 PM
there is a definitely a way to use Prefect on your infrastructure, but it's hard to say immediately how this may look like Did you decide if you: 1. would like to use Prefect Cloud vs. do you want to use only OSS version? 2. want to use Prefect 2.0 vs. use only Prefect 1.0 for now? For OpenShift, you can leverage Kubernetes integration to deploy flow runs
g

Gowtham Manne

05/03/2022, 5:53 PM
k

Kevin Kho

05/03/2022, 5:55 PM
Yeah
g

Gowtham Manne

05/03/2022, 5:55 PM
This is what I tried https://docs.prefect.io/orchestration/server/deploy-local.html and failed because of "pip install docker-compose"
k

Kevin Kho

05/03/2022, 5:56 PM
prefect server start
is using docker compose, not Kubernetes. For Kubernetes, you need to use helm
g

Gowtham Manne

05/03/2022, 8:42 PM
Thanks Kevin!
d

davzucky

05/04/2022, 12:44 AM
Hi @Gowtham Manne We are running all the Prefect infrastructure including Perfect Server on OC. All the containers are rootless which is a requirement for OC. The rest is a basic Kubernetes setup. Just ensure your RBAC is right and agents have the right role attached to them.
upvote 1
a

Anna Geller

05/04/2022, 9:40 AM
for the Helm chart, this README is a great description showing how to use it
g

Gowtham Manne

05/04/2022, 2:13 PM
Appreciate your help on this @Anna Geller @davzucky, Let me try few things out !
👍 1
84 Views