Hi, I am new to Prefect for task orchestration. And have couple questions here:
1. Understand that we have Prefect Cloud which is a managed service. But could we deploy prefect server as cluster?
2. Is it possible to setup a dependency between "flows" instead of "tasks"?
05/12/2021, 9:53 AM
For your first question, check this out: https://github.com/PrefectHQ/server. We currently have Prefect deployed on our Kubernetes cluster, so that is a yes 🙂.
For your second question, I am not sure about this, maybe @Kevin Kho can help you.
05/12/2021, 10:52 AM
@Fabrice Toussaint thanks. Will try it out following the instructions.
05/12/2021, 1:35 PM
@Martin If you find an answer to the second question I would be interested in that also!
05/12/2021, 2:33 PM
Hi Martin! You can deploy prefect server to a Kubernetes cluster, but it's not really "clusterable" from an HA perspective out of the box. There are currently no "flow dependencies" but there is some task functionality that can do some of this.. that can be found here https://docs.prefect.io/core/idioms/flow-to-flow.html
05/13/2021, 4:09 PM
2. flow dependency
I'm very new to prefect, but I think a "flow of flows" construct is how its done.
There was an earlier discussion that touched this
I looked but didn't find an example in the docs.