re the new orion FlowRunner class, is a KubernetesFlowRunner coming soon or could that still be a ways off?
k
Kevin Kho
01/13/2022, 6:18 PM
It’s the next FlowRunner priority, but has prerequisites that may take a bit longer
z
Zanie
01/13/2022, 11:19 PM
Any essential features of the existing one or new improvements you’re hoping to see?
b
Brett Naul
01/14/2022, 1:33 AM
just wanna launch stuff in k8s... we already had our own dask cluster setup and teardown logic but the existing k8s job pattern works great (agent is optional for us I guess, for now everyone has the k8s permission to create a job). only thing I can think of is that sometimes the job pod would get evicted and that would not be captured anywhere, raising some kind of exception in that case would be nice if possible
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.