Hello 🙂 I recently deployed Prefect Server 0.14.15 on a test k8s cluster. After playing around with it I noticed that k8s agent only runs the flows for the first tenant I created. For the projects I created from other tenants, all their flows are just stuck in
scheduled
state (becoming late runs). Is this a bug, or there’s a way of configuring k8s agent to work with more than one tenant? If so, how? Thanks 🙂 (I deployed the services using the prefecthq helm chart)
k
Kevin Kho
04/09/2021, 1:29 PM
Hi @Marko Jamedzija! Unfortunately, you need one agent per tenant. We don’t issue multi-tenant tokens at the moment so the Runner token you generated is only scoped to the first tenant.
m
Marko Jamedzija
04/09/2021, 2:01 PM
Thanks 🙂 So I guess I need to deploy more agents (the provided helm chart only supports defining one, right?). I see that I can use
update_agent
from query api to make agent work with the specific tenant. Can this be configured during the deployment?
x
xyzz
04/09/2021, 2:30 PM
I didn't even know server supports multiple tenants like cloud 🙂
m
Marko Jamedzija
04/09/2021, 2:31 PM
It does, but each shows all flow runs on its dashboard 😞
k
Kevin Kho
04/09/2021, 2:33 PM
I don’t think that can be configured during deployment because it would need to somehow get a new RUNNER token
👍 1
m
Marko Jamedzija
04/09/2021, 2:34 PM
I kinda gave up on the idea of using them due to the previous comment. But thanks! 🙂
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.