Hi - my previously working kubernetes prefect server setup seems to have broken somehow. When I submit jobs via the UI, the agent logs say that the job has been successfully submitted (
Completed deployment of flow run
), but no job container ever appears in k8s and the UI just hangs forever at “Submitted for execution”. Restarting the agent does not help. Does anyone know how to debug this?
Ryan Sattler
11/10/2021, 12:46 AM
Never mind - I found out that this was due to resource limits on my kubernetes namespace. It’s unfortunate that there’s no error in this case but that might be the nature of kubernetes here.
👍 1
z
Zanie
11/10/2021, 3:57 AM
Would you mind opening an issue for this? It may not be immediately addressable but the agent does monitor jobs it creates and we could eventually add a check for this.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.