Hi :wave:, I'am facing a weird issue with my flow ...
# prefect-kubernetes
m
Hi šŸ‘‹, I'am facing a weird issue with my flow runs. I'am using Prefect2.11 My infra is a k8s cluster on a pool of node & namespace which contains my self-hosted prefect server, workers and services. All the flow runs are configured to run on the same namespace and node pool as well. Sometimes when a flow makes an API call to my services it works, sometimes it doesn't. It feels like it's a random thing.
Copy code
# error message when it fails
Finished in state Failed('Flow run encountered an exception. Exception: Error calling <http://extract-api.prefect.svc.cluster.local:80/extract>: Internal Server Error')
In "extract-api" service log, there is no error message, apparently the query didn't reach the service If I hit the "retry" button in the "flow run" UI, at some point, the flow will be successfully completed. Do you have any idea why this is happening? I'm not sure whether my bug is linked to Prefect or to my cluster
After some investigations, it's seems that the problem was the ressources available on my cluster. Make sure to define a proper resources limits to your jobs and set a proper limit on flow runs concurrency