Hi Everyone, My flow is getting crashed when runni...
# ask-community
n
Hi Everyone, My flow is getting crashed when running Kubernetes block, can anyone please help me on this what is the issue here, why it is getting crashed. prefect version 2.16.3
n
hi @Nimesh Kumar - do you have agent logs? this may not be enough information as is
n
This is all i am getting in agent logs
Hi Nate, Any suggestion or thought regarding this
n
hi @Nimesh Kumar - I am not sure, I think the log about backoff limit could be improved - have you set that value job backoff limit yourself? you might try and run
kubectl get pods -n your-ns
to see if you have any stray jobs that might need to be deleted
n
I set these values from prefect UI: Job Watch Timeout Seconds 3600 Pod Watch Timeout Seconds 18400 Stream Output true Finished Job Ttl 18400 other than these i didn't any values.
Also getting this runtime error too
Copy code
<frozen runpy>:128: RuntimeWarning: 'prefect.engine' found in sys.modules after import of package 'prefect', but prior to execution of 'prefect.engine'; this may result in unpredictable behaviour
Copy code
Crash detected! Execution was interrupted by an unexpected exception: PrefectHTTPStatusError: Server error '504 Gateway Timeout' for url '<https://orion-uat.services.carpl.ai/api/flow_runs/4069e4a2-23cf-44e8-a154-950bc92e8caf/set_state>'
For more information check: <https://httpstatuses.com/504>
01:17:21 PM
prefect.flow_runs
Process for flow run '4e7e2550-397e-4cf0-9bd0-b1571826ba66' exited with status code: 1
Any suggestion how can i avoid this. i am triggering the already made deployment from the API
139 Views