https://prefect.io
Join Slack
Hi Everyone, My flow is getting crashed when running Kubernetes block, can anyone please help me on ...
# ask-community
n
Hi Everyone, My flow is getting crashed when running Kubernetes block, can anyone please help me on this what is the issue here, why it is getting crashed. prefect version 2.16.3
n
hi @Nimesh Kumar - do you have agent logs? this may not be enough information as is
n
This is all i am getting in agent logs
Hi Nate, Any suggestion or thought regarding this
n
hi @Nimesh Kumar - I am not sure, I think the log about backoff limit could be improved - have you set that value job backoff limit yourself? you might try and run 
kubectl get pods -n your-ns
to see if you have any stray jobs that might need to be deleted
n
I set these values from prefect UI: Job Watch Timeout Seconds 3600 Pod Watch Timeout Seconds 18400 Stream Output true Finished Job Ttl 18400 other than these i didn't any values.
Also getting this runtime error too
Copy code
<frozen runpy>:128: RuntimeWarning: 'prefect.engine' found in sys.modules after import of package 'prefect', but prior to execution of 'prefect.engine'; this may result in unpredictable behaviour
Copy code
Crash detected! Execution was interrupted by an unexpected exception: PrefectHTTPStatusError: Server error '504 Gateway Timeout' for url '<https://orion-uat.services.carpl.ai/api/flow_runs/4069e4a2-23cf-44e8-a154-950bc92e8caf/set_state>'
For more information check: <https://httpstatuses.com/504>
01:17:21 PM
prefect.flow_runs
Process for flow run '4e7e2550-397e-4cf0-9bd0-b1571826ba66' exited with status code: 1
Any suggestion how can i avoid this. i am triggering the already made deployment from the API
143 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by