https://prefect.io logo
Title
z

Zachary Lee

12/16/2022, 10:51 PM
Hey all! I'm self-hosting prefect server via kubernetes, and the prefect-hasura component (
<http://docker.io/hasura/graphql-engine:v2.0.9|docker.io/hasura/graphql-engine:v2.0.9>
) has suspiciously long
query_execution_times
in its logs (30-240 seconds) for some POST requests:
{
  "type": "http-log",
  "timestamp": "2022-12-16T18:59:06.914+0000",
  "level": "info",
  "detail": {
    "operation": {
      "query_execution_time": 217.92351778,
      "user_vars": {
        "x-hasura-role": "admin"
      },
      "request_id": "0d820ccb-6294-42f1-8433-a7d1d9562684",
      "response_size": 99,
      "request_mode": "single",
      "request_read_time": 0.000004808
    },
    "request_id": "0d820ccb-6294-42f1-8433-a7d1d9562684",
    "http_info": {
      "status": 200,
      "http_version": "HTTP/1.1",
      "url": "/v1alpha1/graphql",
      "ip": "127.0.0.6",
      "method": "POST",
      "content_encoding": "gzip"
    }
  }
}
and it periodically says it's
gracefully shutting down server
, which restarts the pod. Has anyone here experienced anything like this before?
j

jawnsy

12/16/2022, 10:54 PM
Hey Zachary, is there a reason you’re looking at Prefect 1 rather than our new version, Prefect 2? (orion)
z

Zachary Lee

12/16/2022, 10:55 PM
Oh hmm not that I know of -- what about this is Prefect 1?
j

jawnsy

12/16/2022, 10:56 PM
prefect-server is Prefect 1, our new version has a Helm chart here: https://github.com/PrefectHQ/prefect-helm/tree/main/charts/prefect-orion
z

Zachary Lee

12/16/2022, 10:56 PM
ooooohhh ok cool I did not know that, I will have to ask my team if there's a reason why we're using prefect 1 specifically but it might just be we didn't know about this!
j

jawnsy

12/16/2022, 10:58 PM
This is a good hint that we should update the docs for Prefect Server, sorry about the confusion! 😀
z

Zachary Lee

12/19/2022, 2:59 PM
Do you believe the issue I described is caused by us using prefect 1 instead of prefect 2? We'd like to migrate to prefect 2 eventually but if we can fix this issue in prefect 1 that's preferable to us in the immediate-term
a

Anna Geller

12/19/2022, 3:43 PM
not sth that directly answers your question, but this could point you to some ideas you can try to troubleshoot https://discourse.prefect.io/t/troubleshooting-prefect-server-issues-list-of-resources-you-may-check/1011