Hi,all
After upgrading of Prefect 2 to 3, "run-graph" always say "This flow run did not generate any task or subflow runs" at a "Runs" pane with Deployment on Kubernetes Worker. Somehow but when I execute same flow at other workload, it works. why?
woker "run-graph" show: Local Execution.
does not show: Kubernetes Worker
syakesaba
09/05/2024, 9:22 AM
expected:
c
Chris White
09/05/2024, 2:37 PM
Hey @syakesaba - this could be a few things; we've gotten some similar reports that we're working on here: https://github.com/PrefectHQ/prefect/issues/15153, so you might start by reading that thread and seeing what applies to your situation. Given that you have a workflow that works fine on some workers but not others, I'm guessing this is an issue with websockets not connecting properly
s
syakesaba
09/06/2024, 1:25 AM
Thank you @Chris White .
I' ll check that!
syakesaba
09/06/2024, 6:54 AM
Thank you @Chris White
as you said,
I got same ERROR of the issue.
200003.634 | ERROR | GlobalEventLoopThread | prefect._internal.concurrency - Service 'EventsWorker' failed with 10 pending items.
and I figure that the error not occur if I ran flow at kubernetes worker in same kubernetes prefect server.
So it seems to be a connectivity issue of my machines between worker and server.
(There is an SSL accelerator and I put custom environment variable PREFECT_API_TLS_INSECURE_SKIP_VERIFY)
Thank you
c
Chris White
09/06/2024, 2:18 PM
feel free to open a new issue on GitHub if you want to investigate deeper there, or if you figure out the root cause!
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.