Hello community. I am trying to go through the walkthrough example for setting up prefect-ray, however, when I go to deploy my flow, I get the following error:

13:43:38.672 | INFO    | prefect.engine - Created flow run 'qualified-groundhog' for flow 'training-pipeline'
13:43:38.672 | INFO    | Flow run 'qualified-groundhog' - View at <https://1723c8f0a74698b29db0b96f82ec23ca.dv-kubeflow.com/flow-runs/flow-run/a780d274-6693-4025-8d27-40b63cef70c5>
13:43:38.672 | INFO    | prefect.task_runner.ray - Connecting to an existing Ray instance at <http://raycluster-kuberay-head-svc.kuberay.svc.cluster.local:8265>
2024-08-16 13:43:38,672 WARNING worker.py:1446 -- SIGTERM handler is not set because current thread is not the main thread.
13:43:38.672 | ERROR   | Flow run 'qualified-groundhog' - Crash detected! Execution was interrupted by an unexpected exception: AssertionError: Module: http does not have ClientBuilder.

Obviously if I am deploying from a machine outside of my k8 cluster, it wouldn't be able to access the rayCluster deployed. Question is, how can I remedy this? Once the pipeline runs inside the cluster, then it can access it. Do I have to expose my ray remote cluster just to be able to deploy my ray flows?

hi @Alan - hmm i'm not certain that I understand your problem yet is it that you need to run a flow outside of your k8s cluster, but your flow needs access to your ray cluster, which is only accessible in the k8s cluster?

nvm, this was a misunderstanding, i was running the flows instead of deploying them

👍