https://prefect.io logo
Title
n

Nikul

02/03/2021, 6:38 PM
Hi all, I'm trying to use a remote Kubernetes cluster to do my computations, but submit them directly from a local machine without having to first register a flow, and after the flow has run I want to avoid having to collect the results, eg from GCS (so I would like the computations to be interactive). Is this possible with Prefect? Thank you (The KubernetesAgent and Prefect Server are both running in-cluster).
j

josh

02/03/2021, 8:04 PM
Hi @Nikul I’m not sure I understand what you’re asking about 🤔 perhaps you could provide some more detail of what you are attempting with some examples?
n

Nikul

02/04/2021, 11:56 AM
If I have something like this:
@task
def heavy_computational_task():
    ...
    return result
... and a KubernetesAgent running in a remote cluster, would it be possible to run the task on the cluster, but have result immediately available to me from my local machine?
j

josh

02/04/2021, 2:06 PM
Ah no currently it is required that you register that task with a flow and run it on that agent