Channels
#prefect-community
Title
# prefect-community
a
Avi A
08/23/2020, 11:13 AMHey, I’m using a
LocalEnvironmentDaskClusterping. does anyone know how to answer this? I actually also want to be able to connect to that scheduler from inside one of the tasks and I don’t know how
j
Jenny
09/08/2020, 2:19 PMHi Avi - are you wanting to know the default base url for the UI when you're using Sever? It's http://localhost:8080. If that wasn't what you were asking can you give me a bit more detail? Thanks.
a
Avi A
09/08/2020, 2:21 PMno, I want to read the attributes of the dask scheduler that spawns when the job is running. I was expecting to find it in the prefect context when the flow is running, but it’s not there
the default scheduler address is
localhost:8786DaskClusterj
Jenny
09/08/2020, 2:23 PMAh - thanks for the clarification - that makes more sense. Let me check with the team.
a
Avi A
09/08/2020, 2:23 PMThanks @Jenny
j
Jim Crist-Harif
09/08/2020, 2:48 PMI actually also want to be able to connect to that scheduler from inside one of the tasks and I don’t know howI don't recommend doing this based on the address of the dask cluster, but rather use a
worker_client Copy code
from distributed import worker_client
@task
def example():
with worker_client() as client:
# do your dask stuff herea
Avi A
09/08/2020, 2:49 PMOMG this is super cool!
🚀 1
@Jim Crist-Harif how do I make this client the default client? I’m not actually submitting a task on my own, I’m running a computation on a dask dataframe and would like the computation to be done on the existing cluster. I currently do this by:
Copy code
client = Client(existing_cluster_addr) # this implicitly makes the client the default execution entry for dask operations
...
dask_dataframe.operations.compute()clientj
Jim Crist-Harif
09/08/2020, 3:02 PMI don't recommend setting it as the default client, that will bleed outside of that single task and may affect other tasks. Rather, I recommend passing
scheduler=client.computea
Avi A
09/08/2020, 3:03 PMsounds like a plan. I thought
scheduler