https://prefect.io logo
m

Michelle Wu

11/17/2020, 7:59 AM
Hi, I've been trying to build a local Dask cluster to run my flows. Everything worked fine when I ran the flows locally:
Copy code
executor = DaskExecutor(address="<tcp://xxx>")
flow.run(executor = executor)
But when I registered the flows to run it in Prefect UI, they stopped running on my local Dask cluster. Neither scheduler or workers showed any reactions in terminal or in Bokeh. I wonder why this is happening?
e

emre

11/17/2020, 10:54 AM
Just to verify, are the following set up: 1. A running local agent 2. You triggered a flow run on the prefect UI after registering the flow 3. Is your flow registered with the correct environment? I believe it should be a
RemoteEnvironment
, that uses a
DaskExecutor
with
executor_kwargs
specifying the address (
RemoteEnvironment(executor=DaskExecutor, executor_kwargs={"address": "<tcp://xxx>"})
) You can check your flow storage end execution environment on the flow page of your UI.
upvote 1
m

Michelle Wu

11/18/2020, 2:11 AM
I added a LocalEnvironment and it worked. Thank you!! @emre
e

emre

11/18/2020, 7:15 AM
Glad to help! Also, I just realized that
RemoteEnvironment
has been deprecated, and LocalEnvironment should be used. Sorry for misinforming 😢
m

Michelle Wu

11/18/2020, 8:44 AM
It’s okay, thanks a lot XD