question on dask-kubernetes, I get a ERROR - prefect.FlowRunner | Unexpected error: ValueError(“Unexpected keyword arguments: [‘processes’, ‘silence_logs’]“,)
Traceback (most recent call last):
File “/usr/local/lib/python3.6/dist-packages/prefect/engine/runner.py”, line 48, in inner
new_state = method(self, state, *args, **kwargs)
File “/usr/local/lib/python3.6/dist-packages/prefect/engine/flow_runner.py”, line 393, in get_flow_run_state
with executor.start():
File “/usr/lib/python3.6/contextlib.py”, line 81, in enter
return next(self.gen)
File “/usr/local/lib/python3.6/dist-packages/prefect/engine/executors/dask.py”, line 74, in start
self.address, processes=self.local_processes, **self.kwargs
File “/usr/local/lib/python3.6/dist-packages/distributed/client.py”, line 651, in init
“Unexpected keyword arguments: {}“.format(str(sorted(kwargs)))
ValueError: Unexpected keyword arguments: [‘processes’, ‘silence_logs’] when trying to connect to a local dask scheduler created using KubeCluster()
c
Chris White
11/13/2019, 12:19 AM
Hmmm those are keyword arguments we use for the standard dask client that makes the connection - can you confirm you are using the most recent version of distributed?
r
RyanB
11/13/2019, 12:22 AM
I was using dask[complete]==2.6.0 tried 2.5.2 now trying 2.7.0
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.