https://prefect.io logo
Title
r

RyanB

11/13/2019, 12:16 AM
question on dask-kubernetes, I get a ERROR - prefect.FlowRunner | Unexpected error: ValueError(“Unexpected keyword arguments: [‘processes’, ‘silence_logs’]“,) Traceback (most recent call last): File “/usr/local/lib/python3.6/dist-packages/prefect/engine/runner.py”, line 48, in inner new_state = method(self, state, *args, **kwargs) File “/usr/local/lib/python3.6/dist-packages/prefect/engine/flow_runner.py”, line 393, in get_flow_run_state with executor.start(): File “/usr/lib/python3.6/contextlib.py”, line 81, in enter return next(self.gen) File “/usr/local/lib/python3.6/dist-packages/prefect/engine/executors/dask.py”, line 74, in start self.address, processes=self.local_processes, **self.kwargs File “/usr/local/lib/python3.6/dist-packages/distributed/client.py”, line 651, in init “Unexpected keyword arguments: {}“.format(str(sorted(kwargs))) ValueError: Unexpected keyword arguments: [‘processes’, ‘silence_logs’] when trying to connect to a local dask scheduler created using KubeCluster()
c

Chris White

11/13/2019, 12:19 AM
Hmmm those are keyword arguments we use for the standard dask client that makes the connection - can you confirm you are using the most recent version of distributed?
r

RyanB

11/13/2019, 12:22 AM
I was using dask[complete]==2.6.0 tried 2.5.2 now trying 2.7.0
@Chris White I noticed https://github.com/dask/distributed/issues/3151 wasn’t sure if this is related, why I went back to 2.5.2
c

Chris White

11/13/2019, 12:26 AM
Yea I believe we fixed that on the prefect side - are you using 0.7.1?
r

RyanB

11/13/2019, 12:26 AM
nope, 0.6.6 I will give that a go thx
c

Chris White

11/13/2019, 12:28 AM
Ah great yea I suspect that will resolve the issue 🤞
j

josh

11/13/2019, 6:42 PM
@Marvin archive “dask-kubernetes unexpected keyword arguments”