I m trying to run this example

Question

I m trying to run this example <https docs prefect io core tutorials dask cluster html> with my HPC Dask cluster I get this error ``` 2019 10 21 21 17 43 141 INFO prefect FlowRunner | Beginning Flow run for dask example 2019 10 21 21 17 43 144 INFO prefect FlowRunner | Starting flow run 2019 10 21 21 17 43 145 ERROR prefect FlowRunner | Unexpected error ValueError Unexpected keyword arguments processes silence logs Traceback most recent call last File lab corradin data FOR AN anaconda3 envs learn new pkgs lib python3 7 site packages prefect engine runner py line 48 in inner new state = method self state args kwargs File lab corradin data FOR AN anaconda3 envs learn new pkgs lib python3 7 site packages prefect engine flow runner py line 393 in get flow run state with executor start File lab corradin data FOR AN anaconda3 envs learn new pkgs lib python3 7 contextlib py line 112 in enter return next self gen File lab corradin data FOR AN anaconda3 envs learn new pkgs lib python3 7 site packages prefect engine executors dask py line 74 in start self address processes=self local processes self kwargs File lab corradin data FOR AN anaconda3 envs learn new pkgs lib python3 7 site packages distributed client py line 649 in init Unexpected keyword arguments format str sorted kwargs ValueError Unexpected keyword arguments processes silence logs 2019 10 21 21 17 43 149 ERROR prefect Flow dask example | Unexpected error occured in FlowRunner ValueError Unexpected keyword arguments processes silence logs ``` conda versions ``` Name Version Build Channel dask 2 6 0 py 0 conda forge dask core 2 6 0 py 0 conda forge dask glm 0 2 0 py 1 conda forge dask jobqueue 0 6 3 py 0 conda forge dask ml 1 0 0 py 1 conda forge Name Version Build Channel prefect 0 6 6 py 0 conda forge ``` cluster configuration ```python from dask jobqueue import LSFCluster cluster = LSFCluster queue= all corradin cores= 47 processes = 2 walltime= 5000 00 memory= 250GB local directory = tmp job extra= o dev null e dev null scheduler port = 8786 worker dashboard address = 8788 cluster scale 17 ```

Chris White · Answer

Hi < An Hoang> If you update your local version of prefect OR downgrade your version of `dask distributed` this issue will go away

An Hoang · Answer

Thanks for the rapid reply < Chris White> I was able to get the example to work Is there somewhere I can find tips for debugging Prefect running on Dask I have ``` result = flow run executor=executor result result lt Task 2 gt lt Success None gt lt Task 14 gt lt Success None gt lt Task 17 gt lt Success None gt lt Task 21 gt lt Success None gt lt Task 20 gt lt Success None gt lt Task List gt lt Success Task run succeeded gt lt Task 3 gt lt Success None gt lt Task 13 gt lt Success None gt lt Task 6 gt lt Success None gt lt Task run script gt lt Mapped Mapped tasks submitted for execution gt lt Task 10 gt lt Success None gt lt Task 16 gt lt Success None gt lt Task 11 gt lt Success None gt lt Task 19 gt lt Success None gt lt Task 4 gt lt Success None gt lt Task 5 gt lt Success None gt lt Task 9 gt lt Success None gt lt Task 12 gt lt Success None gt lt Task 7 gt lt Success None gt lt Task 8 gt lt Success None gt lt Task 15 gt lt Success None gt lt Task 1 gt lt Success None gt lt Task 18 gt lt Success None gt ``` and don t know where to go from here my task is ``` task name= run script def run MS analysis chr num papermill execute notebook MS HWE QC input ipynb f MS HWE QC chr chr num ipynb parameters= chr num chr num with Flow dask example as flow run MS analysis map list range 1 23 ```

An Hoang · Answer

It works when running locally just not when mapped

Chris White · Answer

I don t think I m following in your example it appears that all of your tasks succeeded