Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

prefect 2.3.1 with prefect-dask 0.2.0, I am getting the following error

`prefect.exceptions.PrefectHTTPStatusError: Server error '500 Internal Server Error' for url '<http://prefect-server:4200/api/task_runs/>'`
`Response: {'exception_message': 'Internal Server Error'}`
`For more information check: <https://httpstatuses.com/500>`
`2022-09-06 00:53:06,614 - distributed.scheduler - ERROR - Couldn't gather keys {'ec1143ab-f7bf-426f-8367-b2db2e00def5': ['<tcp://127.0.0.1:36059>']} state: [None] workers: []`
`NoneType: None`
`2022-09-06 00:53:06,615 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: ['<tcp://127.0.0.1:36059>'], ec1143ab-f7bf-426f-8367-b2db2e00def5`
`NoneType: None`
`00:53:07.108 | DEBUG   | prefect.client - Connecting to API at <http://prefect-server:4200/api/>`
`00:53:07.843 | DEBUG   | prefect.engine - Reported crashed flow run 'incredible-dove' successfully!`
`2022-09-06 00:53:07,876 - distributed.core - ERROR -` 
`Traceback (most recent call last):`

I have something similar :
```Exception: 'PrefectHTTPStatusError("Client error \'404 Not Found\' for url \'<http://ephemeral-orion/api/task_runs/a158be60-8b91-49d8-ab7e-46a5969116d6/set_state>\'\\nResponse: {\'exception_message\': \'Task run with id a158be60-8b91-49d8-ab7e-46a5969116d6 not found\'}\\nFor more information check: <https://httpstatuses.com/404>")'```

```distributed.protocol.pickle - INFO - Failed to deserialize```

I am using prefect on several computer using DaskTaskRunner

seems like there might be a bug in prefect &gt; 2.0.4, compatibility issue with Dask

I gonna try with a downgrade version of prefect

try with at least 2.0.4 and clear all prefect data

<@U0412GLGXEZ> whats the current status, did u fix the issue?

In the end I used prefect cloud and it worked ! I am not sure it will work for you but it's worth a shot
However I had PermissionError issues and I also had to modify the `PREFECT_LOCAL_STORAGE_PATH` to be sure that every worker would have permission rights