https://prefect.io logo
#prefect-community
Title
# prefect-community
f

Faheem Khan

09/06/2022, 1:09 AM
prefect 2.3.1 with prefect-dask 0.2.0, I am getting the following error
1
prefect.exceptions.PrefectHTTPStatusError: Server error '500 Internal Server Error' for url '<http://prefect-server:4200/api/task_runs/>'
Response: {'exception_message': 'Internal Server Error'}
For more information check: <https://httpstatuses.com/500>
2022-09-06 00:53:06,614 - distributed.scheduler - ERROR - Couldn't gather keys {'ec1143ab-f7bf-426f-8367-b2db2e00def5': ['<tcp://127.0.0.1:36059>']} state: [None] workers: []
NoneType: None
2022-09-06 00:53:06,615 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: ['<tcp://127.0.0.1:36059>'], ec1143ab-f7bf-426f-8367-b2db2e00def5
NoneType: None
00:53:07.108 | DEBUG   | prefect.client - Connecting to API at <http://prefect-server:4200/api/>
00:53:07.843 | DEBUG   | prefect.engine - Reported crashed flow run 'incredible-dove' successfully!
2022-09-06 00:53:07,876 - distributed.core - ERROR -
Traceback (most recent call last):
p

Pierre LIBAULT

09/06/2022, 7:44 AM
I have something similar :
Copy code
Exception: 'PrefectHTTPStatusError("Client error \'404 Not Found\' for url \'<http://ephemeral-orion/api/task_runs/a158be60-8b91-49d8-ab7e-46a5969116d6/set_state>\'\\nResponse: {\'exception_message\': \'Task run with id a158be60-8b91-49d8-ab7e-46a5969116d6 not found\'}\\nFor more information check: <https://httpstatuses.com/404>")'
👍 1
Copy code
distributed.protocol.pickle - INFO - Failed to deserialize
I am using prefect on several computer using DaskTaskRunner
f

Faheem Khan

09/06/2022, 8:20 AM
seems like there might be a bug in prefect > 2.0.4, compatibility issue with Dask
p

Pierre LIBAULT

09/06/2022, 8:26 AM
I gonna try with a downgrade version of prefect
f

Faheem Khan

09/06/2022, 8:43 AM
try with at least 2.0.4 and clear all prefect data
@Pierre LIBAULT whats the current status, did u fix the issue?
p

Pierre LIBAULT

09/09/2022, 1:20 AM
In the end I used prefect cloud and it worked ! I am not sure it will work for you but it's worth a shot However I had PermissionError issues and I also had to modify the
PREFECT_LOCAL_STORAGE_PATH
to be sure that every worker would have permission rights
🙏 1
a

Anna Geller

09/10/2022, 12:26 AM
thanks for the update Pierre!