Matt Delacour
07/20/2022, 2:37 PMLocalDaskExecutor
and I cannot understand the problem.
I am trying to run parallel calls for Rest API endpoints. The problem is that the Dask executor will run some calls twice for no apparent reason. Here is the logic I have
Then I can see that some Dask tasks run on the same endpoint while when I log all the endpoints, there are all unique...
I will post the logic as a snippet in the thread 🧵Kevin Kho
07/20/2022, 4:31 PMMatt Delacour
07/20/2022, 4:50 PMKevin Kho
07/20/2022, 6:17 PMMatt Delacour
07/20/2022, 6:26 PMAh I know the issue. I think your class is not thread safeHa ... That explains it then. Maybe it would be worth adding a "Warning" section in the documentation about that specific issue. Lost couple of hours on that 😢
Kevin Kho
07/20/2022, 6:44 PM