Task was destroyed but it is pending! task: <Task pending name='Task-36427' ! Sometime I got this error. Note: I have millions of task running parallely.

Millions!? Could you show me a screenshot or some logs?

This is Prefect 1 on Dask right? That specific log is not a Prefect log though

I just have list of 100000 objects which contains different attributes. I am using map function on this list for analysing sentiment of each and every object seperately

I think this is more of a Dask error

Hahahaha! Gone through this😃 I thought some have/maybe encountered this in our community.

No first time seeing it here. I don’t know if you need to try to slow down submission a bit

Slowing Down Makes it successful. Just want to know why this is happening. We are working on a product in which at a given point of time we need to process millions of tasks.

I wouldn’t know for this scale. Maybe you can asking the Dask Discourse? But it’s not Dask specific, i think it’s asyncio specific. Still though, they might be a good place to ask, or maybe the asyncio github issues?

@Kevin Kho, Hey Kevin ! Thanks for the help.