A task's retry timeout is blocking other tasks from running. Is this on purpose? While the retry-timeout is blocking other runnable tasks, their task-timeout (running time) is running. This seems a bit odd. Or did I miss something?
In other words: when a task is waiting for retry, other tasks cannot use that worker (dask-worker in my case) but the waiting task's clock is running towards runtime-timeout.
okay, maybe i was wrong and the waiting task is in state "pending". i maybe misinterpreted the message
/usr/local/lib/python3.8/site-packages/prefect/engine/task_runner.py:822: UserWarning: This task is running in a daemonic subprocess; consequently Prefect can only enforce a soft timeout limit, i.e., if your Task reaches its timeout limit it will enter a TimedOut state but continue running in the background.
😞