Ok I think I got it. My Dask workers were too small, and some would die from time to time. When a Dask worker dies, it is restarted and run its task history once again (including completed tasks). Prefect only emits a warning when the worker is restarted, I wonder if this the desired behavior. Maybe it would be better if the flow crashed instead.