I’ve got a task mapping set up, but the child tasks sometimes have to retry until the external data they read is ready. When one of them enters the Retrying state, it seems to hold up the entire flow. The parent doesn’t produce any more tasks until the retrying one is complete. Is there way around this behaviour? Ideally I’d like the parent to spawn all its tasks right away, and for Prefect to identify which ones can be run, rather than one retry blocking everyone else

Hey @Eli Treuherz, I think this is because the default is executor is a sequential single-threaded executor. You can just use the LocalDaskExecutor to introduce parallelism. Are you putting a time to restart and that is hanging things?

Either I have a long retry interval and it waits for that, or I have a short one and it retries until it succeeds, but either way it blocks the rest of the flow. I don’t really want or need parallelism here, just eager execution of available tasks

Ok will ask the other team for more options