was having major issues running just 100 mapped tasks concurrently. i think i found a solution but not sure as i have not done a much larger workload yet but have not had any errors in the last 10 runs. posted comments here: https://github.com/PrefectHQ/prefect/issues/6492#issuecomment-1630081353
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.