I'm not sure what the solution to this is, but do other people also find that the Prefect UI Graph becomes unreadable with even a fairly modest number of parallel tasks (e.g. 1000)? Being able to split out into smaller sub-flows would help, but my understanding at the moment is that flows are designed to be run sequentially, so this isn't really an option. I'm using Prefect Cloud UI.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.