In theory should it be possible to execute a run that submits ~15,000 tasks on the concurrent task runner? I'm using a semaphore implementation to limit the execution to only 3 tasks at a time. Prefect cloud seems to be crashing when I try and open the flow run logs for this flow as its running, although it's still running ok in the execution infrastructure so far.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.