I submitted a few hundred runs using the prefect API that I want to cancel right now, how can I do that easily?

You might make use of our graphql api to query for all flow runs for the flow, then call

Client.cancel_flow_run

route for each flow run.