If I cancel a flow run, should I expect the Fargate task executing the flow to automatically be stopped? I've found that I have to manually stop it.

It should automatically stop, but depending on the executor you're using that may happen quickly or slowly. Can you say more about the behavior you're seeing?