Is the prefect agent supposed to clean up completed pods when running on kubernetes? I see tons of pods in a completed state (prefect version 2.7.10 for my agent)

Not by default. You can configure a ttl on the Kubernetes job block.