Is there anyway to remove a prefect agent and stop prefect cloud from using it to run more flows?

You need to kill that process because it works by pinging Cloud every 10 seconds so Cloud will keep detecting it if you see delete from the UI.

Oh got it; thanks!