I saw that in prefect for AWS, I can create a new ECS cluster and supply it to the work pool later. Can I use an ECS cluster manually defined by me? (Not through Prefect)

yes, there shouldn’t be any difficulties there.