I was using ansible for this, but increasingly became frustrated with it (it seemed to be getting in the way rather than helping)