Symmetry breaking, conformal geometry and gauge invariance