Exotic $Z_2$ Symmetry Breaking Transitions in 2D Correlated Systems