Mu-tau neutrino refraction and collective three-flavor transformations in supernovae