The curious case of the Potts spin glass