Detecting Hidden Differences via Permutation Symmetries