A hall of statistical mirrors