Self-Supervised Aggregation of Diverse Experts for Test-Agnostic Long-Tailed Recognition