Revisiting Modality Imbalance In Multimodal Pedestrian Detection