Observed binary populations reflect the Galactic history