The long and the short of it: modelling double neutron star and collapsar Galactic dynamics