Low mass X-ray binaries in the Inner Galaxy: implications for millisecond pulsars and the GeV excess