Millisecond pulsars cannot account for the inner Galaxy’s GeV excess