Neutron star observations of pseudoscalar-mediated dark matter