Using neutron stars and primordial black holes to test theories of quantum gravity