Linear response, validity of semiclassical gravity, and the stability of flat space