The S-matrix and graviton self-energy in quantum Yang-Mills gravity