Conformal Symmetry and the Three Point Function for the Gravitational Axial Anomaly