High-Energy Phase-Averaged Spectra from Gamma-Ray Pulsars