Spectroscopy of the Largest Ever Gamma-Ray Selected AGN Sample