Clearing the Smoke: Nebular Spectra of 100+ Type Ia Supernovae Exclude Single Degenerate Progenitors