Longitudinal spin relaxation in nitrogen-vacancy ensembles in diamond