Constraints on ion velocity distributions from fusion product spectroscopy