Thermal and fast neutron detection in chemical vapor deposition single-crystal diamond detectors