Time-stability of a Single-crystal Diamond Detector for fast neutron beam diagnostic under alpha and neutron irradiation