Systematic investigation of background sources in neutron flux measurements with a proton-recoil silicon detector