Influence of defects and temperature on the annihilation of positrons in neutron-irradiated silicon