The Impact of Magnetic Field on the Thermal Evolution of Neutron Stars