Challenges for the Accurate Determination of the Surface Thermal Condition via In-Depth Sensor Data