Optimal estimation of spectral surface reflectance in challenging atmospheres