A new shape from shading technique with application to Mars Express HRSC images

Abstract We have developed a new optimisation based shape from shading algorithm which is able to make use of sophisticated camera and reflectance models and does not require a good initialising surface. Surface shape consistent with ground truth is obtained when the technique is applied to both synthetic rendered surfaces and real images captured by the Mars Express orbiter and HRSC instrument. The obtained surfaces provide improved fine surface detail over that found using stereo techniques and demonstrate the applicability of the technique to real images.

[1]  Christian Heipke,et al.  Simulation studies and practical tests using multi-image shape from shading☆ , 2001 .

[2]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[3]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[4]  Aaron F. Bobick,et al.  The direct computation of height from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Berthold K. P. Horn.  Height and gradient from shading , 1989, International Journal of Computer Vision.

[6]  Jianbo Shi,et al.  Shape from Shading: Recognizing the Mountains through a Global View , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Shiu Yin Yuen,et al.  A fast marching formulation of perspective shape from shading under frontal illumination , 2007, Pattern Recognit. Lett..

[8]  Roland Siegwart,et al.  The ExoMars rover and Pasteur payload Phase A study: an approach to experimental astrobiology , 2006 .

[9]  Konrad Schindler,et al.  Reconstruction of Archaeological Finds using Shape from Stereo and Shape from Shading , 2004 .

[10]  Yehezkel Yeshurun,et al.  Shape-from-Shading Under Perspective Projection , 2005, International Journal of Computer Vision.

[11]  Shree K. Nayar,et al.  Generalization of Lambert's reflectance model , 1994, SIGGRAPH.

[12]  R. Jaumann,et al.  HRSC: the High Resolution Stereo Camera of Mars Express , 2004 .

[13]  J. Muller,et al.  Multi-resolution topographic data extraction from Martian stereo imagery , 2009 .

[14]  Dimitris N. Metaxas,et al.  Incorporating Illumination Constraints in Deformable Models for Shape from Shading and Light Direction Estimation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  R. Jaumann,et al.  Context for the ESA ExoMars rover: the Panoramic Camera (PanCam) instrument , 2006, International Journal of Astrobiology.

[16]  Alfred M. Bruckstein,et al.  Global shape from shading , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[17]  J. Muller,et al.  Evaluating planetary digital terrain models - the HRSC DTM test , 2007 .

[18]  J. Muller,et al.  HRSC on Mars Express - Photogrammetric and Cartographic Research , 2005 .

[19]  Ruigang Yang,et al.  Examplar-based Shape from Shading , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[20]  R. Kirk,et al.  I. Thermal Evolution of Ganymede and Implications for Surface Features. II. Magnetohydrodynamic Constraints on Deep Zonal Flow in the Giant Planets. III. A Fast Finite-Element Algorithm for Two-Dimensional Photoclinometry , 1987 .

[21]  Ron Kimmel,et al.  Optimal Algorithm for Shape from Shading and Path Planning , 2001, Journal of Mathematical Imaging and Vision.

[22]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[23]  Alex Pentland,et al.  A simple algorithm for shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Clay M. Thompson,et al.  Robust Photo-topography by Fusing Shape-from-Shading and Stereo , 1993 .