Shading constraint improves accuracy of time-of-flight measurements

We describe a technique for improving the accuracy of range maps measured by time-of-flight (TOF) cameras. The technique is based on the observation that the range map and intensity image measured by a TOF camera are not independent but are linked by the shading constraint: If the reflectance properties of the surface are known, a certain range map implies a corresponding intensity image. We impose the shading constraint using a probabilistic model of image formation and find a maximum a posteriori estimate for the true range map. We present results on both synthetic and real TOF camera images that demonstrate the robust shape estimates achieved by the algorithm.

[1]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[2]  Sebastian Thrun,et al.  A Bayesian method for probable surface reconstruction and decimation , 2006, TOGS.

[3]  Richard C. Wilson,et al.  Integrating Stereo with Shape-from-Shading derived Orientation Information , 2007, BMVC.

[4]  Jean-Denis Durou,et al.  Numerical methods for shape-from-shading: A new survey with benchmarks , 2008, Comput. Vis. Image Underst..

[5]  Pascal Fua,et al.  Variable albedo surface reconstruction from stereo and shape from shading , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Mark Carlotto,et al.  A method for shape-from-shading using multiple images acquired under different viewing and lighting conditions , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jean-Denis Durou,et al.  Ambiguous Shape from Shading with Critical Points , 2004, Journal of Mathematical Imaging and Vision.

[9]  Pascal Fua,et al.  Object-centered surface reconstruction: Combining multi-image stereo and shading , 1995, International Journal of Computer Vision.

[10]  Clay M. Thompson,et al.  Robust Photo-topography by Fusing Shape-from-Shading and Stereo , 1993 .

[11]  Aaron F. Bobick,et al.  The direct computation of height from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Sebastian Thrun,et al.  An Application of Markov Random Fields to Range Sensing , 2005, NIPS.

[13]  Mubarak Shah,et al.  Integration of shape from shading and stereo , 1995, Pattern Recognit..

[14]  Anil K. Jain,et al.  Fusion of range and intensity images on a connection machine (CM-2) , 1995, Pattern Recognit..

[15]  Richard C. Wilson,et al.  Combining shape-from-shading and stereo using Gaussian-Markov random fields , 2008, 2008 19th International Conference on Pattern Recognition.

[16]  William H. Press,et al.  Numerical recipes in C , 2002 .

[17]  Aly A. Farag,et al.  Integrating shape from shading and range data using neural networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).