Range Images

While range images can easily be captured through readily available commercial off-the-shelf range cameras/sensors/finders nowadays, it is not immediate for the user to appreciate and understand the technological challenges involved in range imaging. This article gives an overview of range imaging techniques with an aim to let the reader better understand how the difficult issue, such as the registration of overlapping range images, can be approached and solved. This article firstly introduces the characteristics of range images and highlights examples of 3D image visualizations, associated technical issues, applications and the differences of range imaging with respect to the traditional digital broadband imaging. Subsequently, one of the most popular feature extraction and matching methods, the signature of histograms of orientations (SHOT) method, is then outlined. However, the “matched” points generated by SHOT usually generates high proportion of false positives due to various factors such as imaging noise, lack of features and cluttered backgrounds. Thus the article discusses more about image matching issues particularly to emphasize how the widely employed range image alignment technique, the random sample consensus (RANSAC) method, is compared with a simple yet effective technique based on normalized error penalization (NEP). This simple NEP method utilizes a strategy to penalise point matches whose errors are far away from the majority. The capability of the method for the evaluation of point matches between overlapping range images is illustrated by experiments using real range image data sets. Interestingly enough, these range images appear to be easier to register than expected. Finally, some conclusions have been drawn and further readings for other fundamental techniques and concepts have been suggested.

[1]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[4]  K. Storjohann Laser range camera modeling , 1990 .

[5]  In So Kweon,et al.  Experimental Characterization of the Perceptron Laser Rangefinder , 1991 .

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Eric Mjolsness,et al.  New Algorithms for 2D and 3D Point Matching: Pose Estimation and Correspondence , 1998, NIPS.

[8]  Adrian Hilton,et al.  Automatic inspection of loaded PCBs using 3D range data , 1994, Electronic Imaging.

[9]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[10]  J. P. Jones,et al.  Calibration and control for range imaging in mobile robot navigation , 1994 .

[11]  Gabriel Taubin,et al.  Estimating the tensor of curvature of a surface from a polyhedral approximation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[12]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[13]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[14]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[16]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[17]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[18]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[19]  Radu Horaud,et al.  Hand Motion from 3D Point Trajectories and a Smooth Surface Model , 2004, ECCV.

[20]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[21]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[22]  Kim L. Boyer,et al.  Precision range image registration using a robust surface interpenetration measure and enhanced genetic algorithms , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Yonghuai Liu,et al.  Automatic registration of overlapping 3D point clouds using closest points , 2006, Image Vis. Comput..

[24]  Ran Liu,et al.  Outlier Robust ICP for Minimizing Fractional RMSD , 2006, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[25]  Takeshi Oishi,et al.  Flying Laser Range Sensor for Large-Scale Site-Modeling and Its Applications in Bayon Digital Archival Project , 2008, International Journal of Computer Vision.

[26]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[27]  Carlos Torre-Ferrero,et al.  A similarity measure for 3D rigid registration of point clouds using image-based descriptors with low overlap , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[28]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[30]  Yonghuai Liu,et al.  Practical issues and development of underwater 3D laser scanners , 2010, 2010 IEEE 15th Conference on Emerging Technologies & Factory Automation (ETFA 2010).

[31]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[32]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[33]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[34]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.