Projected texture fusion

Active consumer grade depth sensors have motivated recent research on volumetric depth map fusion. This led to the development of new, efficient, video-rate integration and tracking methods. These approaches still suffer from the geometric inaccuracies of the input depth maps of consumer grade depth sensors. This paper presents a practical stereo system that combines highly accurate and robust projected texture stereo and efficient volumetric integration and allows to easily capture accurate 3D models of indoor scenes. We describe a stereo method that is optimized for random dot projection patterns and delivers complete and robust results. We also show the complementing hardware setup that delivers accurate, complete depth maps. Results of a real-world scene are compared to ground truth data.

[1]  John J. Leonard,et al.  Robust real-time visual odometry for dense RGB-D mapping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[3]  Reinhard Klette,et al.  The Naked Truth about Cost Functions for Stereo Matching , 2009 .

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  C. Zach.  Fast and High Quality Fusion of Depth Maps , 2008 .

[6]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Andrew J. Davison,et al.  Live dense reconstruction with a single moving camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[9]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Kurt Konolige,et al.  Projected texture stereo , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[12]  Daniel Cremers,et al.  Robust odometry estimation for RGB-D cameras , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Gerhard Paar,et al.  Line Processes for Highly Accurate Geometric Camera Calibration , 2017 .

[14]  Bok-Suk Shin,et al.  Evaluation of two stereo matchers on long real-world video sequences , 2015, Pattern Recognit..

[15]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[17]  Peter A. Beling,et al.  Statistical Analysis-Based Error Models for the Microsoft Kinect™ Depth Sensor , 2014, Sensors.

[18]  Hujun Bao,et al.  Robust 3D Reconstruction With an RGB-D Camera , 2014, IEEE Transactions on Image Processing.

[19]  Reinhard Klette,et al.  Disparity Confidence Measures on Engineered and Outdoor Data , 2012, CIARP.

[20]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[21]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  A. Verri,et al.  A compact algorithm for rectification of stereo pairs , 2000 .

[24]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[25]  Sebastian Thrun,et al.  Unsupervised Intrinsic Calibration of Depth Sensors via SLAM , 2013, Robotics: Science and Systems.

[26]  John K. Tsotsos,et al.  The Roles of Endstopped and Curvature Tuned Computations in a Hierarchical Representation of 2D Shape , 2012, PloS one.

[27]  Andrew J. Davison,et al.  Real-Time Camera Tracking: When is High Frame-Rate Best? , 2012, ECCV.

[28]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[30]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.