A Plane Extraction Approach in Inverse Depth Images Based on Region-Growing

Planar surfaces are prevalent components of man-made indoor scenes, and plane extraction plays a vital role in practical applications of computer vision and robotics, such as scene understanding, and mobile manipulation. Nowadays, most plane extraction methods are based on reconstruction of the scene. In this paper, plane representation is formulated in inverse-depth images. Based on this representation, we explored the potential to extract planes in images directly. A fast plane extraction approach, which employs the region growing algorithm in inverse-depth images, is presented. This approach consists of two main components: seeding, and region growing. In the seeding component, seeds are carefully selected locally in grid cells to improve exploration efficiency. After seeding, each seed begins to grow into a continuous plane in succession. Both greedy policy and a normal coherence check are employed to find boundaries accurately. During growth, neighbor coplanar planes are checked and merged to overcome the over-segmentation problem. Through experiments on public datasets and generated saw-tooth images, the proposed approach achieves 80.2% CDR (Correct Detection Rate) on the ABW SegComp Dataset, which has proven that it has comparable performance with the state-of-the-art. The proposed approach runs at 5 Hz on typical 680 × 480 images, which has shown its potential in real-time practical applications in computer vision and robotics with further improvement.

[1]  Sven Behnke,et al.  Approximate triangulation and region growing for efficient segmentation and smoothing of range images , 2014, Robotics Auton. Syst..

[2]  Shichao Yang,et al.  Pop-up SLAM: Semantic monocular plane SLAM for low-texture environments , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Jörg Stückler,et al.  Efficient Multi-resolution Plane Segmentation of 3D Point Clouds , 2011, ICIRA.

[4]  Rolf Lakaemper,et al.  Fast plane extraction in 3D range data based on line segments , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Zhi Jin,et al.  Depth image-based plane detection , 2018, Big Data Analytics.

[6]  Radu Horaud,et al.  Plane-extraction from depth-data using a Gaussian mixture regression model , 2017, Pattern Recognit. Lett..

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Cang Ye,et al.  NCC-RANSAC: A Fast Plane Extraction Method for 3-D Range Data Segmentation , 2014, IEEE Transactions on Cybernetics.

[9]  Shichao Yang,et al.  Monocular Object and Plane SLAM in Structured Environments , 2018, IEEE Robotics and Automation Letters.

[10]  Roland Siegwart,et al.  Conference Presentation Slides on Kinect v2 for Mobile Robot Navigation: Evaluation and Modeling , 2015 .

[11]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Longin Jan Latecki,et al.  Unsupervised object region proposals for RGB-D indoor scenes , 2017, Comput. Vis. Image Underst..

[13]  Yunsick Sung,et al.  Fast Planar Detection System Using a GPU-Based 3D Hough Transform for LiDAR Point Clouds , 2020, Applied Sciences.

[14]  Ziran Xing,et al.  Extracting Multiple Planar Surfaces Effectively and Efficiently Based on 3D Depth Sensors , 2019, IEEE Access.

[15]  Yang Gao,et al.  Fast Cylinder and Plane Extraction from Depth Cameras for Visual Odometry , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Nassir Navab,et al.  Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Luciano Silva,et al.  Range image segmentation by surface extraction using an improved robust estimator , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Sven Behnke,et al.  Fast Range Image Segmentation and Smoothing Using Approximate Surface Reconstruction and Region Growing , 2012, IAS.

[19]  Ian D. Reid,et al.  Geometrically consistent plane extraction for dense indoor 3D maps segmentation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Stefanos Kollias,et al.  Unsupervised semantic object segmentation of stereoscopic video sequences , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[21]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[22]  Jan Kautz,et al.  PlaneRCNN: 3D Plane Detection and Reconstruction From a Single Image , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Zhi Jin,et al.  Robust Plane Detection Using Depth Information From a Consumer Depth Camera , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Vineet R. Kamat,et al.  Fast plane extraction in organized point clouds using agglomerative hierarchical clustering , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Jörg Stückler,et al.  Towards Semantic Scene Analysis with Time-of-Flight Cameras , 2010, RoboCup.

[26]  Roberto Manduchi,et al.  CC-RANSAC: Fitting planes in the presence of multiple surfaces in range data , 2011, Pattern Recognit. Lett..

[27]  Henrik I. Christensen,et al.  Efficient Organized Point Cloud Segmentation with Connected Components , 2013 .