CC-RANSAC: Fitting planes in the presence of multiple surfaces in range data

Range sensors, in particular time-of-flight and stereo cameras, are being increasingly used for applications such as robotics, automotive, human-machine interface and virtual reality. The ability to recover the geometrical structure of visible surfaces is critical for scene understanding. Typical structured indoor or urban scenes are often represented via compositional models comprising multiple planar surface patches. The RANSAC robust regression algorithm is the most popular technique to date for extracting individual planar patches from noisy data sets containing multiple surfaces. Unfortunately, RANSAC fails to produce reliable results in situations with two nearby patches of limited extent, where a single plane crossing through the two patches may contain more inliers than the ''correct'' models. This is the case of steps, curbs, or ramps, which represent the focus of our research for the impact they can have on cars' safe parking systems or robot navigation. In an effort to improve the quality of regression in these cases, we propose a modification of the RANSAC algorithm, dubbed CC-RANSAC, that only considers the largest connected components of inliers to evaluate the fitness of a candidate plane. We provide experimental evidence that CC-RANSAC may recover the planar patches composing a typical step or ramp with substantially higher accuracy than the traditional RANSAC algorithm.

[1]  S. Shankar Sastry,et al.  Generalized principal component analysis (GPCA) , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[3]  James V. Miller,et al.  MUSE: robust surface fitting using unbiased scale estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Peter Meer,et al.  Heteroscedastic Projection Based M-Estimators , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[5]  Viliam Glazduri An Investigation of the Potential Safety Benefits of Vehicle Backup Proximity Sensors , 2005 .

[6]  Michael Spann,et al.  MIR: An Approach to Robust Clustering-Application to Range Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Leonidas J. Guibas,et al.  Estimating surface normals in noisy point cloud data , 2004, Int. J. Comput. Geom. Appl..

[8]  Roberto Manduchi,et al.  Detection and Localization of Curbs and Stairways Using Stereo Vision , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Gabriel Taubin,et al.  Estimation of Planar Curves, Surfaces, and Nonplanar Space Curves Defined by Implicit Equations with Applications to Edge and Range Image Segmentation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David Suter,et al.  Robust range segmentation , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[12]  Wolfram Burgard,et al.  Using Hierarchical EM to Extract Planes from 3D Range Scans , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[13]  Rae-Hong Park,et al.  Robust Adaptive Segmentation of Range Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Martial Hebert,et al.  Scale selection for classification of point-sampled 3D surfaces , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[15]  Benjamin Kuipers,et al.  Building Local Safety Maps for a Wheelchair Robot using Vision and Lasers , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[16]  Charles V. Stewart,et al.  Bias in robust estimation caused by discontinuities and multiple structures , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  R Cataldo Backup systems. , 1994, American pharmacy.

[18]  R. Aufrere,et al.  Multiple sensor fusion for detecting location of curbs, walls, and barriers , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[19]  Michael Brady,et al.  Vision-based Detection of Kerbs and Steps , 1997, BMVC.

[20]  Martin David Adams,et al.  On-line gradient based surface discontinuity detection for outdoor scanning range sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[21]  Helmut Pottmann,et al.  The Isophotic Metric and Its Application to Feature Sensitive Morphology on Surfaces , 2004, ECCV.

[22]  David H. Eberly,et al.  Ridges for image analysis , 1994, Journal of Mathematical Imaging and Vision.

[23]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[24]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[25]  Abbas Rafii,et al.  Object detection and tracking using an optical time-of-flight range camera module for vehicle safety and driver assist applications , 2007 .

[26]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[27]  Charles V. Stewart,et al.  Robust Parameter Estimation in Computer Vision , 1999, SIAM Rev..

[28]  Roberto Manduchi,et al.  Visual curb localization for autonomous navigation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[29]  Wolfram Burgard,et al.  Using EM to Learn 3D Models of Indoor Environments with Mobile Robots , 2001, ICML.

[30]  Martial Hebert,et al.  Robust extraction of multiple structures from non-uniformly sampled data , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[31]  G. Medioni,et al.  Piecewise Planar Modeling for Step Detection using Stereo Vision , 2008 .

[32]  Sing Bing Kang,et al.  Emerging Topics in Computer Vision , 2004 .

[33]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[34]  Gérard G. Medioni,et al.  First order tensor voting, and application to 3-D scale analysis , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[35]  Martin David Adams,et al.  Pose invariant, robust feature extraction from data with a modified scale space approach , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[36]  Martin Adams,et al.  Tracking Naturally Occurring Indoor Features in 2-D and 3-D with Lidar Range/ Amplitude Data , 1998, Int. J. Robotics Res..

[37]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[38]  Peter Meer,et al.  Robust regression for data with multiple structures , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[39]  Kim L. Boyer,et al.  The Robust Sequential Estimator: A General Approach and its Application to Surface Organization in Range Data , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Peter Meer,et al.  ROBUST TECHNIQUES FOR COMPUTER VISION , 2004 .