A Minimalist Approach to Type-Agnostic Detection of Quadrics in Point Clouds

This paper proposes a segmentation-free, automatic and efficient procedure to detect general geometric quadric forms in point clouds, where clutter and occlusions are inevitable. Our everyday world is dominated by man-made objects which are designed using 3D primitives (such as planes, cones, spheres, cylinders, etc.). These objects are also omnipresent in industrial environments. This gives rise to the possibility of abstracting 3D scenes through primitives, thereby positions these geometric forms as an integral part of perception and high level 3D scene understanding. As opposed to state-of-the-art, where a tailored algorithm treats each primitive type separately, we propose to encapsulate all types in a single robust detection procedure. At the center of our approach lies a closed form 3D quadric fit, operating in both primal & dual spaces and requiring as low as 4 oriented-points. Around this fit, we design a novel, local null-space voting strategy to reduce the 4-point case to 3. Voting is coupled with the famous RANSAC and makes our algorithm orders of magnitude faster than its conventional counterparts. This is the first method capable of performing a generic cross-type multi-object primitive detection in difficult scenes. Results on synthetic and real datasets support the validity of our method.

[1]  Ulrich Neumann,et al.  Pipe-Run Extraction and Reconstruction from Point Clouds , 2014, ECCV.

[2]  Yu Liu Robust segmentation of raw point clouds into consistent surfaces , 2016 .

[3]  Darius Burschka,et al.  An Efficient RANSAC for 3D Object Recognition in Noisy and Occluded Scenes , 2010, ACCV.

[4]  Slobodan Ilic,et al.  Point Pair Features Based Object Detection and Pose Estimation Revisited , 2015, 2015 International Conference on 3D Vision.

[5]  Sébastien Valette,et al.  Sparse Geometric Representation Through Local Shape Probing , 2016, IEEE Transactions on Visualization and Computer Graphics.

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  M. Rosenblatt Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[8]  Dong-Ming Yan,et al.  Variational mesh segmentation via quadric surface fitting , 2012, Comput. Aided Des..

[9]  Luca Di Angelo,et al.  Geometric segmentation of 3D scanned surfaces , 2015, Comput. Aided Des..

[10]  David B. Cooper,et al.  The 3L Algorithm for Fitting Implicit Polynomial Curves and Surfaces to Data , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Kenichi Kanatani,et al.  Further improving geometric fitting , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[12]  Denis Laurendeau,et al.  Extraction of Reliable Primitives from Unorganized Point Clouds , 2015 .

[13]  Sylvain Petitjean,et al.  A survey of methods for recovering quadrics in triangle meshes , 2002, CSUR.

[14]  Yong-Liang Yang,et al.  Fitting quadrics with a Bayesian prior , 2016, Computational Visual Media.

[15]  Andrew Zisserman,et al.  Quadric reconstruction from dual-space geometry , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[16]  Carlo H. Séquin,et al.  Type-Constrained Direct Fitting of Quadric Surfaces , 2014 .

[17]  Markus Ulrich,et al.  Introducing MVTec ITODD — A Dataset for 3D Object Recognition in Industry , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[18]  James R. Miller,et al.  Analysis of quadric-surface-based solid models , 1988, IEEE Computer Graphics and Applications.

[19]  Daniel Cohen-Or,et al.  GlobFit: consistently fitting primitives by discovering global relations , 2011, ACM Trans. Graph..

[20]  Kim L. Boyer,et al.  Robust extraction of planar and quadric surfaces from range images , 2004, ICPR 2004.

[21]  Alessio Del Bue,et al.  Probabilistic Structure from Motion with Objects (PSfMO) , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Valérie Burdin,et al.  Type-Constrained Robust Fitting of Quadrics with Application to the 3D Morphological Characterization of Saddle-Shaped Articular Surfaces , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[23]  David B. Cooper,et al.  Algebraic curves that work better , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[24]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[25]  Jan-Michael Frahm,et al.  RANSAC for (Quasi-)Degenerate data (QDEGSAC) , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  Zesheng Tang,et al.  Representing spheres and ellipsoids using periodic NURBS surfaces with fewer control vertices , 1998, Proceedings Pacific Graphics '98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No.98EX208).

[27]  Ezequiel López-Rubio,et al.  Robust Fitting of Ellipsoids by Separating Interior and Exterior Points During Optimization , 2017, Journal of Mathematical Imaging and Vision.

[28]  Slobodan Ilic,et al.  X-Tag: A Fiducial Tag for Flexible and Accurate Bundle Adjustment , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[29]  Slobodan Ilic,et al.  CAD Priors for Accurate and Flexible Instance Reconstruction , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Markus Vincze,et al.  Geometric data abstraction using B-splines for range image segmentation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[31]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[32]  James Andrews,et al.  User-Guided Inverse 3D Modeling , 2013 .

[33]  O. Egeland,et al.  Object Detection in Point Clouds Using Conformal Geometric Algebra , 2017 .

[34]  Ding Yuan,et al.  3-D point cloud normal estimation based on fitting algebraic spheres , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[35]  Slobodan Ilic,et al.  A point sampling algorithm for 3D matching of irregular geometries , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Rolf Lakaemper,et al.  Real-time 3D scene description using Spheres, Cones and Cylinders , 2016, ArXiv.

[37]  Kaihuai Qin Representing quadric surfaces using NURBS surfaces , 2008, Journal of Computer Science and Technology.

[38]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Gabriel Taubin,et al.  Estimation of Planar Curves, Surfaces, and Nonplanar Space Curves Defined by Implicit Equations with Applications to Edge and Range Image Segmentation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Vladlen Koltun,et al.  A Large Dataset of Object Scans , 2016, ArXiv.

[41]  K. Lingemann,et al.  The 3D Hough Transform for plane detection in point clouds: A review and a new accumulator design , 2011 .

[42]  Dong-Ming Yan,et al.  Quadric Surface Extraction by Variational Shape Approximation , 2006, GMP.

[43]  Slobodan Ilic,et al.  PPFNet: Global Context Aware Local Features for Robust 3D Point Matching , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[44]  Slobodan Ilic,et al.  Local Hough Transform for 3D Primitive Detection , 2015, 2015 International Conference on 3D Vision.

[45]  Ryo Kurazume,et al.  Grasp planning using quadric surface approximation for parallel grippers , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[46]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[47]  Ludovico Minto,et al.  Scene Segmentation Driven by Deep Learning and Surface Fitting , 2016, ECCV Workshops.

[48]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[49]  Markus Ulrich,et al.  Combining Scale-Space and Similarity-Based Aspect Graphs for Fast 3D Object Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Robert Platt,et al.  Localizing Grasp Affordances in 3-D Points Clouds Using Taubin Quadric Fitting , 2013, ArXiv.

[51]  Federico Thomas,et al.  Grasping Unknown Objects in Clutter by Superquadric Representation , 2017, 2018 Second IEEE International Conference on Robotic Computing (IRC).

[52]  Andrew W. Fitzgibbon,et al.  Robust Registration of 2D and 3D Point Sets , 2003, BMVC.

[53]  Markus H. Gross,et al.  Algebraic point set surfaces , 2007, ACM Trans. Graph..

[54]  Andrew W. Fitzgibbon,et al.  Efficient Intersection of Three Quadrics and Applications in Computer Vision , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).