Robust procedural model fitting with a new geometric similarity estimator

Abstract Procedural model fitting (PMF) is a generalization of classical model fitting and has numerous applications for computer vision and computer graphics. The task of PMF is to search a geometric model set for the model that is most similar to a set of data points. We propose a strict and robust similarity estimator for PMF to handle imperfect data. The proposed estimator is based on the error from model to data, while most other estimators are based on the error from data to model. We then use the proposed estimator to guide the cuckoo search algorithm to search for the most similar model. To accelerate the search process, we also propose a coarse-to-fine model dividing strategy to early reject dissimilar models. In this paper, the proposed PMF method is applied to fit building models on laser scanning data. It is also applied to fit character models on eighteen variants of imperfect MNIST data to achieve few-shot pattern recognition. In the 5-shot recognition, our method outperforms the state-of-the-art method on thirteen variants of the imperfect data. In particular, for one of the data corrupted by grid lines, our method obtains a high accuracy of 65%, whereas the state-of-the-art method only obtains an accuracy of 30%.

[1]  Hans-Peter Seidel,et al.  ShapeGenetics: Using Genetic Algorithms for Procedural Modeling , 2017, Comput. Graph. Forum.

[2]  Victor S. Lempitsky,et al.  Global Optimization for Shape Fitting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Subhransu Maji,et al.  CSGNet: Neural Shape Parser for Constructive Solid Geometry , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Luc Van Gool,et al.  Is There a Procedural Logic to Architecture? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Yuri Boykov,et al.  Energy-Based Geometric Multi-model Fitting , 2012, International Journal of Computer Vision.

[6]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[7]  陈宝权 GlobFit: Consistently Fitting Primitives by Discovering Global Relations , 2011 .

[8]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[9]  Kuo-Liang Chung,et al.  Efficient sampling strategy and refinement strategy for randomized circle detection , 2012, Pattern Recognit..

[10]  Jibin Zhao,et al.  A hybrid method for ellipse detection in industrial images , 2017, Pattern Recognit..

[11]  Leif Kobbelt,et al.  Robust reconstruction of watertight 3D models from non-uniformly sampled point clouds without normal information , 2006, SGP '06.

[12]  H. Seidel,et al.  Multi-level partition of unity implicits , 2003 .

[13]  Jinglu Tan,et al.  Detection of incomplete ellipse in images with strong noise by iterative randomized Hough transform (IRHT) , 2008, Pattern Recognit..

[14]  Daniel G. Aliaga,et al.  Inverse design of urban procedural models , 2012, ACM Trans. Graph..

[15]  Huu Le,et al.  An Exact Penalty Method for Locally Convergent Maximum Consensus , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Abdul Nurunnabi,et al.  Robust statistical approaches for circle fitting in laser scanning three-dimensional point cloud data , 2018, Pattern Recognit..

[17]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[18]  Marc Pollefeys,et al.  Semantic3D.net: A new Large-scale Point Cloud Classification Benchmark , 2017, ArXiv.

[19]  Björn Stenger,et al.  Demisting the Hough Transform for 3D Shape Recognition and Registration , 2014, International Journal of Computer Vision.

[20]  Iasonas Kokkinos,et al.  Parsing Facades with Shape Grammars and Reinforcement Learning , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Tat-Jun Chin,et al.  Mode seeking over permutations for rapid geometric model fitting , 2013, Pattern Recognit..

[22]  Thi-Lan Le,et al.  Acquiring qualified samples for RANSAC using geometrical constraints , 2018, Pattern Recognit. Lett..

[23]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010 .

[24]  Bhaskara Marthi,et al.  A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs , 2017, Science.

[25]  Hans-Peter Seidel,et al.  Multi-level partition of unity implicits , 2005, SIGGRAPH Courses.

[26]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[27]  P. J. Huber Robust Estimation of a Location Parameter , 1964 .

[28]  Abdul Nurunnabi,et al.  Outlier detection and robust normal-curvature estimation in mobile laser scanning 3D point cloud data , 2015, Pattern Recognit..

[29]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[30]  Luiz Velho,et al.  Hough Transform for real-time plane detection in depth images , 2018, Pattern Recognit. Lett..

[31]  David Suter,et al.  Hypergraph Modelling for Geometric Model Fitting , 2016, Pattern Recognit..

[32]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[33]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[34]  Gang Wang,et al.  Gaussian field consensus: A robust nonparametric matching method for outlier rejection , 2018, Pattern Recognit..

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[36]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[37]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[38]  Manuel Menezes de Oliveira Neto,et al.  Real-time detection of planar regions in unorganized point clouds , 2015, Pattern Recognit..

[39]  Pat Hanrahan,et al.  Controlling procedural modeling programs with stochastically-ordered sequential Monte Carlo , 2015, ACM Trans. Graph..

[40]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[41]  Bidyut Baran Chaudhuri,et al.  A survey of Hough Transform , 2015, Pattern Recognit..

[42]  D. Cohen-Or,et al.  Curve skeleton extraction from incomplete point cloud , 2009, SIGGRAPH 2009.

[43]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[44]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[45]  Zhenwei Cao,et al.  Robust Model Fitting Using Higher Than Minimal Subset Sampling , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Shang-Hong Lai,et al.  A consensus sampling technique for fast and robust model fitting , 2009, Pattern Recognit..

[47]  Radomír Mech,et al.  Inverse Procedural Modelling of Trees , 2014, Comput. Graph. Forum.

[48]  Joshua B. Tenenbaum,et al.  Picture: A probabilistic programming language for scene perception , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[50]  Rafael Bidarra,et al.  A Survey on Procedural Modelling for Virtual Worlds , 2014, Comput. Graph. Forum.

[51]  Pierre Alliez,et al.  A Survey of Surface Reconstruction from Point Clouds , 2017, Comput. Graph. Forum.

[52]  Luc Van Gool,et al.  Bayesian Grammar Learning for Inverse Procedural Modeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Armando Solar-Lezama,et al.  Sampling for Bayesian Program Learning , 2016, NIPS.

[54]  H. Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, SIGGRAPH 2010.

[55]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[56]  Jun Wang,et al.  Shape Detection from Raw LiDAR Data with Subspace Modeling , 2017, IEEE Transactions on Visualization and Computer Graphics.

[57]  Kuo-Liang Chung,et al.  An Efficient Randomized Algorithm for Detecting Circles , 2001, Comput. Vis. Image Underst..

[58]  Yan Yan,et al.  Searching for Representative Modes on Hypergraphs for Robust Geometric Model Fitting , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[60]  Bok-Suk Shin,et al.  Closed form line-segment extraction using the Hough transform , 2015, Pattern Recognit..

[61]  Marc Alexa,et al.  Computing and Rendering Point Set Surfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[62]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[63]  Andrei Sharf,et al.  Grammar-based 3D facade segmentation and reconstruction , 2012, Comput. Graph..

[64]  Hugues Hoppe Surface Reconstruction from Unorganized Points (PhD Thesis) , 1994 .

[65]  Daniel G. Aliaga,et al.  Interactive sketching of urban procedural models , 2016, ACM Trans. Graph..

[66]  Manuel Menezes de Oliveira Neto,et al.  Real-time line detection through an improved Hough transform voting scheme , 2008, Pattern Recognit..

[67]  Zhi-Qiang Liu,et al.  A robust, real-time ellipse detector , 2005, Pattern Recognit..

[68]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[69]  Adrian E. Raftery,et al.  Accurate and efficient curve detection in images: the importance sampling Hough transform , 2002, Pattern Recognit..

[70]  Peter H. N. de With,et al.  Sparse-plus-dense-RANSAC for estimation of multiple complex curvilinear models in 2D and 3D , 2013, Pattern Recognit..

[71]  N. Mitra,et al.  GlobFit: consistently fitting primitives by discovering global relations , 2011, SIGGRAPH 2011.

[72]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, SIGGRAPH 2006.

[73]  Nikos Paragios,et al.  Learning Grammars for Architecture-Specific Facade Parsing , 2016, International Journal of Computer Vision.

[74]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[76]  Andrés Iglesias,et al.  Cuckoo search with Lévy flights for reconstruction of outline curves of computer fonts with rational Bézier curves , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[77]  Yonina C. Eldar,et al.  A probabilistic Hough transform , 1991, Pattern Recognit..