Author ' s personal copy Perception-based shape retrieval for 3 D building models

With the help of 3D search engines, a large number of 3D building models can be retrieved freely online. A serious disadvantage of most rotation-insensitive shape descriptors is their inability to distinguish between two 3D building models which are different at their main axes, but appear similar when one of them is rotated. To resolve this problem, we present a novel upright-based normalization method which not only correctly rotates such building models, but also greatly simplifies and accelerates the abstraction and the matching of building models’ shape descriptors. Moreover, the abundance of archi-ion and the matching of building models’ shape descriptors. Moreover, the abundance of architectural styles significantly hinders the effective shape retrieval of building models. Our research has shown that buildings with different designs are not well distinguished by the widely recognized shape descriptors for general 3D models. Motivated by this observation and to further improve the shape retrieval quality, a new building matching method is introduced and analyzed based on concepts found in the field of perception theory and the well-known Light Field descriptor. The resulting normalized building models are first classified using the qualitative shape descriptors of Shell and Unevenness which outline integral geometrical and topological information. These models are then put in on orderly fashion with the help of an improved quantitative shape descriptor which we will term as Horizontal Light Field Descriptor, since it assembles detailed shape characteristics. To accurately evaluate the proposed methodology, an enlarged building shape database which extends previous well-known shape benchmarks was implemented as well as a model retrieval system supporting inputs from 2D sketches and 3D models. Various experimental performance evaluation results have shown that, as compared to previous methods, retrievals employing the proposed matching methodology are faster and more consistent with human recognition of spatial objects. In addition these performance evaluation results have verified that the proposed methodology does not sacrifice the matching accuracy while significantly improves the efficiency when matching 3D building models. 2012 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS) Published by Elsevier B.V. All rights reserved.

[1]  R. Allen Miller,et al.  A database system of mechanical components based on geometric and topological similarity. Part II: indexing, retrieval, matching, and similarity assessment , 2003, Comput. Aided Des..

[2]  Remco C. Veltkamp,et al.  Polyhedral Model Retrieval Using Weighted Point Sets , 2003, Int. J. Image Graph..

[3]  Bill Hillier,et al.  What do we mean by building function , 1984 .

[4]  Marcin Novotni,et al.  3D zernike descriptors for content based shape retrieval , 2003, SM '03.

[5]  Liqiu Meng,et al.  3D Building Generalisation , 2007 .

[6]  Marc Pollefeys,et al.  Fast robust large-scale mapping from video and internet photo collections , 2010 .

[7]  P. Takis Mathiopoulos,et al.  A geometry and texture coupled flexible generalization of urban building models , 2012 .

[8]  Rama Chellappa,et al.  Articulation-Invariant Representation of Non-planar Shapes , 2010, ECCV.

[9]  Daniel A. Keim,et al.  Automatic selection and combination of descriptors for effective 3D similarity search , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[10]  Ali Shokoufandeh,et al.  Scale-space representation of 3D models and topological matching , 2003, SM '03.

[11]  Song Wang,et al.  Two perceptually motivated strategies for shape classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Martin Styner,et al.  Pre-organizing Shape Instances for Landmark-Based Shape Correspondence , 2011, International Journal of Computer Vision.

[13]  Maneesh Agrawala,et al.  Automatic generation of tourist maps , 2008, ACM Trans. Graph..

[14]  Bülent Sankur,et al.  3D Model Retrieval Using Probability Density-Based Shape Descriptors , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jau-Ling Shih,et al.  A 3D model retrieval approach using the interior and exterior 3D shape information , 2009, Multimedia Tools and Applications.

[16]  Thomas A. Funkhouser,et al.  A Comparison of Text and Shape Matching for Retrieval of Online 3 D Models with statistical significance testing , 2022 .

[17]  Dejan V. VraniC An improvement of rotation invariant 3D-shape based on functions on concentric spheres , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[18]  Paul Schrater,et al.  Shape perception reduces activity in human primary visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[20]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[21]  Philip Shilane,et al.  Stratified Point Sampling of 3D Models , 2004, PBG.

[22]  M. Tarr,et al.  Mental rotation and orientation-dependence in shape recognition , 1989, Cognitive Psychology.

[23]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.

[24]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[25]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[26]  Qian-Yi Zhou,et al.  Fast and extensible building modeling from airborne LiDAR data , 2008, GIS '08.

[27]  V. Coors,et al.  AUTOMATIC LANDMARK DETECTION FOR 3 D URBAN MODELS , 2010 .

[28]  D. Cohen-Or,et al.  Upright orientation of man-made objects , 2008, SIGGRAPH 2008.

[29]  Motofumi T. Suzuki A Search Engine for Polygonal Models to Support Development of 3D E-Learning Applications , 2001, WWW Posters.

[30]  Vittorio Castelli,et al.  Image Databases: Search and Retrieval of Digital Imagery , 2002 .

[31]  Atilla Baskurt,et al.  Generalizations of angular radial transform for 2D and 3D shape retrieval , 2005, Pattern Recognit. Lett..

[32]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[33]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[34]  J. Todd Review TRENDS in Cognitive Sciences Vol.8 No.3 March 2004 The visual perception of 3D shape q , 2022 .

[35]  Xiaoou Tang,et al.  2D Shape Matching by Contour Flexibility , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Thomas A. Funkhouser,et al.  A 2D sketch interface for a 3D model search engine , 2002, SIGGRAPH '02.

[37]  Michael Elad,et al.  Content based retrieval of VRML objects: an iterative and interactive approach , 2002 .

[38]  L Chen,et al.  Topological structure in visual perception. , 1982, Science.

[39]  T. Funkhouser,et al.  Shape matching and anisotropy , 2004, SIGGRAPH 2004.

[40]  Dejan V. Vranic,et al.  3D model retrieval , 2004 .

[41]  Daniel A. Keim,et al.  Using entropy impurity for improved 3D object similarity search , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[42]  Ioannis Pratikakis,et al.  Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation , 2007, Pattern Recognit..

[43]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, SIGGRAPH 2004.

[44]  Frank Nielsen,et al.  Shape Retrieval Using Hierarchical Total Bregman Soft Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  R. Allen Miller,et al.  A database system of mechanical components based on geometric and topological similarity. Part I: representation , 2003, Comput. Aided Des..

[46]  Christopher B. Jones,et al.  City model enrichment , 2011 .

[47]  Longin Jan Latecki,et al.  Affinity learning on a tensor product graph with applications to shape and image retrieval , 2011, CVPR 2011.

[48]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[49]  Reinhard Klein,et al.  A geometric approach to 3D object comparison , 2001, Proceedings International Conference on Shape Modeling and Applications.

[50]  Karthik Ramani,et al.  Developing an engineering shape benchmark for CAD models , 2006, Comput. Aided Des..

[51]  Hermilo Sánchez-Cruz,et al.  A method of optimum transformation of 3D objects used as a measure of shape dissimilarity , 2003, Image Vis. Comput..