Building hierarchical structures for 3D scenes with repeated elements

We propose a novel hierarchy construction algorithm for 3D scenes with repeated elements, such as classrooms with multiple desk–chair pairs. Most existing algorithms focus on scenes such as bedrooms or living rooms, which rarely contain repeated patterns. Consequently, such methods may not recognize repeated patterns, which are vital for understanding the structure and context of scenes such as classrooms. Therefore, we propose a new global optimization algorithm for recognizing repeated patterns and building hierarchical structures based on repeated patterns. First, we find a repeated template by calculating the coverage ratios and frequencies of many substructures in a scene. Once the repeated template has been determined, a minimum cost maximum flow problem can be solved to find all instances (repetitions) of it in the scene and then group objects accordingly. Second, we group objects in the region outside the repeated elements according to their adjacency. Finally, based on these two sets of results, we build the hierarchy of the entire scene. We test this hierarchy construction algorithm on the Princeton and SceneNN databases and show that our algorithm can correctly find repeated patterns and construct a hierarchy that is more similar to the ground truth than the results of previous methods.

[1]  Shi-Min Hu,et al.  ImageAdmixture: Putting Together Dissimilar Objects from Groups , 2012, IEEE Transactions on Visualization and Computer Graphics.

[2]  Taku Komura,et al.  Indexing 3D Scenes Using the Interaction Bisector Surface , 2014, ACM Trans. Graph..

[3]  Philip Dutré,et al.  On the use of local ray termination for efficiently constructing qualitative BSPs, BIHs and (S)BVHs , 2018, The Visual Computer.

[4]  Yanxi Liu,et al.  A computational model for periodic pattern perception based on frieze and wallpaper groups , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Siddhartha Chaudhuri,et al.  A probabilistic model for component-based shape synthesis , 2012, ACM Trans. Graph..

[6]  Ralph R. Martin,et al.  Segmenting Periodic Reliefs on Triangle Meshes , 2007, IMA Conference on the Mathematics of Surfaces.

[7]  Taku Komura,et al.  Relationship templates for creating scene variations , 2016, ACM Trans. Graph..

[8]  Niloy J. Mitra,et al.  Creating consistent scene graphs using a probabilistic grammar , 2014, ACM Trans. Graph..

[9]  Jun Li,et al.  Symmetry Hierarchy of Man‐Made Objects , 2011, Comput. Graph. Forum.

[10]  H. Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, ACM Trans. Graph..

[11]  Daniel Cohen-Or,et al.  Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering , 2011, ACM Trans. Graph..

[12]  Ligang Liu,et al.  Interaction context (ICON) , 2015, ACM Trans. Graph..

[13]  Hua Huang,et al.  RepSnapping: Efficient Image Cutout for Repeated Scene Elements , 2011, Comput. Graph. Forum.

[14]  Jochen Lang,et al.  Evaluation of Colour Image Segmentation Hierarchies , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[15]  Nicolas Mellado,et al.  MCGraph: multi-criterion representation for scene understanding , 2014, SIGGRAPH ASIA Indoor Scene Understanding Where Graphics Meets Vision.

[16]  Rui Ma,et al.  Topology-varying 3D shape creation via structural blending , 2014, ACM Trans. Graph..

[17]  Duc Thanh Nguyen,et al.  A Robust 3D-2D Interactive Tool for Scene Segmentation and Annotation , 2016, IEEE Transactions on Visualization and Computer Graphics.

[18]  Pat Hanrahan,et al.  Characterizing structural relationships in scenes using graph kernels , 2011, ACM Trans. Graph..

[19]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[20]  Silvia Biasotti,et al.  3D Scene Comparison using Topological Graphs , 2007, Eurographics Italian Chapter Conference.

[21]  Miguel Ángel García,et al.  Generating compact representations of static scenes by means of 3D object hierarchies , 2006, The Visual Computer.

[22]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, ACM Trans. Graph..

[23]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[24]  Narendra Ahuja,et al.  Extracting Texels in 2.1D Natural Textures , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Daniel Cohen-Or,et al.  Structure-aware shape processing , 2013, Eurographics.

[26]  Ronald L. Rivest,et al.  Introduction to Algorithms, third edition , 2009 .

[27]  Leonidas J. Guibas,et al.  GRASS: Generative Recursive Autoencoders for Shape Structures , 2017, ACM Trans. Graph..

[28]  Thomas A. Funkhouser,et al.  Consistent segmentation of 3D models , 2009, Comput. Graph..

[29]  Rui Ma,et al.  Organizing heterogeneous scene collections through contextual focal points , 2014, ACM Trans. Graph..