On being the right scale: sizing large collections of 3D models

We address the problem of recovering reliable sizes for a collection of models defined using scales with unknown correspondence to physical units. Our algorithmic approach provides absolute size estimates for 3D models by combining category-based size priors and size observations from 3D scenes. Our approach handles un-observed 3D models without any user intervention. It also scales to large public 3D model databases and is appropriate for handling the open-world problem of rapidly expanding collections of 3D models. We use two datasets from online 3D model repositories to evaluate against both human judgments of size and ground truth physical sizes of 3D models, and find that an algorithmic approach can predict sizes more accurately than people.

[1]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[2]  Pat Hanrahan,et al.  Context-based search for 3D models , 2010, ACM Trans. Graph..

[3]  Kun Zhou,et al.  An interactive approach to semantic modeling of indoor scenes with an RGBD camera , 2012, ACM Trans. Graph..

[4]  Stuart Macdonald,et al.  User Engagement in Research Data Curation , 2009, ECDL.

[5]  Martial Hebert,et al.  Data-Driven Scene Understanding from 3D Models , 2012, BMVC.

[6]  Thomas A. Funkhouser,et al.  A Comparison of Text and Shape Matching for Retrieval of Online 3 D Models with statistical significance testing , 2022 .

[7]  Kun-Peng Wang,et al.  Content-aware model resizing based on surface deformation , 2009, Comput. Graph..

[8]  Antonio Torralba,et al.  Building a database of 3D scenes from user annotations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  J Predebon,et al.  The role of instructions and familiar size in absolute judgments of size and distance. , 1992, Perception & psychophysics.

[10]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[11]  Bernt Schiele,et al.  Revisiting 3D geometric models for accurate object shape and pose , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[12]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[13]  Alexei A. Efros,et al.  Photo clip art , 2007, ACM Trans. Graph..

[14]  Marcin Novotni,et al.  3D zernike descriptors for content based shape retrieval , 2003, SM '03.

[15]  Dan Klein,et al.  Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network , 2003, NAACL.

[16]  Pat Hanrahan,et al.  Example-based synthesis of 3D object arrangements , 2012, ACM Trans. Graph..

[17]  Haim Levkowitz,et al.  Introduction to information retrieval (IR) , 2008 .

[18]  Peter K. Allen,et al.  Autotagging to improve text search for 3d models , 2008, Shape Modeling International.

[19]  SaltonGerard,et al.  Term-weighting approaches in automatic text retrieval , 1988 .

[20]  Daniel Cohen-Or,et al.  Non-homogeneous resizing of complex models , 2008, SIGGRAPH Asia '08.

[21]  Ari Rappoport,et al.  Extraction and Approximation of Numerical Attributes from the Web , 2010, ACL.

[22]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[23]  Ariel Shamir,et al.  Non-homogeneous resizing of complex models , 2008, SIGGRAPH 2008.

[24]  Antonio Torralba,et al.  Building a database of 3D scenes from user annotations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  John Fredebon,et al.  The role of instructions and familiar size in absolute judgments of size and distance , 1992 .

[26]  Trevor Darrell,et al.  Size Matters: Metric Visual Search Constraints from Monocular Metadata , 2010, NIPS.

[27]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[28]  Ming Ouhyoung,et al.  3D Model Search Engine Based on Lightfield Descriptors , 2003, Eurographics.

[29]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[30]  Markus Vincze,et al.  3DNet: Large-scale object class recognition from CAD models , 2012, 2012 IEEE International Conference on Robotics and Automation.