Human-centric metrics for indoor scene assessment and synthesis

Abstract In recent years, many approaches have been proposed to analyze the affordance of 3D objects and to facilitate the synthesis of aesthetic and realistic indoor scenes. However, how to assess the quality of such synthesized 3D scenes is still a challenging problem. To address this, we present a novel approach through so-called Human-Centric Metrics (HCMs) for quantitatively evaluating the layout quality of certain objects, and thus to facilitate indoor scene synthesis. Our HCMs consider both the human-object factors to assess the functional accessibility of indoor objects, and the human-environment factors to assess the subjective comfort in the scene. Given a 3D scene with arranged furniture objects, our method automatically places human agents and then use HCMs to assess both the object arrangement and indoor environment based on the position/direction of a certain human agent. The conducted user study shows that the assessment capability of HCMs well conforms to the interior design knowledge. We also use the HCMs based assessment results to synthesize 3D indoor scenes by suggesting indoor objects and their layout given an empty room. A series of experimental results and comparisons are presented to validate the usability and effectiveness of our HCMs for virtual scene assessment and synthesis.

[1]  Rui Ma,et al.  Action-driven 3D indoor scene evolution , 2016, ACM Trans. Graph..

[2]  Leonidas J. Guibas,et al.  Shape2Pose , 2014, ACM Trans. Graph..

[3]  Ariel Shamir,et al.  Learning to predict part mobility from a single static snapshot , 2017, ACM Trans. Graph..

[4]  Luc Van Gool,et al.  What makes a chair a chair? , 2011, CVPR 2011.

[5]  Frank Ching Interior Design Illustrated , 1987 .

[6]  Pat Hanrahan,et al.  SceneGrok: inferring action maps in 3D environments , 2014, ACM Trans. Graph..

[7]  Leonidas J. Guibas,et al.  Understanding and Exploiting Object Interaction Landscapes , 2016, ACM Trans. Graph..

[8]  Ligang Liu,et al.  Interaction context (ICON) , 2015, ACM Trans. Graph..

[9]  Ligang Liu,et al.  MIQP‐based Layout Design for Building Interiors , 2018, Comput. Graph. Forum.

[10]  Alvin R. Tilley,et al.  The Measure of Man and Woman: Human Factors in Design , 2001 .

[11]  Richard de Dear,et al.  Workspace satisfaction: The privacy-communication trade-off in open-plan offices - eScholarship , 2013 .

[12]  Matthias Nießner,et al.  PiGraphs , 2016, SIGGRAPH ASIA 2016 Virtual Reality meets Physical Reality: Modelling and Simulating Virtual Humans and Environments.

[13]  Hongbo Fu,et al.  Pose-Inspired Shape Synthesis and Functional Hybrid , 2017, IEEE Transactions on Visualization and Computer Graphics.

[14]  Daniel Cohen-Or,et al.  GRAINS , 2018, ACM Trans. Graph..

[15]  Fei Xu,et al.  Knowledge graph construction with structure and parameter learning for indoor scene design , 2018, Computational Visual Media.

[16]  Chi-Keung Tang,et al.  Make it home: automatic optimization of furniture arrangement , 2011, SIGGRAPH 2011.

[17]  Pat Hanrahan,et al.  Characterizing structural relationships in scenes using graph kernels , 2011, SIGGRAPH 2011.

[18]  Niloy J. Mitra,et al.  Ergonomics-Inspired Reshaping and Exploration of Collections of Models , 2016, IEEE Transactions on Visualization and Computer Graphics.

[19]  Rui Ma,et al.  Organizing heterogeneous scene collections through contextual focal points , 2014, ACM Trans. Graph..

[20]  Qinping Zhao,et al.  Image2Scene: Transforming Style of 3D Room , 2015, ACM Multimedia.

[21]  Alexei A. Efros,et al.  From 3D scene geometry to human workspace , 2011, CVPR 2011.

[22]  Ariel Shamir,et al.  Learning how objects function via co-analysis of interactions , 2016, ACM Trans. Graph..

[23]  Wei Sun,et al.  Autoscanning for coupled scene reconstruction and proactive object analysis , 2015, ACM Trans. Graph..

[24]  Xuejin Chen,et al.  Reconstructing piecewise planar scenes with multi-view regularization , 2019, Computational Visual Media.

[25]  Chenfanfu Jiang,et al.  Human-Centric Indoor Scene Synthesis Using Stochastic Grammar , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Bin Zhou,et al.  Adaptive synthesis of indoor scenes via activity-associated object relation graphs , 2017, ACM Trans. Graph..

[27]  Filippo Speranza,et al.  Stereoscopic 3D-TV: Visual Comfort , 2011, IEEE Transactions on Broadcasting.

[28]  Kun Zhou,et al.  Imagining the unseen , 2014, ACM Trans. Graph..

[29]  S. Hygge,et al.  EFFECTS OF NOISE, HEAT AND INDOOR LIGHTING ON COGNITIVE PERFORMANCE AND SELF-REPORTED AFFECT , 2001 .

[30]  Yingxin Zhu,et al.  A study on the effects of thermal, luminous, and acoustic environments on indoor environmental comfort in offices , 2012 .

[31]  Paul L. Rosin,et al.  Intelligent Visual Media Processing: When Graphics Meets Vision , 2017, Journal of Computer Science and Technology.

[32]  Peter Hall,et al.  A Survey of 3D Indoor Scene Synthesis , 2019, Journal of Computer Science and Technology.

[33]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.

[34]  Ying He,et al.  Automatic Sitting Pose Generation for Ergonomic Ratings of Chairs , 2019, IEEE Transactions on Visualization and Computer Graphics.

[35]  Taehoon Hong,et al.  An integrated psychological response score of the occupants based on their activities and the indoor environmental quality condition changes , 2017 .

[36]  Matthias Nießner,et al.  Activity-centric scene synthesis for functional 3D scene modeling , 2015, ACM Trans. Graph..

[37]  Pat Hanrahan,et al.  Context-based search for 3D models , 2010, SIGGRAPH 2010.

[38]  Niloy J. Mitra,et al.  Creating consistent scene graphs using a probabilistic grammar , 2014, ACM Trans. Graph..

[39]  Angel X. Chang,et al.  Deep convolutional priors for indoor scene synthesis , 2018, ACM Trans. Graph..

[40]  Pat Hanrahan,et al.  Example-based synthesis of 3D object arrangements , 2012, ACM Trans. Graph..

[41]  Daniel Cohen-Or,et al.  Meta-representation of shape families , 2014, ACM Trans. Graph..