Simplification of 3D Graphics for Mobile Devices: Exploring the Trade-off Between Energy Savings and User Perceptions of Visual Quality

Abstract3D graphics have quickly become a popular form of media that can also be accessed with today’s mobile devices. However, the use of 3D applications with mobile devices is typically a very energy-consuming task due to the processing complexity and the large file size of 3D graphics. As a result, their use may lead to rapid depletion of the limited battery life. In this paper, we investigate how much energy savings can be gained in the transmission and rendering of 3D graphics by simplifying geometry data. In this connection, we also examine users’ perceptions on the visual quality of the simplified 3D models. The results of this paper provide new knowledge on the energy savings that can be gained through geometry simplification, as well as on how much the geometry can be simplified before the visual quality of 3D models becomes unacceptable for the mobile users. Based on the results, it can be concluded that geometry simplification can provide significant energy savings for mobile devices without disturbing the users. When geometry simplification is combined with distance based adjustment of detail, up to 52% energy savings were gained in our experiments compared to using only a single high quality 3D model.Graphical Abstract

[1]  Selim Ickin,et al.  Factors influencing quality of experience of commonly used mobile applications , 2012, IEEE Communications Magazine.

[2]  C.-C. Jay Kuo,et al.  Technologies for 3D mesh compression: A survey , 2005, J. Vis. Commun. Image Represent..

[3]  Sarma B. K. Vrudhula,et al.  Battery Modeling for Energy-Aware System Design , 2003, Computer.

[4]  Mansoor Shafi,et al.  Wireless communications in the twenty-first century: a perspective , 1997 .

[5]  George Drettakis,et al.  C‐LOD: Context‐aware Material Level‐of‐Detail applied to Mobile Graphics , 2014, Comput. Graph. Forum.

[6]  Claude Puech,et al.  Quadtrees, octrees, hyperoctrees: a unified analytical approach to tree data structures used in graphics, geometric modeling and image processing , 1985, SCG '85.

[7]  Feng Qian,et al.  A close examination of performance and power characteristics of 4G LTE networks , 2012, MobiSys '12.

[8]  Paulo Trezentos,et al.  Impacts of data interchange formats on energy consumption and performance in smartphones , 2011, OSDOC '11.

[9]  Peter-Pike J. Sloan,et al.  Importance Driven Texture Coordinate Optimization , 1998, Comput. Graph. Forum.

[10]  William Ribarsky,et al.  Legible Simplification of Textured Urban Models , 2008, IEEE Computer Graphics and Applications.

[11]  Timo Koskela,et al.  Optimization Techniques for 3D Graphics Deployment on Mobile Devices , 2015 .

[12]  Bernice E. Rogowitz,et al.  Perceptual issues in substituting texture for geometry , 2000, Electronic Imaging.

[13]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[14]  Bernice E. Rogowitz,et al.  Are image quality metrics adequate to evaluate the quality of geometric objects? , 2001, IS&T/SPIE Electronic Imaging.

[15]  Andrew Willmott,et al.  Rapid simplification of multi-attribute meshes , 2011, HPG '11.

[16]  Marc Alexa,et al.  The POP Buffer: Rapid Progressive Clustering by Geometry Quantization , 2013, Comput. Graph. Forum.

[17]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[18]  Nihal Kularatna,et al.  Rechargeable batteries and their management , 2011, IEEE Instrumentation & Measurement Magazine.

[19]  Manuel Menezes de Oliveira Neto,et al.  Relief mapping of non-height-field surface details , 2006, I3D '06.

[20]  Michael Garland,et al.  Interactive Multiresolution Editing and Display of Large Terrains , 2006, Comput. Graph. Forum.

[21]  Tomas Akenine-Möller,et al.  Performance per What , 2012 .

[22]  S. Kiss.  Book review: Virtual Clothing: Theory and Practice by P. Volino and N. Magnenat-Thalmann, Springer, 2000, ISBN 3-540-67600-7 , 2002 .

[23]  Paolo Fiorini,et al.  Energy autonomous systems : future trends in devices, technology, and systems , 2009 .

[24]  Benjamin Watson,et al.  Measuring and predicting visual fidelity , 2001, SIGGRAPH.

[25]  Samuel S. Silva,et al.  Perceived quality assessment of polygonal meshes using observer studies: a new extended protocol , 2008, Electronic Imaging.

[26]  Jonna Häkkilä,et al.  On the Edge of a Virtual World - Investigating Users' Preferences and Different Visualization Techniques , 2013, AmI.

[27]  Hao Wang,et al.  Geometry and Texture Coupled Generalization of Urban Buildings , 2011, 2011 Workshop on Digital Media and Digital Content Management.

[28]  Matti Siekkinen,et al.  A System-Level Model for Runtime Power Estimation on Mobile Devices , 2010, 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing.

[29]  Zhigang Deng,et al.  Characterizing the Performance and Power Consumption of 3D Mobile Games , 2013, Computer.

[30]  Kirill Dmitriev,et al.  Generating displacement from normal map for use in 3D games , 2011, SIGGRAPH '11.

[31]  A. Venkataramani,et al.  Energy Consumption in Mobile Phones: Measurement, Design Implications, and Algorithms , 2009 .

[32]  Arun Venkataramani,et al.  Energy consumption in mobile phones: a measurement study and implications for network applications , 2009, IMC '09.

[33]  Tolga K. Çapin,et al.  Assessing Visual Quality of 3-D Polygonal Models , 2011, IEEE Signal Processing Magazine.

[34]  Tomas Akenine-Möller,et al.  Optimized View Frustum Culling Algorithms for Bounding Boxes , 2000, J. Graphics, GPU, & Game Tools.

[35]  Tomas Akenine-Möller,et al.  A performance and energy evaluation of many-light rendering algorithms , 2014, The Visual Computer.

[36]  Feng Qian,et al.  An in-depth study of LTE: effect of network protocol and application behavior on performance , 2013, SIGCOMM.

[37]  Mohammad Hosseini,et al.  Energy-aware adaptations in mobile 3d graphics , 2012, ACM Multimedia.

[38]  Jukka K. Nurminen,et al.  Consumer Attitudes Towards Energy Consumption of Mobile Phones and Services , 2010, 2010 IEEE 72nd Vehicular Technology Conference - Fall.

[39]  Timo Koskela,et al.  Effect of 3D Content Simplification on Mobile Device Energy Consumption , 2013, MindTrek.

[40]  Guillaume Lavoué,et al.  Streaming compressed 3D data on the web using JavaScript and WebGL , 2013, Web3D '13.

[41]  Massimiliano Corsini,et al.  A Comparison of Perceptually-Based Metrics for Objective Evaluation of Geometry Processing , 2010, IEEE Transactions on Multimedia.

[42]  魏瑨,et al.  Feature Preserving Mesh Simplification Using Feature Sensitive Metric , 2010 .

[43]  Erik Millán,et al.  Impostors and pseudo-instancing for GPU crowd rendering , 2006, GRAPHITE '06.

[44]  John D. Owens,et al.  Resolution-matched shadow maps , 2007, TOGS.

[45]  Tomas Akenine-Möller,et al.  Measuring Per-Frame Energy Consumption of Real-Time Graphics Applications , 2014 .

[46]  Irene Cheng,et al.  Quality metric for approximating subjective evaluation of 3-D objects , 2005, IEEE Transactions on Multimedia.