A Framework for Interactive 3D Rendering on Mobile Devices

Although mobile devices have now become an important computing platform, however most of them still lack hardware accelerated graphics. Therefore, interactive 3D rendering on these devices is a difficult task. This paper describes different approaches for 3D rendering on mobile devices and the associated challenges. It then investigates different solutions to resolve these problems and proposes a framework that uses Image Based Rendering (IBR) technique to render interactive 3D graphics on mobile devices. Further, the performance of proposed framework is compared with Geometry Based Rendering (GBR). The experimental results show that the proposed framework performs better than the geometry-based techniques in terms of rendering time, visual quality and memory requirements. The results also show that the rendering time of the proposed framework is independent of the scene complexity. The experiments are performed in Java Platform Micro Edition (JavaME) environment with Sun JavaME Phone emulator.

[1]  Jürgen Döllner,et al.  Server-based rendering of large 3D scenes for mobile devices using G-buffer cube maps , 2012, Web3D '12.

[2]  Roseli A. F. Romero,et al.  Computer Vision for Learning to Interact Socially with Humans , 2013 .

[3]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[4]  Daniel G. Aliaga,et al.  MMR: an interactive massive model rendering system using geometric and image-based acceleration , 1999, SI3D.

[5]  Ekta Walia,et al.  3D RENDERING - TECHNIQUES AND CHALLENGES , 2010 .

[6]  Vilas M. Thakare,et al.  TECHNICAL ANALYSIS OF REMOTE 3D VISUALIZATION ON MOBILE DEVICES , 2011 .

[7]  Anselmo Lastra,et al.  LDI tree: a hierarchical representation for image-based rendering , 1999, SIGGRAPH.

[8]  Hoi-Jun Yoo,et al.  A programmable vertex shader with fixed-point SIMD datapath for low power wireless applications , 2004, Graphics Hardware.

[9]  Neveen I. Ghali,et al.  An Improved Hashing Function for Human Authentication System: Near Set Approach , 2013, Int. J. Comput. Vis. Image Process..

[10]  José Luis Rojo-Álvarez,et al.  Kernel Methods in Bioengineering, Signal And Image Processing , 2007 .

[11]  Lee-Sup Kim,et al.  A 186-Mvertices/s 161-mW Floating-Point Vertex Processor With Optimized Datapath and Vertex Caches , 2009, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[12]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[13]  Mahantapas Kundu,et al.  Human Face Recognition using Gabor based Kernel Entropy Component Analysis , 2012, Int. J. Comput. Vis. Image Process..

[14]  HENRI GOURAUD,et al.  Continuous Shading of Curved Surfaces , 1971, IEEE Transactions on Computers.

[15]  Ekta Walia,et al.  A Computationally Efficient Framework for 3D Warping Technique , 2012 .

[16]  Jose Garcia-Rodriguez,et al.  Robotic Vision: Technologies for Machine Learning and Vision Applications , 2013 .

[17]  Chun-Fa Chang,et al.  Enhancing 3D Graphics on Mobile Devices by Image-Based Rendering , 2002, IEEE Pacific Rim Conference on Multimedia.

[18]  Tae-Sun Choi,et al.  Depth Map and 3D Imaging Applications: Algorithms and Technologies , 2011 .

[19]  Tae-Sun Choi,et al.  Image Focus Measure Based on Energy of High Frequency Components in S-Transform , 2013 .

[20]  Muhammad Hussain,et al.  Ensemble Classifier for Benign-Malignant Mass Classification , 2013, Int. J. Comput. Vis. Image Process..

[21]  Sud Sudirman,et al.  Analysis of the Performance of Eigenfaces Technique in Recognizing Non-Caucasian Faces , 2012, Int. J. Comput. Vis. Image Process..

[22]  Luca Chittaro,et al.  Rendering of X3D content on mobile devices with OpenGL ES , 2006, Web3D '06.

[23]  Paul Bao,et al.  A framework for remote rendering of 3-D scenes on limited mobile devices , 2006, IEEE Transactions on Multimedia.

[24]  Sang-Heon Lee,et al.  Fusion on Citrus Image Data from Cold Mirror Acquisition System , 2012, Int. J. Comput. Vis. Image Process..

[25]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[26]  Preeti Ranjan Panda,et al.  Adaptive Partitioning of Vertex Shader for Low Power High Performance Geometry Engine , 2009, ISVC.

[27]  K.S. Banerjee,et al.  Remote execution for 3D graphics on mobile devices , 2005, 2005 International Conference on Wireless Networks, Communications and Mobile Computing.

[28]  Chandan Singh,et al.  Fast Hybrid Shading: an Application of Finite Element Methods in 3d Rendering , 2005, Int. J. Image Graph..

[29]  Andrea Sanna,et al.  A 3D Multiresolution rendering engine for PDA devices , 2003 .

[30]  Donald P. Greenberg,et al.  An Efficient Radiosity Approach for Realistic Image Synthesis , 1986, IEEE Computer Graphics and Applications.

[31]  Ammar Bouallègue,et al.  Chase-Like Decoding of Arithmetic Codes with Applications , 2011, Int. J. Comput. Vis. Image Process..

[32]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[33]  Klara Nahrstedt,et al.  Real-time remote rendering of 3D video for mobile devices , 2009, MM '09.

[34]  Klara Nahrstedt,et al.  Real-time parallel remote rendering for mobile devices using graphics processing units , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[35]  William R. Mark,et al.  Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping , 1999 .

[36]  Ekta Walia,et al.  Shading By Fast Bi-Quadratic Normal Vector Interpolation , 2005 .

[37]  Narendra Kumar Kamila.  Handbook of Research on Emerging Perspectives in Intelligent Pattern Recognition, Analysis, and Image Processing , 2015 .

[38]  Ezzeddine Zagrouba,et al.  A Robust Embedding Scheme and an Efficient Evaluation Protocol for 3D Meshes Watermarking , 2011, Int. J. Comput. Vis. Image Process..

[39]  Francesca Odone,et al.  Image Classification and Retrieval with Kernel Methods , 2007 .

[40]  Paul Kwan,et al.  Fuzzy Image Segmentation for Mass Detection in Digital Mammography: Recent Advances and Techniques , 2012 .

[41]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[42]  Allam Mousa,et al.  Augmented Small-Scale Database to Improve the Performance of Eigenface Recognition Technique , 2012, Int. J. Comput. Vis. Image Process..