A Mobile Augmented Reality System For Illumination Consistency With Fisheye Camera Based On Client-Server Model

This paper proposes a client-server based mobile augmented reality system for illumination consistency between the virtual objects and the real world. The server system adopts a fisheye camera to capture real world illumination and transmits the light source information to the client system, while the client system uses the received information to render the virtual objects in the augmented reality application. The proposed method possesses the virtue of reducing the calculation cost of the clients, which is especially important for mobile devices. An evaluation method of AR image's illumination consistency has also been proposed based on analyzing the distance of the histogram of virtual and real parts of AR image with different channels.

[1]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Martin Knecht,et al.  Differential Instant Radiosity for mixed reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[4]  Sylvain Paris,et al.  Learning photographic global tonal adjustment with a database of input / output image pairs , 2011, CVPR 2011.

[5]  Julie Dorsey,et al.  Understanding and improving the realism of image composites , 2012, ACM Trans. Graph..

[6]  Paul E. Debevec,et al.  A median cut algorithm for light probe sampling , 2005, SIGGRAPH Courses.

[7]  David A. Forsyth,et al.  Rendering synthetic objects into legacy photographs , 2011, ACM Trans. Graph..

[8]  Erik Reinhard,et al.  On Visual Realism of Synthesized Imagery , 2013, Proceedings of the IEEE.

[9]  Hannes Kaufmann,et al.  High-quality reflections, refractions, and caustics in Augmented Reality and their contribution to visual coherence , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[10]  Dieter Schmalstieg,et al.  Real-time photometric registration from arbitrary geometry , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).