From smartphone to virtual window

This paper presents a prototype of virtual transparency on a hand-held device. The prototype is restricted to such device with no additional material to show that a semblance of virtual transparency can be achieved with today's smartphones and has been designed be as simple as possible to use. The user's head is tracked using the front camera and the eyes co-ordinates are estimated from the head position. The area to be displayed is then computed from the these coordinates, an estimation of the distance head-phone and phone-scene, as well as the phone and lens specifications. It provides a realistic illusion of virtual transparency, not an geometrically accurate render of the scene, and still works in non-optimal situations (non-flat scene).

[1]  Tobias Höllerer,et al.  A hand-held AR magic lens with user-perspective rendering , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[2]  Kostas Karpouzis,et al.  Head pose estimation with one camera, in uncalibrated environments , 2010, EGIHMI '10.

[3]  Ikeda Sei,et al.  Rectification of Real Images for On-Board Camera Tablet-based Augmented Reality , 2013 .

[4]  Blair MacIntyre,et al.  Virtual transparency: Introducing parallax view into video see-through AR , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[5]  Ronald Azuma,et al.  The Challenge of Making Augmented Reality Work Outdoors , 1999 .

[6]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[7]  J. Rolland,et al.  Head-worn displays: a review , 2006, Journal of Display Technology.