eyeSelfie: self directed eye alignment using reciprocal eye box imaging

Eye alignment to the optical system is very critical in many modern devices, such as for biometrics, gaze tracking, head mounted displays, and health. We show alignment in the context of the most difficult challenge: retinal imaging. Alignment in retinal imaging, even conducted by a physician, is very challenging due to precise alignment requirements and lack of direct user eye gaze control. Self-imaging of the retina is nearly impossible. We frame this problem as a user-interface (UI) challenge. We can create a better UI by controlling the eye box of a projected cue. Our key concept is to exploit the reciprocity, "If you see me, I see you", to develop near eye alignment displays. Two technical aspects are critical: a) tightness of the eye box and (b) the eye box discovery comfort. We demonstrate that previous pupil forming display architectures are not adequate to address alignment in depth. We then analyze two ray-based designs to determine efficacious fixation patterns. These ray based displays and a sequence of user steps allow lateral (x, y) and depth (z) wise alignment to deal with image centering and focus. We show a highly portable prototype and demonstrate the effectiveness through a user study.

[1]  Manuel Menezes de Oliveira Neto,et al.  CATRA: interactive measuring and modeling of cataracts , 2011, ACM Trans. Graph..

[2]  Gudrun Klinker,et al.  Light-Field Correction for Spatial Calibration of Optical See-Through Head-Mounted Displays , 2015, IEEE Transactions on Visualization and Computer Graphics.

[3]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[4]  Tae-Sun Choi,et al.  Accurate Registration Using Adaptive Block Processing for Multispectral Images , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Matthew Burton,et al.  A smartphone based ophthalmoscope , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Michael F. Deering,et al.  A photon accurate model of the human eye , 2005, SIGGRAPH '05.

[7]  Arun Ross,et al.  Synthesis of iris images using Markov Random Fields , 2005, 2005 13th European Signal Processing Conference.

[8]  Ramesh Raskar,et al.  Smart phone administered fundus imaging without additional imaging optics , 2014 .

[9]  Dmitry Sokolov,et al.  On Smooth 3D Frame Field Design , 2015, ArXiv.

[10]  Vitor F. Pamplona,et al.  NETRA: interactive display for estimating refractive errors and focal range , 2010 .

[11]  Tae-Sun Choi,et al.  Improving focus measurement via variable window shape on surface radiance distribution for 3D shape reconstruction , 2013 .

[12]  Ashok Veeraraghavan,et al.  mobileVision: A Face-mounted, Voice-activated, Non-mydriatic "Lucky" Ophthalmoscope , 2014, Wireless Health.

[13]  Thad Starner,et al.  A review of head-mounted displays (HMD) technologies and applications for consumer electronics , 2013, Defense, Security, and Sensing.

[14]  Douglas Lanman,et al.  Near-eye light field displays , 2013, SIGGRAPH '13.

[15]  Douglas Lanman,et al.  Pinlight displays: wide field of view augmented reality eyeglasses using defocused point light sources , 2014, SIGGRAPH '14.

[16]  Ramesh Raskar,et al.  Coded time of flight cameras , 2013, ACM Trans. Graph..

[17]  Manuel Menezes de Oliveira Neto,et al.  Photorealistic models for pupil light reflex and iridal pattern deformation , 2009, TOGS.

[18]  C. Keeler 150 years since Babbage's ophthalmoscope. , 1997, Archives of ophthalmology.

[19]  Peter J. Hunter,et al.  A virtual environment and model of the eye for surgical simulation , 1994, SIGGRAPH.

[20]  Marina L. Gavrilova,et al.  Iris synthesis: a reverse subdivision application , 2005, GRAPHITE.

[21]  Woo Chaw Seng,et al.  A review of biometric technology along with trends and prospects , 2014, Pattern Recognit..

[22]  Neil A. Dodgson Analysis of the viewing zone of multiview autostereoscopic displays , 2002, IS&T/SPIE Electronic Imaging.

[23]  Hans-Peter Seidel,et al.  Temporal Glare: Real‐Time Dynamic Simulation of the Scattering in the Human Eye , 2009, Comput. Graph. Forum.

[24]  Tieniu Tan,et al.  An iris image synthesis method based on PCA and super-resolution , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[25]  Anthony M. Tai,et al.  Development of the holographic sight , 1997, Other Conferences.

[26]  Erik Reinhard,et al.  An Ocularist's Approach to Human Iris Synthesis , 2003, IEEE Computer Graphics and Applications.

[27]  Daniel G. Aliaga,et al.  Tailored displays to compensate for visual aberrations , 2012, ACM Trans. Graph..

[28]  Gudrun Klinker,et al.  Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays , 2015, IEEE Transactions on Visualization and Computer Graphics.

[29]  Uwe Schelinski,et al.  MEMS scanner mirror based system for retina scanning and in eye projection , 2015, Photonics West - Optoelectronic Materials and Devices.

[30]  Gordon Wetzstein,et al.  Eyeglasses-free display , 2014, SIGGRAPH 2014.

[31]  Kenneth Tran,et al.  Construction of an inexpensive, hand-held fundus camera through modification of a consumer "point-and-shoot" camera. , 2012, Investigative ophthalmology & visual science.

[32]  Tae-Sun Choi,et al.  Adaptive window selection for 3D shape recovery from image focus , 2013 .

[33]  Gladimir V. G. Baranoski,et al.  A Predictive Light Transport Model for the Human Iris , 2006, Comput. Graph. Forum.