Computational Phase-Modulated Eyeglasses

We present computational phase-modulated eyeglasses, a see-through optical system that modulates the view of the user using phase-only spatial light modulators (PSLM). A PSLM is a programmable reflective device that can selectively retardate, or delay, the incoming light rays. As a result, a PSLM works as a computational dynamic lens device. We demonstrate our computational phase-modulated eyeglasses with either a single PSLM or dual PSLMs and show that the concept can realize various optical operations including focus correction, bi-focus, image shift, and field of view manipulation, namely optical zoom. Compared to other programmable optics, computational phase-modulated eyeglasses have the advantage in terms of its versatility. In addition, we also presents some prototypical focus-loop applications where the lens is dynamically optimized based on distances of objects observed by a scene camera. We further discuss the implementation, applications but also discuss limitations of the current prototypes and remaining issues that need to be addressed in future research.

[1]  Qiong-Hua Wang,et al.  Zoom lens design using liquid lenses for achromatic and spherical aberration corrected target , 2012 .

[2]  Karol Myszkowski,et al.  Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors , 2017, IEEE Transactions on Visualization and Computer Graphics.

[3]  Shree K. Nayar,et al.  Programmable imaging using a digital micromirror array , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Donald C. Hood,et al.  Sensitivity to Light , 1986 .

[5]  Masatoshi Ishikawa,et al.  High-speed gaze controller for millisecond-order pan/tilt camera , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  Shree K. Nayar,et al.  Focal sweep videography with deformable optics , 2013, IEEE International Conference on Computational Photography (ICCP).

[7]  Wolfgang Heidrich,et al.  Light reallocation for high contrast projection using an analog micromirror array , 2010, ACM Trans. Graph..

[8]  Gordon Wetzstein,et al.  A survey on computational displays: Pushing the boundaries of optics, computation, and perception , 2013, Comput. Graph..

[9]  Gordon Wetzstein,et al.  Autofocals: Evaluating gaze-contingent eyeglasses for presbyopes , 2019, Science Advances.

[10]  Malgorzata Kujawinska,et al.  Phase manipulation and optoelectronic reconstruction of digital holograms by means of LCOS spatial light modulator , 2005, Other Conferences.

[11]  Daisuke Iwai,et al.  Light Attenuation Display: Subtractive See-Through Near-Eye Display via Spatial Color Filtering , 2019, IEEE Transactions on Visualization and Computer Graphics.

[12]  Shree K. Nayar,et al.  Lensless Imaging with a Controllable Aperture , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Shree K. Nayar,et al.  Light field transfer: global illumination between real and synthetic objects , 2008, ACM Trans. Graph..

[14]  Yongtian Wang,et al.  Design of a wide-angle, lightweight head-mounted display using free-form optics tiling. , 2011, Optics letters.

[15]  Josef B. Spjut,et al.  Matching prescription & visual acuity: towards AR for humans , 2019, SIGGRAPH Emerging Technologies.

[16]  Yifan Peng,et al.  The diffractive achromat full spectrum computational imaging with diffractive optics , 2016, ACM Trans. Graph..

[17]  Di Wang,et al.  P‐27: An Optical Zoom Method Based On Spatial Light Modulator , 2016 .

[18]  E Marom,et al.  Phase-only modulation with twisted nematic liquid-crystal spatial light modulators. , 1988, Optics letters.

[19]  Yuta Itoh,et al.  AdaptiVisor: assisting eye adaptation via occlusive optical see-through head-mounted displays , 2017, AH.

[20]  Hanseup Kim,et al.  Adaptive Optics for Autofocusing Eyeglasses , 2017 .

[21]  Gudrun Klinker,et al.  Interaction-free calibration for optical see-through head-mounted displays based on 3D Eye localization , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[22]  Douglas Lanman,et al.  Focal surface displays , 2017, ACM Trans. Graph..

[23]  Andreas Georgiou,et al.  Holographic near-eye displays for virtual and augmented reality , 2017, ACM Trans. Graph..

[24]  Alex D. Hwang,et al.  An Augmented-Reality Edge Enhancement Application for Google Glass , 2014, Optometry and vision science : official publication of the American Academy of Optometry.

[25]  Gordon Wetzstein,et al.  Computational Plenoptic Imaging , 2011, SIGGRAPH '12.

[26]  Shree K. Nayar,et al.  Programmable Aperture Camera Using LCoS , 2010, IPSJ Trans. Comput. Vis. Appl..

[27]  T. Martinez,et al.  Adaptive optical zoom , 2004 .

[28]  Wolfgang Heidrich,et al.  Encoded diffractive optics for full-spectrum computational imaging , 2016, Scientific Reports.

[29]  Shree K. Nayar,et al.  Ieee Transactions on Image Processing Computational Cameras: Convergence of Optics and Processing , 2022 .

[30]  Holger Regenbrecht,et al.  Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[31]  Gudrun Klinker,et al.  Laplacian Vision: Augmenting Motion Prediction via Optical See-Through Head-Mounted Displays , 2016, AH.

[32]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[33]  Ty Martinez,et al.  Wide field-of-view imaging system using a liquid crystal spatial light modulator , 2005, SPIE Optics + Photonics.

[34]  Wei-Yao Hsu,et al.  Optical zoom camera module using two poly-dimethylsiloxane deformable mirrors. , 2014, Applied optics.

[35]  Yasushi Yagi,et al.  High Dynamic Range Camera using Reflective Liquid Crystal , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[36]  N. Collings,et al.  The Applications and Technology of Phase-Only Liquid Crystal on Silicon Devices , 2011, Journal of Display Technology.

[37]  Yi-Hsin Lin,et al.  An electrically tunable optical zoom system using two composite liquid crystal lenses with a large zoom ratio. , 2011, Optics express.

[38]  T. Hebert,et al.  Adaptive optics scanning laser ophthalmoscopy. , 2002, Optics express.

[39]  N. George,et al.  Hybrid diffractive-refractive lenses and achromats. , 1988, Applied optics.

[40]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[41]  Z. You,et al.  Fundamentals of phase-only liquid crystal on silicon (LCOS) devices , 2014, Light: Science & Applications.

[42]  Thad Starner,et al.  A review of head-mounted displays (HMD) technologies and applications for consumer electronics , 2013, Defense, Security, and Sensing.

[43]  Hendrik P. A. Lensch,et al.  A Phase-coded Aperture Camera with Programmable Optics , 2017, Computational Imaging.

[44]  S. Restaino,et al.  Foveated, wide field-of-view imaging system using a liquid crystal spatial light modulator. , 2001, Optics express.

[45]  Holger Regenbrecht,et al.  Real-Time Radiometric Compensation for Optical See-Through Head-Mounted Displays , 2016, IEEE Transactions on Visualization and Computer Graphics.

[46]  Guoqiang Li,et al.  Switchable electro-optic diffractive lens with high efficiency for ophthalmic applications. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Rajesh Menon,et al.  Chromatic-aberration-corrected diffractive lenses for ultra-broadband focusing , 2016, Scientific Reports.

[48]  Henry Fuchs,et al.  FocusAR: Auto-focus Augmented Reality Eyeglasses for both Real World and Virtual Imagery , 2018, IEEE Transactions on Visualization and Computer Graphics.

[49]  Geeyoung Sung,et al.  Optimal synthesis of double-phase computer generated holograms using a phase-only spatial light modulator with grating filter. , 2012, Optics express.

[50]  Anthony Rowe,et al.  Programmable Automotive Headlights , 2014, ECCV.

[51]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[52]  Holger Regenbrecht,et al.  ChromaGlasses: Computational Glasses for Compensating Colour Blindness , 2018, CHI.

[53]  Gudrun Klinker,et al.  Vision enhancement: defocus correction via optical see-through head-mounted displays , 2015, AH.