Large depth of focus dynamic micro integral imaging for optical see-through augmented reality display using a focus-tunable lens.

We have developed a three-dimensional (3D) dynamic integral-imaging (InIm)-system-based optical see-through augmented reality display with enhanced depth range of a 3D augmented image. A focus-tunable lens is adopted in the 3D display unit to relay the elemental images with various positions to the micro lens array. Based on resolution priority integral imaging, multiple lenslet image planes are generated to enhance the depth range of the 3D image. The depth range is further increased by utilizing both the real and virtual 3D imaging fields. The 3D reconstructed image and the real-world scene are overlaid using an optical see-through display for augmented reality. The proposed system can significantly enhance the depth range of a 3D reconstructed image with high image quality in the micro InIm unit. This approach provides enhanced functionality for augmented information and adjusts the vergence-accommodation conflict of a traditional augmented reality display.

[1]  Masahiro Yamaguchi,et al.  Full-Parallax Holographic Light-Field 3-D Displays and Interactive 3-D Touch , 2017, Proceedings of the IEEE.

[2]  B. Javidi,et al.  Dual layer electrode liquid crystal lens for 2D/3D tunable endoscopy imaging system. , 2016, Optics express.

[3]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[4]  Hong Hua,et al.  An integral‐imaging‐based head‐mounted light field display using a tunable lens and aperture array , 2017 .

[5]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[6]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[7]  Bahram Javidi,et al.  Multiple-Planes Pseudoscopic-to-Orthoscopic Conversion for 3D Integral Imaging Display , 2015 .

[8]  Bahram Javidi,et al.  Augmented Reality 3D Displays With Micro Integral Imaging , 2015, Journal of Display Technology.

[9]  M. Schmid.  Principles Of Optics Electromagnetic Theory Of Propagation Interference And Diffraction Of Light , 2016 .

[10]  C. Burckhardt.  Optimum Parameters and Resolution Limitation of Integral Photography , 1968 .

[11]  Bahram Javidi,et al.  A 3D integral imaging optical see-through head-mounted display. , 2014, Optics express.

[12]  Hong Hua.  Enabling Focus Cues in Head-Mounted Displays , 2017 .

[13]  M McCormick,et al.  Discussion of the optics of a new 3-D imaging system. , 1988, Applied optics.

[14]  Bahram Javidi,et al.  Recent Advances in the Capture and Display of Macroscopic and Microscopic 3-D Scenes by Integral Imaging , 2017, Proceedings of the IEEE.

[15]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[16]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[17]  Bahram Javidi,et al.  Augmented reality three-dimensional object visualization and recognition with axially distributed sensing. , 2016, Optics letters.

[18]  B. Javidi,et al.  Hexagonal liquid crystal lens array for 3D endoscopy. , 2015, Optics express.

[19]  B Javidi,et al.  3D integral imaging display by smart pseudoscopic-to-orthoscopic conversion (SPOC). , 2010, Optics express.

[20]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[21]  Bahram Javidi,et al.  Extended depth-of-focus 3D micro integral imaging display using a bifocal liquid crystal lens. , 2015, Optics letters.

[22]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[23]  B. Javidi,et al.  Effects of device resolution on three-dimensional integral imaging. , 2004, Optics letters.

[24]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[25]  Eisuke Nakasu,et al.  Progress Overview of Capturing Method for Integral 3-D Imaging Displays , 2017, Proceedings of the IEEE.

[26]  Ching-Jen Chen,et al.  Numerical simulation of flow in a screw-type blood pump , 2005, J. Vis..

[27]  N Davies,et al.  Three-dimensional imaging systems: a new development. , 1988, Applied optics.

[28]  M. McCormick,et al.  Analytical model of a three-dimensional integral image recording system that uses circular- and hexagonal-based spherical surface microlenses. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  Makoto Okui,et al.  Integral three-dimensional television with video system using pixel-offset method. , 2013, Optics express.

[30]  Bahram Javidi,et al.  Multifacet structure of observed reconstructed integral images. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[32]  Bahram Javidi,et al.  Dynamic integral imaging display with electrically moving array lenslet technique using liquid crystal lens. , 2015, Optics express.

[33]  Beom-Ryeol Lee,et al.  Holographic and Light-Field Imaging as Future 3-D Displays , 2017, Proceedings of the IEEE.

[34]  Bahram Javidi,et al.  Extended depth-of-field 3D endoscopy with synthetic aperture integral imaging using an electrically tunable focal-length liquid-crystal lens. , 2015, Optics letters.

[35]  Bahram Javidi,et al.  Three-dimensional integral imaging with large depth of focus by use of real and virtual image fields. , 2003, Optics letters.

[36]  Bahram Javidi,et al.  Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics. , 2002, Optics letters.

[37]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.