Augmented Reality 3D Displays With Micro Integral Imaging

In this paper, we present a 3D augmented reality micro integral imaging display system by combining conventional integral imaging and an augmented reality technique. Compared with conventional integral imaging, our proposed system has two advantages: 1) it provides 3D augmented reality display capability and 2) it has a compact design. To validate the feasibility of our proposed method, we experimented with a 3D scene and used two computer-generated objects for augmented reality. By combining the captured 2D elemental images of the 3D object and the computer generated virtual objects, we reconstruct 3D images for the augmented reality micro integral imaging display system. To the best of our knowledge, the first report on a video see through 3D augmented reality display has been experimentally demonstrated with a micro integral imaging display system. The proposed 3D system has potential to be applied to the head mounted display system due to its small form factor.

[1]  Myungjin Cho,et al.  Three-Dimensional Optical Sensing and Visualization Using Integral Imaging , 2011, Proceedings of the IEEE.

[2]  M. McCormick,et al.  Analytical model of a three-dimensional integral image recording system that uses circular- and hexagonal-based spherical surface microlenses. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  F. Okano,et al.  Analysis of resolution limitation of integral photography , 1998 .

[4]  Bahram Javidi,et al.  Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics. , 2002, Optics letters.

[5]  Bahram Javidi,et al.  Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing. , 2004, Optics express.

[6]  I. Guyon,et al.  Detecting stable clusters using principal component analysis. , 2003, Methods in molecular biology.

[7]  Herbert E. Ives,et al.  Optical Properties of a Lippmann Lenticulated Sheet , 1931 .

[8]  B Javidi,et al.  3D integral imaging display by smart pseudoscopic-to-orthoscopic conversion (SPOC). , 2010, Optics express.

[9]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[10]  Yongtian Wang,et al.  Design, tolerance, and fabrication of an optical see-through head-mounted display with free-form surface elements. , 2013, Applied optics.

[11]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[12]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[13]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[14]  Byoungho Lee,et al.  Viewing-angle-enhanced integral imaging by lens switching. , 2002, Optics letters.

[15]  C. Burckhardt.  Optimum Parameters and Resolution Limitation of Integral Photography , 1968 .

[16]  Sheng Liu,et al.  Time-multiplexed dual-focal plane head-mounted display with a liquid lens. , 2009, Optics letters.

[17]  M. Kawakita,et al.  Wave optical analysis of integral method for three-dimensional images. , 2007, Optics letters.

[18]  Bahram Javidi,et al.  Progress in 3-D Multiperspective Display by Integral Imaging , 2009, Proceedings of the IEEE.

[19]  Bahram Javidi,et al.  A 3D integral imaging optical see-through head-mounted display. , 2014, Optics express.

[20]  Hong Hua,et al.  A high-resolution optical see-through head-mounted display with eyetracking capability. , 2013, Optics express.

[21]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[22]  Bahram Javidi,et al.  Three-dimensional volumetric object reconstruction using computational integral imaging. , 2004, Optics express.

[23]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[24]  Bahram Javidi,et al.  Analysis of the depth of field of integral imaging displays based on wave optics. , 2013, Optics express.

[25]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[26]  Bahram Javidi,et al.  Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging , 2006, Proceedings of the IEEE.

[27]  Genaro Saavedra,et al.  Depth-of-Field Enhancement in Integral Imaging by Selective Depth-Deconvolution , 2014, Journal of Display Technology.

[28]  M McCormick,et al.  Discussion of the optics of a new 3-D imaging system. , 1988, Applied optics.

[29]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[30]  B. Javidi,et al.  Integral imaging with large depth of field using an asymmetric phase mask. , 2007, Optics express.