Micro-optical system based 3D imaging for full HD depth image capturing

20 Mega-Hertz-switching high speed image shutter device for 3D image capturing and its application to system prototype are presented. For 3D image capturing, the system utilizes Time-of-Flight (TOF) principle by means of 20MHz high-speed micro-optical image modulator, so called 'optical shutter'. The high speed image modulation is obtained using the electro-optic operation of the multi-layer stacked structure having diffractive mirrors and optical resonance cavity which maximizes the magnitude of optical modulation. The optical shutter device is specially designed and fabricated realizing low resistance-capacitance cell structures having small RC-time constant. The optical shutter is positioned in front of a standard high resolution CMOS image sensor and modulates the IR image reflected from the object to capture a depth image. Suggested novel optical shutter device enables capturing of a full HD depth image with depth accuracy of mm-scale, which is the largest depth image resolution among the-state-of-the-arts, which have been limited up to VGA. The 3D camera prototype realizes color/depth concurrent sensing optical architecture to capture 14Mp color and full HD depth images, simultaneously. The resulting high definition color/depth image and its capturing device have crucial impact on 3D business eco-system in IT industry especially as 3D image sensing means in the fields of 3D camera, gesture recognition, user interface, and 3D display. This paper presents MEMS-based optical shutter design, fabrication, characterization, 3D camera system prototype and image test results.

[1]  Michael Lehmann,et al.  An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (SwissRanger) , 2004, SPIE Optical Systems Design.

[2]  Minoru Tanaka,et al.  High-speed depth-mapping axi-vision camera with compact optical system , 2008, Electronic Imaging.

[3]  Takefumi Namiki,et al.  An optical modulator , 2001 .

[4]  Peter Seitz,et al.  The lock-in CCD-two-dimensional synchronous detection of light , 1995 .

[5]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[6]  Hilmar Ingensand,et al.  Calibration and improvements of the high-resolution range-imaging camera SwissRanger , 2005 .

[7]  Keith W. Goossen,et al.  Electroabsorption in ultranarrow‐barrier GaAs/AlGaAs multiple quantum well modulators , 1994 .

[8]  Yuko Yamanouchi,et al.  High-definition real-time depth-mapping TV camera: HDTV Axi-Vision Camera. , 2004, Optics express.

[9]  Takeo Kanade,et al.  CCD-based range-finding sensor , 1997 .

[10]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[11]  Michael Richter,et al.  Novel pixel architecture with inherent background suppression for 3D time-of-flight imaging , 2005 .

[12]  M. Cree,et al.  Achieving sub-millimetre precision with a solid-state full-field heterodyning range imaging camera , 2007 .

[13]  M Kawakita,et al.  Axi-vision camera (real-time distance-mapping camera). , 2000, Applied optics.

[14]  Peter Seitz,et al.  Demonstration of a novel drift field pixel structure for the demodulation of modulated light waves with application in three-dimensional image capture , 2004, IS&T/SPIE Electronic Imaging.

[15]  G. Fowles,et al.  Introduction to modern optics , 1968 .