Optical MEMS devices for compact 3D surface imaging cameras

Implementing 3D surface imaging camera systems into miniaturized devices for a variety of 3D applications such as movement recognition, object sensing, and 3D endoscopy has received great attention over the past decade. Recently, various MEMS techniques enabled the fabrication of key optical elements for 3D surface imaging with compact size, reasonable cost, and high yield. This article will overview the principles of major categories of 3D surface imaging techniques and their applications using optical MEMS devices for compact 3D surface imaging camera.

[1]  R. Raskar,et al.  Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging , 2012, Nature Communications.

[2]  Bohan Lyu,et al.  Infrared structure light projector design for 3D sensing , 2018, Optical Systems Design.

[3]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[4]  Radu Horaud,et al.  Time-of-Flight Cameras: Principles, Methods and Applications , 2012 .

[5]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[6]  O. Barlev,et al.  Multifunctional binary diffractive optical elements for structured light projectors. , 2018, Optics express.

[7]  Min H. Kim,et al.  Electrothermal MEMS parallel plate rotation for single-imager stereoscopic endoscopes. , 2016, Optics express.

[8]  Liang-Chia Chen,et al.  3-D surface profilometry using simultaneous phase-shifting interferometry , 2010 .

[9]  Frank Forster.  A High-Resolution and High Accuracy Real-Time 3D Sensor Based on Structured Light , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[10]  Graham M. Gibson,et al.  A fast 3D reconstruction system with a low-cost camera accessory , 2015, Scientific Reports.

[11]  Robert Schmitt,et al.  Fast and low-cost structured light pattern sequence projection. , 2011, Optics express.

[12]  Sabina Merlo,et al.  Infrared structured light generation by optical MEMS and application to depth perception , 2017, 2017 IEEE International Workshop on Metrology for AeroSpace (MetroAeroSpace).

[13]  Derek Tseng,et al.  Multi-angle lensless digital holography for depth resolved imaging on a chip. , 2010, Optics express.

[14]  Cristiano Niclass,et al.  Design and characterization of a 256 x 64-pixel single-photon imager in CMOS for a MEMS-based laser scanning time-of-flight sensor. , 2012, Optics express.

[15]  Seung-Wan Lee,et al.  Micro-optical system based 3D imaging for full HD depth image capturing , 2012, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[16]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[17]  Mikko Nuutinen,et al.  Method for measuring stereo camera depth accuracy based on stereoscopic vision , 2011, Electronic Imaging.

[18]  Guang-Zhong Yang,et al.  Spectrally encoded fiber-based structured lighting probe for intraoperative 3D imaging , 2011, Biomedical optics express.

[19]  Song Zhang,et al.  Superfast phase-shifting method for 3-D shape measurement. , 2010, Optics express.

[20]  Affan Shaukat,et al.  Towards Camera-LIDAR Fusion-Based Terrain Modelling for Planetary Surfaces: Review and Analysis , 2016, Sensors.

[21]  Georg Schitter,et al.  MEMS-based lidar for autonomous driving , 2018, Elektrotech. Informationstechnik.

[22]  E. Reithmeier,et al.  A 3D measuring endoscope for hand-guided operation , 2018, Measurement Science and Technology.

[23]  K. Jeong,et al.  Variable Structured Illumination Using Lissajous Scanning MEMS Mirror , 2018, 2018 International Conference on Optical MEMS and Nanophotonics (OMN).

[24]  Changhe Zhou,et al.  Binocular vision measurement using Dammann grating. , 2015, Applied optics.

[25]  Xiaoyang Zhang,et al.  Wide-angle structured light with a scanning MEMS mirror in liquid. , 2016, Optics express.

[26]  Jin Wang,et al.  Binocular three-dimensional measurement system using a Dammann grating , 2014, Photonics Asia.

[27]  Song Zhang.  Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .

[28]  Christoph Schmalz,et al.  An endoscopic 3D scanner based on structured light , 2012, Medical Image Anal..

[29]  S. Merlo,et al.  A Silicon Microsystem for Generation of Infrared Patterned Light , 2016, Journal of Display Technology.

[30]  Anssi J. Mäkynen,et al.  Recent advances in dental optics – Part I: 3D intraoral scanners for restorative dentistry , 2014 .

[31]  B. Javidi,et al.  Hexagonal liquid crystal lens array for 3D endoscopy. , 2015, Optics express.

[32]  Radu Horaud,et al.  Time-of-Flight Cameras , 2012, SpringerBriefs in Computer Science.

[33]  Seung-Wan Lee,et al.  Three-dimensional imaging using fast micromachined electro-absorptive shutter , 2013 .

[34]  Jing Xu,et al.  High-accuracy, high-speed 3D structured light imaging techniques and potential applications to intelligent robotics , 2017, International Journal of Intelligent Robotics and Applications.

[35]  Kwang Gi Kim,et al.  Application of Stereo-Imaging Technology to Medical Field , 2012, Healthcare informatics research.

[36]  Bernard Mendiburu.  Chapter 2 – Stereoscopic Vision and 3D Cinematography , 2009 .

[37]  Xu Chen,et al.  Full-field 3D measurement using multi-camera digital image correlation system , 2013 .

[38]  Yong-hwa Park,et al.  A robust design and fabrication of micromachined electro-absorptive optical modulator for 3D imaging , 2014, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[39]  R. Marino,et al.  Jigsaw : A Foliage-Penetrating 3 D Imaging Laser Radar System , 2004 .

[40]  Baiming Guo,et al.  High-efficiency VCSEL arrays for illumination and sensing in consumer applications , 2016, SPIE OPTO.

[41]  K. Jeong,et al.  Compact stereo endoscopic camera using microprism arrays. , 2016, Optics letters.

[42]  B. Javidi,et al.  Dual layer electrode liquid crystal lens for 2D/3D tunable endoscopy imaging system. , 2016, Optics express.