ToF-sensors: New dimensions for realism and interactivity

A growing number of applications depend on accurate and fast 3D scene analysis. Examples are object recognition, collision prevention, 3D modeling, mixed reality, and gesture recognition. The estimation of a range map by image analysis or laser scan techniques is still a time- consuming and expensive part of such systems. A lower-priced, fast and robust alternative for distance measurements are time-of-flight (ToF) cameras. Recently, significant improvements have been made in order to achieve low-cost and compact ToF-devices, that have the potential to revolutionize many fields of research, including computer vision, computer graphics and human computer interaction (HCI). These technologies are starting to have an impact on research and commercial applications. The upcoming generation of ToF sensors, however, will be even more powerful and will have the potential to become "ubiquitous geometry devices" for gaming, web-conferencing, and numerous other applications. This paper will give an account of some recent developments in ToF-technology and will discuss applications of this technology for vision, graphics, and HCI.

[1]  D.W. Hansen,et al.  Improving Face Detection with TOF Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[2]  D. Falie,et al.  Measurements with ToF Cameras and Their Necessary Corrections , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[3]  Andreas Kolb,et al.  Spherical light field rendering in application for analysis by synthesis , 2008, Int. J. Intell. Syst. Technol. Appl..

[4]  Rasmus Larsen,et al.  Fusion of stereo vision and Time-Of-Flight imaging for improved 3D estimation , 2008, Int. J. Intell. Syst. Technol. Appl..

[5]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[6]  E. Barth,et al.  Geometric Invariants for Facial Feature Tracking with 3D TOF Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[7]  Reinhard Koch,et al.  Calibration of focal length and 3D pose based on the reflectance and depth image of a planar object , 2008, Int. J. Intell. Syst. Technol. Appl..

[8]  Thomas Martinetz,et al.  A facial feature tracker for human-computer interaction based on 3D TOF cameras , 2009 .

[9]  G. Yahav,et al.  3D Imaging Camera for Gaming Application , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[10]  D. Falie,et al.  Noise Characteristics of 3D Time-of-Flight Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[11]  Reinhard Koch,et al.  Pose Estimation and Map Building with a PMD-Camera for Robot Navigation , 2007 .

[12]  Andreas Kolb,et al.  Calibration of the intensity-related distance error of the PMD TOF-camera , 2007, SPIE Optics East.

[13]  Fabio Remondino,et al.  Range imaging technology: new developments and applications for people identification and tracking , 2007, Electronic Imaging.

[14]  Reinhard Koch,et al.  Supporting Structure from Motion with a 3D-Range-Camera , 2007, SCIA.

[15]  Andreas Kolb,et al.  Lateral and Depth Calibration of PMD-Distance Sensors , 2006, ISVC.

[16]  Klaus-Dieter Kuhnert,et al.  Fusion of Stereo-Camera and PMD-Camera Data for Real-Time Suited Precise 3D Environment Reconstruction , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Reinhard Koch,et al.  Extraction of 3D freeform surfaces as visual landmarks for real-time tracking , 2007, Journal of Real-Time Image Processing.

[18]  Reinhard Koch,et al.  A Combined Approach for Estimating Patchlets from PMD Depth Images and Stereo Intensity Images , 2007, DAGM-Symposium.

[19]  Wolfgang Straßer,et al.  On-the-fly scene acquisition with a handy multi-sensor system , 2008, Int. J. Intell. Syst. Technol. Appl..

[20]  H. Aanaes,et al.  Environmental Effects on Measurement Uncertainties of Time-of-Flight Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[21]  B. Huhle,et al.  Self-Localization in Scanned 3DTV Sets , 2007, 2007 3DTV Conference.

[22]  K. Hartmann,et al.  Data-Fusion of PMD-Based Distance-Information and High-Resolution RGB-Images , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[23]  Reinhard Koch,et al.  Robust GPU-assisted camera tracking using free-form surface models , 2007, Journal of Real-Time Image Processing.

[24]  Andreas Kolb,et al.  GPU‐Based Spherical Light Field Rendering with Per‐Fragment Depth Correction , 2008, Comput. Graph. Forum.

[25]  Thomas B. Moeslund,et al.  View invariant gesture recognition using the CSEM SwissRanger SR-2 camera , 2008, Int. J. Intell. Syst. Technol. Appl..

[26]  Andreas Kolb,et al.  Sub-pixel data fusion and edge-enhanced distance refinement for 2D/3D images , 2008, Int. J. Intell. Syst. Technol. Appl..

[27]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .