Time‐of‐Flight Cameras in Computer Graphics

A growing number of applications depend on accurate and fast 3D scene analysis. Examples are model and lightfield acquisition, collision prevention, mixed reality and gesture recognition. The estimation of a range map by image analysis or laser scan techniques is still a time‐consuming and expensive part of such systems.

[1]  Reinhard Koch,et al.  Calibration of focal length and 3D pose based on the reflectance and depth image of a planar object , 2008, Int. J. Intell. Syst. Technol. Appl..

[2]  Ruigang Yang,et al.  Fusion of time-of-flight depth and stereo for high accuracy depth maps , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Sebastian Thrun,et al.  High-quality scanning using time-of-flight depth superresolution , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Thomas Martinetz,et al.  A facial feature tracker for human-computer interaction based on 3D Time-Of-Flight cameras , 2008, Int. J. Intell. Syst. Technol. Appl..

[5]  D. Falie,et al.  Noise Characteristics of 3D Time-of-Flight Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[6]  Thomas Martinetz,et al.  Guiding Eye Movements for Better Communication and Augmented Vision , 2006, PIT.

[7]  Joachim Hornegger,et al.  Robust real-time 3D time-of-flight based gesture navigation , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[8]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[9]  Wolfgang Straßer,et al.  On-the-fly scene acquisition with a handy multi-sensor system , 2008, Int. J. Intell. Syst. Technol. Appl..

[10]  Stefan May,et al.  Calibration and registration for precise surface reconstruction with Time-Of-Flight cameras , 2008, Int. J. Intell. Syst. Technol. Appl..

[11]  V. Peters,et al.  A Simulation Framework for Time-Of-Flight Sensors , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[12]  Joachim Hornegger,et al.  3-D gesture-based scene navigation in medical imaging applications using Time-of-Flight cameras , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Andreas Kolb,et al.  Real-time simulation of time-of-flight sensors , 2009, Simul. Model. Pract. Theory.

[14]  G. Yahav,et al.  3D Imaging Camera for Gaming Application , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[15]  Thomas Martinetz,et al.  Scale-invariant range features for time-of-flight camera applications , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[16]  Bernd Jähne,et al.  Range Flow Estimation , 2002, Comput. Vis. Image Underst..

[17]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .

[18]  Jörg Krüger,et al.  Incident light related distance error study and calibration of the PMD-range imaging camera , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[19]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[20]  Reinhard Koch,et al.  Pose Estimation and Map Building with a PMD-Camera for Robot Navigation , 2007 .

[21]  Andreas Kolb,et al.  Lateral and Depth Calibration of PMD-Distance Sensors , 2006, ISVC.

[22]  Martin Otmar Schmidt,et al.  Spatiotemporal Analysis of Range Imagery , 2008 .

[23]  Behzad Dariush,et al.  Controlled human pose estimation from depth image streams , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[24]  A. Kolb,et al.  Raycasting of Light Field Galleries from Volumetric Data , 2008, Comput. Graph. Forum.

[25]  Gerd Hirzinger,et al.  Extrinsic and depth calibration of ToF-cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Young Min Kim,et al.  Design and calibration of a multi-view TOF sensor fusion system , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[27]  Otmar Loffeld,et al.  Real Time Hand Based Robot Control Using 2D/3D Images , 2008, ISVC.

[28]  Reinhard Koch,et al.  A Combined Approach for Estimating Patchlets from PMD Depth Images and Stereo Intensity Images , 2007, DAGM-Symposium.

[29]  Joachim Hornegger,et al.  Time-of-flight sensor for respiratory motion gating. , 2008, Medical physics.

[30]  D. Falie.  3D image correction for time of flight (ToF) cameras , 2009, International Conference on Optical Instruments and Technology.

[31]  Rasmus Larsen,et al.  Fusion of stereo vision and Time-Of-Flight imaging for improved 3D estimation , 2008, Int. J. Intell. Syst. Technol. Appl..

[32]  Andreas Kolb,et al.  Sub-pixel data fusion and edge-enhanced distance refinement for 2D/3D images , 2008, Int. J. Intell. Syst. Technol. Appl..

[33]  E. Barth,et al.  Geometric Invariants for Facial Feature Tracking with 3D TOF Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[34]  Reinhard Koch,et al.  Supporting Structure from Motion with a 3D-Range-Camera , 2007, SCIA.

[35]  Li Guan,et al.  3D Object Reconstruction with Heterogeneous Sensor Data , 2008 .

[36]  Andreas Kolb,et al.  Calibration of the intensity-related distance error of the PMD TOF-camera , 2007, SPIE Optics East.

[37]  Thomas Martinetz,et al.  A facial feature tracker for human-computer interaction based on 3D TOF cameras , 2009 .

[38]  Joachim Hornegger,et al.  Robust real-time 3D respiratory motion detection using time-of-flight cameras , 2008, International Journal of Computer Assisted Radiology and Surgery.

[39]  D. Falie,et al.  Respiratory motion visualization and the sleep apnea diagnosis with the time of flight (ToF) camera , 2008 .

[40]  Reinhard Koch,et al.  ToF-sensors: New dimensions for realism and interactivity , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[41]  Klaus-Dieter Kuhnert,et al.  Fusion of Stereo-Camera and PMD-Camera Data for Real-Time Suited Precise 3D Environment Reconstruction , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Roberto Manduchi,et al.  Robust curb and ramp detection for safe parking using the Canesta TOF camera , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[43]  Tsuhan Chen,et al.  A survey on image-based rendering - representation, sampling and compression , 2004, Signal Process. Image Commun..

[44]  Ruigang Yang,et al.  Spatial-Depth Super Resolution for Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Andreas Kolb,et al.  Spherical light field rendering in application for analysis by synthesis , 2008, Int. J. Intell. Syst. Technol. Appl..

[46]  Agnes Swadzba,et al.  Tracking objects in 6D for reconstructing static scenes , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[47]  S. E. Ghobadi,et al.  Hand Segmentation Using 2D/3D Images , 2007 .

[48]  Timo Schairer,et al.  Robust non-local denoising of colored depth data , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[49]  Rasmus Larsen,et al.  Cluster tracking with Time-of-Flight cameras , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[50]  Kazunori Ohno,et al.  Real-Time Robot Trajectory Estimation and 3D Map Construction using 3D Camera , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Thomas Martinetz,et al.  Shading constraint improves accuracy of time-of-flight measurements , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[52]  Ryan Crabb,et al.  Real-time foreground segmentation via range and color imaging , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[53]  Thomas B. Moeslund,et al.  View invariant gesture recognition using the CSEM SwissRanger SR-2 camera , 2008, Int. J. Intell. Syst. Technol. Appl..

[54]  Joachim Hornegger,et al.  Standardization of intensity-values acquired by Time-of-Flight-cameras , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[55]  Stephan D. Weiss,et al.  Calibration of time-of-flight range imaging cameras , 2008, 2008 15th IEEE International Conference on Image Processing.

[56]  Reinhard Koch,et al.  Robust GPU-assisted camera tracking using free-form surface models , 2007, Journal of Real-Time Image Processing.

[57]  Roland Siegwart,et al.  A state-of-the-art 3D sensor for robot navigation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[58]  Roland Siegwart,et al.  A state-of-the-art 3D sensor for robot navigation , 2004 .

[59]  R. Koch,et al.  CALIBRATION OF A PMD-CAMERA USING A PLANAR CALIBRATION PATTERN TOGETHER WITH A MULTI-CAMERA SETUP , 2008 .

[60]  Thomas B. Moeslund,et al.  Fusion of range and intensity information for view invariant gesture recognition , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[61]  G. Becker,et al.  Vehicle occupancy monitoring with optical range-sensors , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[62]  David J. Ward,et al.  Artificial intelligence: Fast hands-free writing by gaze direction , 2002, Nature.

[63]  G. A. Thomas,et al.  A versatile camera position measurement system for virtual reality TV production , 1997 .

[64]  Til Aach,et al.  Analysis of Superimposed Oriented Patterns , 2006, IEEE Transactions on Image Processing.

[65]  Reinhard Koch,et al.  Pose estimation and map building with a Time-Of-Flight-camera for robot navigation , 2008, Int. J. Intell. Syst. Technol. Appl..

[66]  Andreas Kolb,et al.  GPU‐Based Spherical Light Field Rendering with Per‐Fragment Depth Correction , 2008, Comput. Graph. Forum.

[67]  Jürgen Valldorf,et al.  Fast Fusion of Range and Video Sensor Data , 2007 .

[68]  Stefan May,et al.  3D time-of-flight cameras for mobile robotics , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[69]  Jens T. Thielemann,et al.  Pipeline landmark detection for autonomous robot navigation using time-of-flight imagery , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[70]  Edoardo Charbon,et al.  A Virtual Keyboard Based on True-3D Optical Ranging , 2005, BMVC.

[71]  John G. Fryer,et al.  Applications of 3D Measurements from Images , 2007 .

[72]  Liu Wei.  A Survey of Image-Based Rendering , 2009 .

[73]  K. Hartmann,et al.  Data-Fusion of PMD-Based Distance-Information and High-Resolution RGB-Images , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[74]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[75]  Jörg Krüger,et al.  Improving the Data Quality of PMD-based 3D Cameras , 2007, VMV.

[76]  Andreas Birk,et al.  Sub-pixel depth accuracy with a time of flight sensor using multimodal Gaussian analysis , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[77]  Pushmeet Kohli,et al.  Simultaneous Segmentation and Pose Estimation of Humans Using Dynamic Graph Cuts , 2008, International Journal of Computer Vision.

[78]  Reinhard Koch,et al.  Extraction of 3D freeform surfaces as visual landmarks for real-time tracking , 2007, Journal of Real-Time Image Processing.

[79]  Rasmus Larsen,et al.  Analyzing Gait Using a Time-of-Flight Camera , 2009, SCIA.

[80]  Björn E. Ottersten,et al.  Application of the Reeb Graph Technique to Vehicle Occupant's Head Detection in Low-resolution Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[81]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[82]  David J. Ward,et al.  Fast Hands-free Writing by Gaze Direction , 2002, ArXiv.

[83]  Reinhard Koch,et al.  Integration of a Time-of-Flight Camera into a Mixed Reality System for Handling Dynamic Scenes, Moving Viewpoints and Occlusions in Real-Time , 2008 .

[84]  Jan Fischer,et al.  Using time-of-flight range data for occlusion handling in augmented reality , 2007, EGVE'07.

[85]  Sebastian Thrun,et al.  An Application of Markov Random Fields to Range Sensing , 2005, NIPS.

[86]  B. Huhle,et al.  Self-Localization in Scanned 3DTV Sets , 2007, 2007 3DTV Conference.

[87]  D. Falie,et al.  Measurements with ToF Cameras and Their Necessary Corrections , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[88]  Andreas Kolb,et al.  New insights into the calibration of ToF-sensors , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[89]  Heinz Hügli,et al.  Optimized scattering compensation for time-of-flight camera , 2007, SPIE Optics East.

[90]  Holger H. Rapp,et al.  Experimental and Theoretical Investigation of Correlating TOF-Camera Systems , 2007 .

[91]  Joachim Hornegger,et al.  Time-of-Flight sensor for patient positioning , 2009, Medical Imaging.

[92]  Craig A. Grimes,et al.  Encyclopedia of Sensors , 2006 .

[93]  D.W. Hansen,et al.  Improving Face Detection with TOF Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[94]  Sunil Acharya,et al.  System design of time-of-flight range camera for car park assist and backup application , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[95]  Rasmus Larsen,et al.  TOF imaging in Smart room environments towards improved people tracking , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[96]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[97]  Reinhard Koch,et al.  Increasing Realism and Supporting Content Planning for Dynamic Scenes in a Mixed Reality System incorporating a Time-of-Flight Camera , 2010, J. Virtual Real. Broadcast..

[98]  H. Aanaes,et al.  Environmental Effects on Measurement Uncertainties of Time-of-Flight Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[99]  D. Falie,et al.  Distance errors correction for the Time of Flight (ToF) cameras , 2008, 2008 IEEE International Workshop on Imaging Systems and Techniques.

[100]  Jens T. Thielemann,et al.  Modelling and compensating measurement errors caused by scattering in time-of-flight cameras , 2008, Optical Engineering + Applications.

[101]  Thomas Martinetz,et al.  Deictic Gestures with a Time-of-Flight Camera , 2009, Gesture Workshop.

[102]  Fabio Remondino,et al.  Range imaging technology: new developments and applications for people identification and tracking , 2007, Electronic Imaging.

[103]  Eyal Ofek,et al.  Depth keying , 2003, IS&T/SPIE Electronic Imaging.