Efficient and Fast Implementation of Embedded Time-of-Flight Ranging System Based on FPGAs

Time-of-flight cameras perceive depth information about the surrounding environment with an amplitude-modulated near-infrared light source. The distance between the sensor and objects is calculated through measuring the time the light needs to travel. To be used in fast and embedded applications, such as 3-D reconstruction, visual SLAM, human-robot interactions, and object detection, the 3-D imaging must be performed at high frame rates and accuracy. Thus, this paper presents a real-time field programmable gate arrays platform that calculates the phase shift and then the distance. Experimental results shown that the platform can acquire ranging images at the maximum frame rate of 131fps with a fine measurement precision (appropriately 5.1mm range error at 1.2m distance with the proper integration time). Low resource utilization and power consumption of the proposed system make it very suitable for embedded applications.

[1]  Ventseslav Sainov,et al.  3-D Time-Varying Scene Capture Technologies—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Cláudio Rosito Jung,et al.  Multimodal Multi-Channel On-Line Speaker Diarization Using Sensor Fusion Through SVM , 2015, IEEE Transactions on Multimedia.

[3]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[4]  Seungkyu Lee,et al.  Recovering Translucent Objects Using a Single Time-of-Flight Depth Camera , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Dale Anthony Carnegie,et al.  Analysis of Errors in ToF Range Imaging With Dual-Frequency Modulation , 2011, IEEE Transactions on Instrumentation and Measurement.

[6]  Michael Gassner,et al.  SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems , 2017, IEEE Transactions on Robotics.

[7]  Andreas Kolb,et al.  Simulation of Time-of-Flight Sensors for Evaluation of Chip Layout Variants , 2015, IEEE Sensors Journal.

[8]  Remo Sala,et al.  A metrological characterization of the Kinect V2 time-of-flight camera , 2016, Robotics Auton. Syst..

[9]  Dale Anthony Carnegie,et al.  Efficient FPGA implementation of homodyne-based time-of-flight range imaging , 2010, Journal of Real-Time Image Processing.

[10]  Ramesh Raskar,et al.  Signal Processing for Time-of-Flight Imaging Sensors: An introduction to inverse problems in computational 3-D imaging , 2016, IEEE Signal Processing Magazine.

[11]  Seungkyu Lee,et al.  Time-of-Flight Depth Camera Motion Blur Detection and Deblurring , 2014, IEEE Signal Processing Letters.

[12]  Xuelong Li,et al.  Template Deformation-Based 3-D Reconstruction of Full Human Body Scans From Low-Cost Depth Cameras , 2017, IEEE Transactions on Cybernetics.

[13]  Andreas Kolb,et al.  Online improvement of time-of-flight camera accuracy by automatic integration time adaption , 2015, 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[14]  Hilbert J. Kappen,et al.  Efficient Optical Flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone , 2016, IEEE Robotics and Automation Letters.

[15]  Fulvio Rinaudo,et al.  SR-4000 and CamCube3.0 Time of Flight (ToF) Cameras: Tests and Comparison , 2012, Remote. Sens..

[16]  M. Vossiek,et al.  Novel optical distance sensor based on MSM technology , 2004, IEEE Sensors Journal.

[17]  Peter Seitz,et al.  Robust Optical Time-of-Flight Range Imaging Based on Smart Pixel Structures , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[18]  Manoranjan Majji,et al.  A Structured Light System for Relative Navigation Applications , 2016, IEEE Sensors Journal.

[19]  Christian Riess,et al.  A Comparative Error Analysis of Current Time-of-Flight Sensors , 2016, IEEE Transactions on Computational Imaging.

[20]  Ramesh Raskar,et al.  Resolving Multi-path Interference in Time-of-Flight Imaging via Modulation Frequency Diversity and Sparse Regularization , 2014, Optics letters.

[21]  Zhiwei Xiong,et al.  Computational Depth Sensing : Toward high-performance commodity depth cameras , 2017, IEEE Signal Processing Magazine.

[22]  Carme Torras,et al.  Object modeling using a ToF camera under an uncertainty reduction approach , 2010, 2010 IEEE International Conference on Robotics and Automation.

[23]  Kyungmin Kim,et al.  Robust approach to reconstructing transparent objects using a time-of-flight depth camera. , 2017, Optics express.

[24]  In-So Kweon,et al.  Time-of-Flight Sensor Calibration for a Color and Depth Camera Pair , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Kwanghoon Sohn,et al.  Structure Selective Depth Superresolution for RGB-D Cameras , 2016, IEEE Transactions on Image Processing.

[26]  Yunhui Liu,et al.  Real-time implementation of panoramic mosaic camera based on FPGA , 2016, 2016 IEEE International Conference on Real-time Computing and Robotics (RCAR).