Coded exposure correction of transverse motion in full-field range imaging

Time-of-flight range imaging systems typically require several raw image frames to produce one range, or depth, image. The problem of motion blur in traditional imaging is compounded in time-of-flight imaging because motion between these raw frames leads to invalid data. The use of the coded exposure and optical flow techniques are investigated together for correcting both motion blur within each frame and errors arising due to changes between frames. Examples of the motion correction in real range measurements are also given, along with comparisons to reference data, which shows a significant improvement over noncorrected output.

[1]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  A. Payne.  Development of a Full-Field Time-of-Flight Range Imaging System , 2008 .

[3]  Sergio N. Torres,et al.  A Quantitative Evaluation of Fixed-Pattern Noise Reduction Methods in Imaging Systems , 2010, CIARP.

[4]  Amit K. Agrawal,et al.  Invertible motion blur in video , 2009, SIGGRAPH 2009.

[5]  Stephan Hussmann,et al.  Real-Time Motion Artifact Suppression in TOF Camera Systems , 2011, IEEE Transactions on Instrumentation and Measurement.

[6]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[7]  W. Weihs,et al.  Movement Artefacts in Range Images of Time-of-Flight Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[8]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[9]  M. Gelautz,et al.  Motion segmentation in videos from time of flight cameras , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[10]  Seungkyu Lee,et al.  Time-of-Flight Depth Camera Motion Blur Detection and Deblurring , 2014, IEEE Signal Processing Letters.

[11]  Stephan Hussmann,et al.  One-Phase Algorithm for Continuous Wave TOF Machine Vision Applications , 2013, IEEE Transactions on Instrumentation and Measurement.

[12]  Bernd Jähne,et al.  Range Flow Estimation , 2002, Comput. Vis. Image Underst..

[13]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .

[14]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[15]  James Lee,et al.  Comparison of variance between correlated samples , 1992, Comput. Appl. Biosci..

[16]  Thomas Schamm,et al.  Fast 3D Time of Flight Data Segmentation Using the U-V-Histogram Approach , 2010, ICIRA.

[17]  F. L. Gadallah,et al.  Destriping multisensor imagery with moment matching , 2000 .

[18]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[19]  Fionn Murtagh,et al.  Deconvolution in Astronomy: A Review , 2002 .

[20]  N. Sloane,et al.  Hadamard transform optics , 1979 .

[21]  James D. K. Kim,et al.  Motion blur-free time-of-flight range sensor , 2012, Electronic Imaging.

[22]  E. Pitman.  A NOTE ON NORMAL CORRELATION , 1939 .

[23]  Hagen Spies,et al.  The Fusion of Image and Range Flow , 2000, Theoretical Foundations of Computer Vision.

[24]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .