Robust approach to reconstructing transparent objects using a time-of-flight depth camera.

This study presents a robust approach to reconstructing a three dimensional (3-D) translucent object using a single time-of-flight depth camera with simple user marks. Because the appearance of translucent objects depends on the light interaction with the surrounding environment, the measurement using depth cameras is considerably biased or invalid. Although several existing methods attempt to model the depth error of translucent objects, their model remains partial because of object assumptions and its sensitivity to noise. In this study, we introduce a ground plane and piece-wise linear surface model as priors and construct a robust 3-D reconstruction framework for translucent objects. These two depth priors are combined with the depth error model built on the time-of-flight principle. Extensive evaluation of various real data reveals that the proposed method substantially improves the accuracy and reliability of 3-D reconstruction for translucent objects.

[1]  Sehoon Ha,et al.  Iterative Training of Dynamic Skills Inspired by Human Coaching Techniques , 2014, ACM Trans. Graph..

[2]  Ramesh Raskar,et al.  Resolving Multipath Interference in Kinect: An Inverse Problem Approach , 2014, IEEE Sensors Journal.

[3]  R. Raskar,et al.  Modeling "wiggling" as a multi-path interference problem in AMCW ToF imaging. , 2015, Optics express.

[4]  Wilfried Philips,et al.  Fuzzy logic-based approach to wavelet denoising of 3D images produced by time-of-flight cameras. , 2010, Optics express.

[5]  Seungkyu Lee,et al.  Skewed stereo time-of-flight camera for translucent object imaging , 2015, Image Vis. Comput..

[6]  Andreas Kolb,et al.  Kinect range sensing: Structured-light versus Time-of-Flight Kinect , 2015, Comput. Vis. Image Underst..

[7]  Ramesh Raskar,et al.  Resolving Multi-path Interference in Time-of-Flight Imaging via Modulation Frequency Diversity and Sparse Regularization , 2014, Optics letters.

[8]  Manuel Mazo,et al.  Modeling and correction of multipath interference in time of flight cameras , 2014, Image Vis. Comput..

[9]  MOHIT GUPTA,et al.  Phasor Imaging , 2015, ACM Trans. Graph..

[10]  Seungkyu Lee,et al.  Hybrid exposure for depth imaging of a time-of-flight depth sensor. , 2014, Optics express.

[11]  Frank Lenzen,et al.  Model based scattering correction in time-of-flight cameras. , 2014, Optics express.

[12]  Ramesh Raskar,et al.  Coded time of flight cameras , 2013, ACM Trans. Graph..

[13]  Seungkyu Lee,et al.  Recovering Translucent Objects Using a Single Time-of-Flight Depth Camera , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.