Novel Descattering Approach for Stereo Vision in Dense Suspended Scatterer Environments

In this paper, we propose a model-based scattering removal method for stereo vision for robot manipulation in indoor scattering media where the commonly used ranging sensors are unable to work. Stereo vision is an inherently ill-posed and challenging problem. It is even more difficult in the case of images of dense fog or dense steam scenes illuminated by active light sources. Images taken in such environments suffer attenuation of object radiance and scattering of the active light sources. To solve this problem, we first derive the imaging model for images taken in a dense scattering medium with a single active illumination close to the cameras. Based on this physical model, the non-uniform backscattering signal is efficiently removed. The descattered images are then utilized as the input images of stereo vision. The performance of the method is evaluated based on the quality of the depth map from stereo vision. We also demonstrate the effectiveness of the proposed method by carrying out the real robot manipulation task.

[1]  Shahriar Negahdaripour,et al.  Improved Stereo Matching in Scattering Media by Incorporating a Backscatter Cue , 2014, IEEE Transactions on Image Processing.

[2]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[3]  Fabio Bruno,et al.  A Comparative Analysis between Active and Passive Techniques for Underwater 3D Reconstruction of Close-Range Objects , 2013, Sensors.

[4]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[5]  Andreas Geiger,et al.  Simultaneous underwater visibility assessment, enhancement and improved stereo , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[8]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[9]  Margrit Gelautz,et al.  Local stereo matching using geodesic support weights , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[10]  Dah-Jye Lee,et al.  Review of stereo vision algorithms and their suitability for resource-limited systems , 2013, Journal of Real-Time Image Processing.

[11]  Danping Zou,et al.  Simultaneous video defogging and stereo reconstruction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  P. Roberts,et al.  Backscattering target detection in a turbid medium by polarization discrimination. , 1999, Applied optics.

[13]  G. Gilbert,et al.  Improvement of underwater visibility by reduction of backscatter with a circular polarization technique. , 1967, Applied optics.

[14]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Andrew Blake,et al.  Efficient Dense Stereo with Occlusions for New View-Synthesis by Four-State Dynamic Programming , 2006, International Journal of Computer Vision.

[16]  Yoav Y. Schechner,et al.  Instant 3Descatter , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Michael S. Brown,et al.  Nighttime Haze Removal with Glow and Multiple Light Colors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Reinhard Männer,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2004, International Journal of Computer Vision.

[20]  Christian Bräuer-Burchardt,et al.  Underwater 3D Surface Measurement Using Fringe Projection Based Scanning Devices , 2015, Sensors.

[21]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[22]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[23]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[24]  Sergiu Nedevschi,et al.  Exponential Contrast Restoration in Fog Conditions for Driving Assistance , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.

[27]  Yoav Y Schechner,et al.  Polarization-based vision through haze. , 2008, Applied optics.

[28]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[29]  Yoav Y. Schechner,et al.  Active Polarization Descattering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Shukai Chi,et al.  A Laser Line Auto-Scanning System for Underwater 3D Reconstruction , 2016, Sensors.

[31]  Seung-Won Jung,et al.  A review on dark channel prior based image dehazing algorithms , 2016, EURASIP Journal on Image and Video Processing.

[32]  Brian Y. Lattimer,et al.  Evaluation of Navigation Sensors in Fire Smoke Environments , 2014 .

[33]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[34]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[35]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[36]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Gabriel Oliver,et al.  Optical Sensors and Methods for Underwater 3D Reconstruction , 2015, Sensors.

[38]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[39]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[40]  In-So Kweon,et al.  Specular Reflection Separation Using Dark Channel Prior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Tamaki Ura,et al.  Generation of High‐resolution Three‐dimensional Reconstructions of the Seafloor in Color using a Single Camera and Structured Light , 2017, J. Field Robotics.

[42]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[43]  G.C. Giakos Active backscattered optical polarimetric imaging of scattered targets , 2004, Proceedings of the 21st IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.04CH37510).

[44]  Jing Zhang,et al.  Nighttime haze removal based on a new imaging model , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[45]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[47]  Bo Sun,et al.  Structured light in scattering media , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[48]  Jean-Philippe Tarel,et al.  Combining Stereo and Atmospheric Veil Depth Cues for 3D Reconstruction , 2014, IPSJ Trans. Comput. Vis. Appl..

[49]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..