Dust Removal with Boundary and Spatial Constraint for Videos Captured in Car

Videos captured in car often suffer from duston the wind screen glass. The dust particles on wind screendecrease the video quality and make them blur. Removingdust and restoring high quality dust-free video is a challengingtask in the field of video stream processing. In this paper, we propose an improved iterative optimization pipeline toremove dust from the videos. Our method employs boundaryconstraint to keep transmission map in a reasonable rangeand use spatial constraint on the transmission map to avoidintroduction of significant halo artifacts into the resultantvideo. With optimized transmission map as an initial condition, our method can separate dust layer and background layer frominput video frames and keeps the background frames beingcolor faithful with fine details. Test results demonstrate thatour proposed method can recover dust-free videos from thedust contaminated input videos and keep the resultant video color faithful.

[1]  Changshui Zhang,et al.  Blindly separating mixtures of multiple layers with spatial shifts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Shree K. Nayar,et al.  Removing image artifacts due to dirty camera lenses and thin occluders , 2009, ACM Trans. Graph..

[3]  Edward H. Adelson,et al.  Separating reflections and lighting using independent components analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Takeo Kanade,et al.  Analysis of Rain and Snow in Frequency Space , 2008, International Journal of Computer Vision.

[5]  Stephen Lin,et al.  Removal of Image Artifacts Due to Sensor Dust , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Y. Weiss,et al.  Separating reflections from a single image using local features , 2004, CVPR 2004.

[7]  Biao Xiong,et al.  Dust and Reflection Removal from Videos Captured in Moving Car , 2016, 2016 IEEE 13th International Conference on e-Business Engineering (ICEBE).

[8]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[9]  Michael S. Brown,et al.  Exploiting Reflection Change for Automatic Reflection Removal , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Anat Levin,et al.  User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior , 2004, ECCV.

[11]  Michael S. Brown,et al.  Single Image Layer Separation Using Relative Smoothness , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Yu-Wing Tai,et al.  A Physically-Based Approach to Reflection Separation: From Physical Modeling to Constrained Optimization , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Frédo Durand,et al.  Reflection removal using ghosting cues , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yoav Y. Schechner,et al.  Blind recovery of transparent and semireflected scenes , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  William T. Freeman,et al.  A computational approach for obstruction-free photography , 2015, ACM Trans. Graph..