Underwater image enhancement via extended multi-scale Retinex

Underwater exploration has become an active research area over the past few decades. The image enhancement is one of the challenges for those computer vision based underwater researches because of the degradation of the images in the underwater environment. The scattering and absorption are the main causes in the underwater environment to make the images decrease their visibility, for example, blurry, low contrast, and reducing visual ranges. To tackle aforementioned problems, this paper presents a novel method for underwater image enhancement inspired by the Retinex framework, which simulates the human visual system. The term Retinex is created by the combinations of Retina and Cortex. The proposed method, namely LAB-MSR, is achieved by modifying the original Retinex algorithm. It utilizes the combination of the bilateral filter and trilateral filter on the three channels of the image in CIELAB color space according to the characteristics of each channel. With real world data, experiments are carried out to demonstrate both the degradation characteristics of the underwater images in different turbidities, and the competitive performance of the proposed method.

[1]  Zia-ur Rahman,et al.  Feature visibility limits in the nonlinear enhancement of turbid images , 2003, SPIE Defense + Commercial Sensing.

[2]  T. Poggio,et al.  Synthesizing a color algorithm from examples. , 1988, Science.

[3]  Erik Reinhard,et al.  Evaluation of color spaces for edge classification in outdoor scenes , 2005, IEEE International Conference on Image Processing 2005.

[4]  Changshui Zhang,et al.  DeepFish: Accurate underwater live fish recognition with a deep architecture , 2016, Neurocomputing.

[5]  Glenn D. Hines,et al.  A comparison of visual statistics for the image enhancement of FORESITE aerial images with those of major image classes , 2006, SPIE Defense + Commercial Sensing.

[6]  Zuowei Shen,et al.  Data-Driven Multi-scale Non-local Wavelet Frame Construction and Image Recovery , 2014, Journal of Scientific Computing.

[7]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[8]  Hongyu Wang,et al.  Biologically inspired image enhancement based on Retinex , 2016, Neurocomputing.

[9]  Licheng Jiao,et al.  Eye detection under varying illumination using the retinex theory , 2013, Neurocomputing.

[10]  Eric Brassart,et al.  Colour Image Segmentation Using Homogeneity Method and Data Fusion Techniques , 2010, EURASIP J. Adv. Signal Process..

[11]  Jack Tumblin,et al.  The Trilateral Filter for High Contrast Images and Meshes , 2003, Rendering Techniques.

[12]  Takao Onoye,et al.  Halo artifacts reduction method for variational based realtime retinex image enhancement , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[13]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[14]  Haiyong Zheng,et al.  Underwater image sharpness assessment based on selective attenuation of color in the water , 2016, OCEANS 2016 - Shanghai.

[15]  Neetu Sharma,et al.  A Survey on Underwater Image Enhancement Techniques , 2014 .

[16]  Anne E. James,et al.  Enhancing the low quality images using Unsupervised Colour Correction Method , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[17]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[18]  Amelia Carolina Sparavigna,et al.  Retinex filtering of foggy images: generation of a bulk set with selection and ranking , 2015, ArXiv.

[19]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[20]  R.S. Kamathe,et al.  Quantification of retinex in enhancement of weather degraded images , 2008, 2008 International Conference on Audio, Language and Image Processing.

[21]  Yong Xu,et al.  Classifying dynamic textures via spatiotemporal fractal analysis , 2015, Pattern Recognit..

[22]  David J. Kriegman,et al.  Photometric Stereo in a Scattering Medium , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Mark Alan Chancey,et al.  Short Range Underwater Optical Communication Links , 2005 .

[24]  M. H. Supriya,et al.  Underwater image enhancement using single scale retinex on a reconfigurable hardware , 2015, 2015 International Symposium on Ocean Electronics (SYMPOL).

[25]  Alexei A. Efros,et al.  Estimating natural illumination from a single outdoor image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Yoav Y. Schechner,et al.  Clear underwater vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[27]  A Hurlbert,et al.  Formal connections between lightness algorithms. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[28]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[29]  Xiao-Ping Zhang,et al.  A retinex-based enhancing approach for single underwater image , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[30]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[31]  B. L. McGlamery,et al.  A Computer Model For Underwater Camera Systems , 1980, Other Conferences.

[32]  D. Foster,et al.  Relational colour constancy from invariant cone-excitation ratios , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[33]  Jian Wang,et al.  Single underwater image restoration by blue-green channels dehazing and red channel correction , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Chenguang Yang,et al.  Neural-Learning-Based Telerobot Control With Guaranteed Performance , 2017, IEEE Transactions on Cybernetics.

[35]  S. Parthasarathy,et al.  An automated multi Scale Retinex with Color Restoration for image enhancement , 2012, 2012 National Conference on Communications (NCC).

[36]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[37]  S. Palmer.  Vision Science : Photons to Phenomenology , 1999 .

[38]  K. Gegenfurtner,et al.  Cortical mechanisms of colour vision , 2003, Nature Reviews Neuroscience.

[39]  Raimondo Schettini,et al.  Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods , 2010, EURASIP J. Adv. Signal Process..