Color image fusion method using the multi-scale retinex and directional support value transform

Completely different from many exiting multi-source image fusion methods, a novel color image fusion method for a single original color image, combining the multi-scale Retinex (MSR) with directional support value transform (DSVT), is presented in this paper. The applied MSR is an (centre/surround-based) Retinex algorithm and the directional support value transform, an anisotropic and multi-scale transform, is deduced under the weighted mapping least squares support vector machine (LS-SVM) framework. Using the MSR to an original color image, an enhanced color image, producing more detail information hidden in shadow areas of original color image but easily lapsing into color distortion, is obtained. In the HSV color space, the good color information of original color image and more detail information of enhanced color image are integrated into a fused color image based on the DSVT. Series of color images under different environment are chosen for color image fusion experiments and the performance of DSVT is compared with other methods also used in color image fusion, including Laplacian pyramid, discrete wavelet transform and support value transform. The experimental results demonstrate that: the proposed color image fusion approach is effectively making the fused color images not only present more clearly detail information but also maintain color fidelity; DSVT is superior to other three methods used in color image fusion.

[1]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[2]  Martin Kraus,et al.  Pyramid Methods in GPU-Based Image Processing , 2011 .

[3]  Xiao Zhi-ji Removing Shadows from Urban Aerial Images Based on Fuzzy Retinex , 2005 .

[4]  Li Xu,et al.  Shadow Removal from a Single Image , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[5]  Sheng Zheng,et al.  Mapped least squares support vector machine regression , 2005, Int. J. Pattern Recognit. Artif. Intell..

[6]  Bangjun Lei,et al.  X-ray image denoising with directional support value transform , 2009, International Symposium on Multispectral Image Processing and Pattern Recognition.

[7]  Chengyi Xiong,et al.  Novel algorithm for image interpolation , 2004 .

[8]  C. Munteanu,et al.  Color image enhancement using evolutionary principles and the Retinex theory of color constancy , 2001, Neural Networks for Signal Processing XI: Proceedings of the 2001 IEEE Signal Processing Society Workshop (IEEE Cat. No.01TH8584).

[9]  Jiandong Tian,et al.  Retinex theory-based shadow detection and removal in single outdoor image , 2009, Ind. Robot.

[10]  Mark S. Drew,et al.  Removing Shadows From Images using Retinex , 2002, CIC.

[11]  Sheng Zheng,et al.  Different focuses image fusion with directional support value transform , 2009, 2009 International Conference on Machine Learning and Cybernetics.

[12]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[13]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[14]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[15]  Jian Liu,et al.  An efficient star acquisition method based on SVM with mixtures of kernels , 2005, Pattern Recognit. Lett..

[16]  Wenzhong Shi,et al.  Remote Sensing Image Fusion Using Multiscale Mapped LS-SVM , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  Wenzhong Shi,et al.  Multisource Image Fusion Method Using Support Value Transform , 2007, IEEE Transactions on Image Processing.

[19]  Jian Liu,et al.  A new efficient SVM-based edge detection method , 2004, Pattern Recognit. Lett..

[20]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[21]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[22]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[23]  Katsushi Ikeuchi,et al.  Illumination normalization with time-dependent intrinsic images for video surveillance , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..