A novel night vision image color fusion method based on scene recognition

Infrared and low light level image color fusion can make target detection and recognition more precise. Different from the existing color transfer fusion method using fixed reference image, this paper presents a color fusion method based on a combination of scene classification, fusion quality measure and color transfer. We introduce the scene classification method into the color fusion algorithm, which is based on the Gist descriptor and SVM classifier. Afterwards we use the proposed color fusion quality measure structure to find out the best matched reference image for each classified input image. Meanwhile, we get the high quality color fusion image using color transfer method. This method is verified in both linear and non-linear color space. Results show that this method can effectively improve the color fusion effect. More importantly, it can be used in the condition with few prior information.

[1]  Yin Song.  COLOR CONTRAST ENHANCEMENT METHOD TO IMPROVE TARGET DETECTABILITY IN NIGHT VISION FUSION , 2009 .

[2]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[3]  Roland Baddeley,et al.  The Correlational Structure of Natural Images and the Calibration of Spatial Representations , 1997, Cogn. Sci..

[4]  Yiannis Kompatsiaris,et al.  Proceedings of the ACM International Conference on Image and Video Retrieval , 2009, CIVR 2009.

[5]  Joel Lanir,et al.  Comparing Multispectral Image Fusion Methods for a Target Detection Task , 2006, 2006 9th International Conference on Information Fusion.

[6]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[7]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[8]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .

[9]  Vassilis Tsagaris,et al.  Multispectral image fusion for improved RGB representation based on perceptual attributes , 2005 .

[10]  Allen M. Waxman,et al.  Fusion of multi-sensor imagery for night vision: color visualization, target learning and search , 2000, Proceedings of the Third International Conference on Information Fusion.

[11]  Svetlana Lazebnik,et al.  Scene recognition and weakly supervised object localization with deformable part-based models , 2011, 2011 International Conference on Computer Vision.

[12]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[13]  Yufeng Zheng,et al.  A local-coloring method for night-vision colorization utilizing image analysis and fusion , 2008, Inf. Fusion.

[14]  Weiqi Jin,et al.  Color fusion algorithm for visible and infrared images based on color transfer in YUV color space , 2007, International Symposium on Multispectral Image Processing and Pattern Recognition.

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Cordelia Schmid,et al.  Evaluation of GIST descriptors for web-scale image search , 2009, CIVR '09.

[17]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[18]  Stanley R. Rotman,et al.  Comparing multispectral image fusion methods for a target detection task , 2007 .

[19]  W. Kong,et al.  Fusion technique for grey-scale visible light and infrared images based on non-subsampled contourlet transform and intensity-hue-saturation transform , 2011 .

[20]  GeversTheo,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010 .

[21]  Xiuqiong Zhang,et al.  A Novel Quality Metric for Image Fusion Based on Color and Structural Similarity , 2009, 2009 International Conference on Signal Processing Systems.

[22]  Xiuqing Wu,et al.  A novel similarity based quality metric for image fusion , 2008, 2008 International Conference on Audio, Language and Image Processing.

[23]  Iqbal Gondal,et al.  A novel color image fusion QoS measure for multi-sensor night vision applications , 2010, The IEEE symposium on Computers and Communications.

[24]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[25]  Antonio Torralba,et al.  Recognizing indoor scenes , 2009, CVPR.

[26]  Qiaofeng Tan,et al.  COLOR CONTRAST ENHANCEMENT METHOD TO IMPROVE TARGET DETECTABILITY IN NIGHT VISION FUSION: COLOR CONTRAST ENHANCEMENT METHOD TO IMPROVE TARGET DETECTABILITY IN NIGHT VISION FUSION , 2009 .

[27]  Jason Lepley,et al.  Detection of buried mines and explosive objects using dual-band thermal imagery , 2011, Defense + Commercial Sensing.

[28]  Sabine Süsstrunk,et al.  Measuring colorfulness in natural images , 2003, IS&T/SPIE Electronic Imaging.

[29]  Nikolay N. Ponomarenko,et al.  Color image database for evaluation of image quality metrics , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[30]  Frederick E. Petry,et al.  Scene recognition using genetic algorithms with semantic nets , 1990, Pattern Recognit. Lett..

[31]  Chi-Fang Lin,et al.  Approach to maximize increased details and minimize color distortion for IKONOS and QuickBird image fusion , 2004 .

[32]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  M. Hogervorst,et al.  Progress in color night vision , 2012 .