Saliency Fusion in Eigenvector Space with Multi-Channel Pulse Coupled Neural Network

Saliency computation has become a popular research field for many applications due to the useful information provided by saliency maps. For a saliency map, local relations around the salient regions in multi-channel perspective should be taken into consideration by aiming uniformity on the region of interest as an internal approach. And, irrelevant salient regions have to be avoided as much as possible. Most of the works achieve these criteria with external processing modules; however, these can be accomplished during the conspicuity map fusion process. Therefore, in this paper, a new model is proposed for saliency/conspicuity map fusion with two concepts: a) input image transformation relying on the principal component analysis (PCA), and b) saliency conspicuity map fusion with multi-channel pulsed coupled neural network (m-PCNN). Experimental results, which are evaluated by precision, recall, F-measure, and area under curve (AUC), support the reliability of the proposed method by enhancing the saliency computation.

[1]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[2]  Yu Fu,et al.  Visual saliency detection by spatially weighted dissimilarity , 2011, CVPR 2011.

[3]  Bu-Sung Lee,et al.  Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum , 2012, IEEE Transactions on Multimedia.

[4]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[5]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[6]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[7]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  J. Stiens,et al.  Multispectral Image Fusion for Active Millimeter Wave Imaging Application , 2008, 2008 Global Symposium on Millimeter Waves.

[9]  Ren C. Luo,et al.  Multisensor Fusion and Integration: A Review on Approaches and Its Applications in Mechatronics , 2012, IEEE Transactions on Industrial Informatics.

[10]  King Ngi Ngan,et al.  Global salient information maximization for saliency detection , 2012, Signal Process. Image Commun..

[11]  Tianyou Chai,et al.  Flame Image-Based Burning State Recognition for Sintering Process of Rotary Kiln Using Heterogeneous Features and Fuzzy Integral , 2012, IEEE Transactions on Industrial Informatics.

[12]  Huijun Gao,et al.  Novel Approaches to Improve Robustness, Accuracy and Rapidity of Iris Recognition Systems , 2012, IEEE Transactions on Industrial Informatics.

[13]  Dongjian He,et al.  An Improved Hybrid Model for Automatic Salient Region Detection , 2012, IEEE Signal Processing Letters.

[14]  Shuyuan Yang,et al.  Contourlet hidden Markov Tree and clarity-saliency driven PCNN based remote sensing images fusion , 2012, Appl. Soft Comput..

[15]  Roseli A. Francelin Romero,et al.  A Pulse-Coupled Neural Network as A Simplified Bottom-Up Visual Attention Model , 2006, 2006 Ninth Brazilian Symposium on Neural Networks (SBRN'06).

[16]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[17]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Yang Ruliang,et al.  Pixel level fusion for multiple SAR images using PCA and wavelet transform , 2006, 2006 CIE International Conference on Radar.

[19]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[20]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[21]  Yvonne Herz Image Processing Using Pulse Coupled Neural Networks , 2016 .

[22]  Chee Seng Chan,et al.  A Fusion Approach for Efficient Human Skin Detection , 2012, IEEE Transactions on Industrial Informatics.