Saliency-directed color image interpolation using artificial neural network and particle swarm optimization

In this study, a saliency-directed color image interpolation approach using artificial neural network (ANN) and particle swarm optimization (PSO) is proposed. First, a high-quality saliency map of a color image to be interpolated is generated by a modified block-based visual attention model in an effective manner. Then, based on the saliency map, bilinear interpolation and ANN-PSO interpolation are employed for non-saliency (non-ROI) and saliency (ROI) blocks, respectively, to obtain the final color interpolation results. In the proposed ANN-PSO interpolation scheme, ANN is used to determine the orientation of each 5x5 image pattern (block), whereas PSO is employed to determine the weights in 5x5 interpolation filtering masks. The proposed approach is applicable to image interpolation with arbitrary magnification factors (MFs). Based on the experimental results obtained in this study, the color interpolation results by the proposed approach are better than those by five comparison approaches.

[1]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[2]  Jianfeng Feng,et al.  Cue-guided search: a computational model of selective attention , 2005, IEEE Transactions on Neural Networks.

[3]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[4]  Weisi Lin,et al.  Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation , 2005, IEEE Transactions on Image Processing.

[5]  Truong Q. Nguyen,et al.  Image Superresolution Using Support Vector Regression , 2007, IEEE Transactions on Image Processing.

[6]  Seongjai Kim,et al.  Edge-forming methods for color image zooming , 2006, IEEE Transactions on Image Processing.

[7]  Jin-Jang Leou,et al.  Visual Attention Region Detection Using Texture, Object Features , 2010, J. Inf. Sci. Eng..

[8]  Laurent Itti,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Rapid Biologically-inspired Scene Classification Using Features Shared with Visual Attention , 2022 .

[9]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[10]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[11]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[12]  Patrick Le Callet,et al.  From low-level perception to high-level perception: a coherent approach for visual attention modeling , 2004, IS&T/SPIE Electronic Imaging.

[13]  Jin-Jang Leou,et al.  Saliency-directed image interpolation using particle swarm optimization , 2010, Signal Process..

[14]  S. Carrato,et al.  A high quality 2 x image interpolator , 2000, IEEE Signal Processing Letters.

[15]  Khaled Ahmed Nagaty.  Fingerprints classification using artificial neural networks: a combined structural and statistical approach , 2001, Neural Networks.

[16]  S. Battiato,et al.  ALZ: Adaptive Learning for Zooming Digital Images , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[17]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[18]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[19]  Seongjai Kim,et al.  The Error-Amended Sharp Edge (EASE) Scheme for Image Zooming , 2007, IEEE Transactions on Image Processing.

[20]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[21]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Liang-Tien Chia,et al.  Adaptive local context suppression of multiple cues for salient visual attention detection , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[23]  Dimitris Anastassiou,et al.  Subpixel edge localization and the interpolation of still images , 1995, IEEE Trans. Image Process..

[24]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[25]  Michael Unser,et al.  Enlargement or reduction of digital images with minimum loss of information , 1995, IEEE Trans. Image Process..

[26]  Frank Y. Shih,et al.  Enhancement of image watermark retrieval based on genetic algorithms , 2005, J. Vis. Commun. Image Represent..

[27]  Li-Wei Kang,et al.  Two error resilient coding schemes for wavelet-based image transmission based on data embedding and genetic algorithms , 2006, J. Vis. Commun. Image Represent..

[28]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[29]  Carl G. Looney,et al.  Pattern recognition using neural networks: theory and algorithms for engineers and scientists , 1997 .

[30]  Liang Tang,et al.  A practical and adaptive framework for super-resolution , 2008, 2008 15th IEEE International Conference on Image Processing.

[31]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[32]  Fred Stentiford,et al.  An estimator for visual attention through competitive novelty with application to image compression , 2001 .

[33]  D. Broadbent.  Perception and communication , 1958 .

[34]  Hwang Soo Lee,et al.  Adaptive image interpolation based on local gradient features , 2004, IEEE Signal Process. Lett..

[35]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[36]  Carl G. Looney,et al.  Pattern recognition using neural networks , 1997 .

[37]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[38]  Shin Ishii,et al.  Sparse Bayesian Learning of Filters for Efficient Image Expansion , 2010, IEEE Transactions on Image Processing.

[39]  Peng-Yeng Yin,et al.  Particle swarm optimization for point pattern matching , 2006, J. Vis. Commun. Image Represent..

[40]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[41]  W. James,et al.  The Principles of Psychology. , 1983 .

[42]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[43]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..