Embedded foveation image coding

The human visual system (HVS) is highly space-variant in sampling, coding, processing, and understanding. The spatial resolution of the HVS is highest around the point of fixation (foveation point) and decreases rapidly with increasing eccentricity. By taking advantage of this fact, it is possible to remove considerable high-frequency information redundancy from the peripheral regions and still reconstruct a perceptually good quality image. Great success has been obtained previously by a class of embedded wavelet image coding algorithms, such as the embedded zerotree wavelet (EZW) and the set partitioning in hierarchical trees (SPIHT) algorithms. Embedded wavelet coding not only provides very good compression performance, but also has the property that the bitstream can be truncated at any point and still be decoded to recreate a reasonably good quality image. In this paper, we propose an embedded foveation image coding (EFIC) algorithm, which orders the encoded bitstream to optimize foveated visual quality at arbitrary bit-rates. A foveation-based image quality metric, namely, foveated wavelet image quality index (FWQI), plays an important role in the EFIC system. We also developed a modified SPIHT algorithm to improve the coding efficiency. Experiments show that EFIC integrates foveation filtering with foveated image coding and demonstrates very good coding performance and scalability in terms of foveated image quality measurement.

[1]  Cesar Bandera,et al.  Foveal machine vision systems , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[2]  E. Chang.  Wavelet Foveation , 1999 .

[3]  Wilson S. Geisler,et al.  Implementation of a foveated image coding system for image bandwidth reduction , 1996, Electronic Imaging.

[4]  C.-C. Jay Kuo,et al.  A Haar Wavelet Approach to Compressed Image Quality Measurement , 2000, J. Vis. Commun. Image Represent..

[5]  Wilson S. Geisler,et al.  Visual detection following retinal damage: predictions of an inhomogeneous retino-cortical model , 1996, Photonics West.

[6]  Peter J. Burt,et al.  Smart sensing within a pyramid vision machine , 1988, Proc. IEEE.

[7]  Jack Y. B. Lee.  On a unified architecture for video-on-demand services , 2002, IEEE Trans. Multim..

[8]  Marios S. Pattichis,et al.  Foveated video compression with optimal rate control , 2001, IEEE Trans. Image Process..

[9]  Ee-Chien Chang,et al.  A wavelet approach to foveating images , 1997, SCG '97.

[10]  S J Anderson,et al.  Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[11]  Robert J. Safranek,et al.  A perceptually tuned embedded zerotree image coder , 1997, Proceedings of International Conference on Image Processing.

[12]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[13]  R. J. Safranek,et al.  A perceptually tuned sub-band image coder with image dependent quantization and post-quantization data compression , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[14]  Pankaj N. Topiwala,et al.  Human-vision-based wavelet image coding , 1997, Optics & Photonics.

[15]  Francisco Sandoval Hernández,et al.  Shifted fovea multiresolution geometries , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[16]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[17]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[18]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[20]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[21]  No Value,et al.  IEEE International Conference on Image Processing , 2003 .

[22]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[23]  Norimichi Tsumura,et al.  Image compression and decompression based on gazing area , 1996, Electronic Imaging.

[24]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[25]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[26]  A. L. Yarbus.  Eye movements and vision Plenum Press , 1967 .

[27]  Marios S. Pattichis,et al.  Rate control for foveated MPEG/H.263 video , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[28]  Wilson S. Geisler,et al.  IEEE TRANSACTIONS ON SYSTEMS , MAN , AND CYBERNETICS — PART A : SYSTEMS AND HUMANS , 2009 .

[29]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[30]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[31]  Ee-Chien Chang,et al.  Foveation Techniques and Scheduling Issues in Thinwire Visualization , 1998 .

[32]  T. Kuyel.  Foveated models for compression, texture discrimination and classification , 1998 .

[33]  John D. Villasenor,et al.  Visibility of wavelet quantization noise , 1997, IEEE Transactions on Image Processing.

[34]  Marios S. Pattichis,et al.  Foveated video quality assessment , 2002, IEEE Trans. Multim..

[35]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[36]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[37]  T. David,et al.  Computational models of the circle of Willis and the visibility of small cerebral arteries [in MRI] , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[38]  Benjamin Belzer,et al.  Wavelet filter evaluation for image compression , 1995, IEEE Trans. Image Process..

[39]  Andrew P. Bradley,et al.  A wavelet visible difference predictor , 1999, IEEE Trans. Image Process..

[40]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[41]  Andrew B. Watson,et al.  Digital images and human vision , 1993 .

[42]  Robert W. Kentridge,et al.  Eye movement research : mechanisms, processes and applications , 1995 .

[43]  J. Robson,et al.  Probability summation and regional variation in contrast sensitivity across the visual field , 1981, Vision Research.