A Foveated Imaging System to Reduce Transmission Bandwidth of Video Images from Remote Camera Systems 6

We have developed a preliminary version of a foveated imaging system, implemented on a general purpose computer, which greatly reduces the transmission bandwidth of images. The system is based on the fact that the spatial resolution of the human eye is space variant, decreasing with increasing eccentricity from the point of gaze. By taking advantage of this fact, it is possible to create an image that is almost perceptually indistinguishable from a constant resolution image, but requires substantially less information to code it. This is accomplished by degrading the resolution of the image so that it matches the space-variant degradation in the resolution of the human eye. Eye movements are recorded so that the high resolution region of the image can be kept aligned with the high resolution region of the human visual system. This system has demonstrated that significant reductions in bandwidth can be achieved while still maintaining access to high detail at any point in an image. The system has been tested using 256x256 8 bit gray scale images with 20° fields-of-view and eye-movement update rates of 30 Hz (display refresh was 60 Hz). Users of the system have reported minimal perceptual artifacts at bandwidth reductions of up to 94.7% (18.8 times reduction)

[1]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[2]  Wilson S. Geisler,et al.  Implementation of a foveated image coding system for image bandwidth reduction , 1996, Electronic Imaging.

[3]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[4]  Gary L. Serfoss,et al.  Effects of Area-of-Interest Display Characteristics of Visual Search Performance and Head Movements in Simulated Low-Level Flight , 1993 .

[5]  Tihao Chiang,et al.  A zerotree wavelet video coder , 1997, IEEE Trans. Circuits Syst. Video Technol..

[6]  Ee-Chien Chang,et al.  A wavelet approach to foveating images , 1997, SCG '97.

[7]  Wilson S. Geisler,et al.  Visual detection following retinal damage: predictions of an inhomogeneous retino-cortical model , 1996, Photonics West.

[8]  Alan C. Bovik,et al.  Visual pattern image sequence coding , 1993, IEEE Trans. Circuits Syst. Video Technol..

[9]  S J Anderson,et al.  Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[10]  Benjamin B. Bederson,et al.  A miniature pan-tilt actuator: the spherical pointing motor , 2011, IEEE Trans. Robotics Autom..

[11]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[12]  Alan C. Bovik,et al.  Motion-compensated visual pattern image sequence coding for full-motion multisession videoconferencing on multimedia workstations , 1996, J. Electronic Imaging.

[13]  Celeste M. Howard Display Characteristics of Example Light-Valve Projectors , 1989 .

[14]  J. Robson,et al.  Probability summation and regional variation in contrast sensitivity across the visual field , 1981, Vision Research.

[15]  T. E. Fisher,et al.  Geometric Transformations For Video Compression And Human Teleoperator Display , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[16]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[17]  Carl F. R. Weiman,et al.  Video compression via log polar mapping , 1990, Defense, Security, and Sensing.

[18]  Edward H. Adelson,et al.  Orthogonal Pyramid Transforms For Image Coding. , 1987, Other Conferences.

[19]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..