IEEE TRANSACTIONS ON SYSTEMS , MAN , AND CYBERNETICS — PART A : SYSTEMS AND HUMANS

Current digital image/video storage, transmission and display technologies use uniformly sampled images. On the other hand, the human retina has a nonuniform sampling density that decreases dramatically as the solid angle from the visual fixation axis increases. Therefore, there is sampling mismatch. This paper introduces retinally reconstructed images (RRI), a representation of digital images that enables a resolution match with the retina. To create an RRI, the size of the input image, the viewing distance and the fixation point should be known. In the coding phase, we compute the "retinal codes", which consist of the retinal sampling locations onto which the image projects, together with the retinal outputs at these locations. In the decoding phase, we use the backprojection of the retinal codes onto the input image grid as B-spline control coefficients, in order to construct a 3D B-spline surface with nonuniform resolution properties. An RRI is then created by mapping the B-spline surface onto a uniform grid, using triangulation. Transmitting or storing the "retinal codes" instead of the full resolution images enables up to two orders of magnitude data compression, depending on the resolution of the input image, the size of the input image and the viewing distance. The data reduction capability of retinal codes and RRI is promising for digital video storage and transmission applications. However, the computational burden can be substantial in the decoding phase.

[1]  Rafael Fonolla Navarro,et al.  Duality between foveatization and multiscale local spectrum estimation , 1998, Electronic Imaging.

[2]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[3]  Joseph R. Cavallaro,et al.  A dynamic fault tolerance framework for remote robots , 1995, IEEE Trans. Robotics Autom..

[4]  Gordon W. Roberts,et al.  A foveated image sensor in standard CMOS technology , 1995, Proceedings of the IEEE 1995 Custom Integrated Circuits Conference.

[5]  Wayne Tiller,et al.  Rational B-Splines for Curve and Surface Representation , 1983, IEEE Computer Graphics and Applications.

[6]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[7]  Tsu-Tian Lee,et al.  On the stability properties of hexapod tripod gait , 1988, IEEE J. Robotics Autom..

[8]  Robert B. McGhee,et al.  Adaptive Locomotion of a Multilegged Robot over Rough Terrain , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  오승준.  [서평]「Digital Video Processing」 , 1996 .

[10]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[11]  Rangasami L. Kashyap,et al.  Multisplines, nonwavelet multiresolution, and piecewise polynomials , 1995, Optics + Photonics.

[12]  Farrokh Marvasti,et al.  Recovery of signals from nonuniform samples using iterative methods , 1991, IEEE Trans. Signal Process..

[13]  F. Campbell,et al.  Optical quality of the human eye , 1966, The Journal of physiology.

[14]  D. Bouis,et al.  An accurate and linear infrared oculometer , 1983, Journal of Neuroscience Methods.

[15]  Wilson S. Geisler,et al.  Implementation of a foveated image coding system for image bandwidth reduction , 1996, Electronic Imaging.

[16]  H. Weber,et al.  Presaccadic Processes in the Generation of Pro and anti Saccades in Human Subjects—A Reaction-Time Study , 1995, Perception.

[17]  L. Croner,et al.  Receptive fields of P and M ganglion cells across the primate retina , 1995, Vision Research.

[18]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[19]  Wilson S. Geisler,et al.  A nonparametric statistical analysis of texture segmentation performance using a foveated image preprocessing similar to the human retina , 1996, Proceeding of Southwest Symposium on Image Analysis and Interpretation.

[20]  Sudhir P. Mudur,et al.  Mathematical Elements for Computer Graphics , 1985, Advances in Computer Graphics.

[21]  Bruce H. McCormick,et al.  Gaze-contingent video resolution degradation , 1998, Electronic Imaging.

[22]  D. S. Wooding,et al.  Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. , 1995, Spatial vision.

[23]  Tom Lyche,et al.  Algorithms for degree-raising of splines , 1985, TOGS.

[24]  C. Curcio,et al.  Topography of ganglion cells in human retina , 1990, The Journal of comparative neurology.

[25]  C. D. Boor,et al.  On Calculating B-splines , 1972 .

[26]  Anup Basu,et al.  Enhancing videoconferencing using spatially varying sensing , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[27]  Shigeo Hirose,et al.  A Study of Design and Control of a Quadruped Walking Vehicle , 1984 .

[28]  F. Campbell.  The human eye as an optical filter , 1968 .