Retinally reconstructed images (RRIs): digital images having a resolution match with the human eye

Current digital image/video storage, transmission and display technologies use uniformly sampled images. On the other hand, the human retina has a nonuniform sampling density that decreases dramatically as the solid angle from the visual fixation axis increases. Therefore, there is sampling mismatch between the uniformly sampled digital images and the retina. This paper introduces Retinally Reconstructed Images (RRIs), a novel representation of digital images, that enables a resolution match with the human retina. To create an RRI, the size of the input image, the viewing distance and the fixation point should be known. In the RRI coding phase, we compute the `Retinal Codes', which consist of the retinal sampling locations onto which the input image projects, together with the retinal outputs at these locations. In the decoding phase, we use the backprojection of the Retinal Codes onto the input image grid as B-spline control coefficients, in order to construct a 3D B-spline surface with nonuniform resolution properties. An RRI is then created by mapping the B-spline surface onto a uniform grid, using triangulation. Transmitting or storing the `Retinal Codes' instead of the full resolution images enables up to two orders of magnitude data compression, depending on the resolution of the input image, the size of the input image and the viewing distance. The data reduction capability of Retinal Codes and RRI is promising for digital video storage and transmission applications. However, the computational burden can be substantial in the decoding phase.

[1]  C. Curcio,et al.  Topography of ganglion cells in human retina , 1990, The Journal of comparative neurology.

[2]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[3]  L. Croner,et al.  Receptive fields of P and M ganglion cells across the primate retina , 1995, Vision Research.

[4]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[5]  Wilson S. Geisler,et al.  A nonparametric statistical analysis of texture segmentation performance using a foveated image preprocessing similar to the human retina , 1996, Proceeding of Southwest Symposium on Image Analysis and Interpretation.

[6]  Rangasami L. Kashyap,et al.  Multisplines, nonwavelet multiresolution, and piecewise polynomials , 1995, Optics + Photonics.

[7]  Jake K. Aggarwal,et al.  Multiple resolution imagery and texture analysis , 1987, Pattern Recognit..

[8]  F. Campbell,et al.  Optical quality of the human eye , 1966, The Journal of physiology.

[9]  H. Weber,et al.  Presaccadic Processes in the Generation of Pro and anti Saccades in Human Subjects—A Reaction-Time Study , 1995, Perception.

[10]  Tom Lyche,et al.  Algorithms for degree-raising of splines , 1985, TOGS.

[11]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[12]  Wayne Tiller,et al.  Rational B-Splines for Curve and Surface Representation , 1983, IEEE Computer Graphics and Applications.

[13]  Wilson S. Geisler,et al.  Visual detection following retinal damage: predictions of an inhomogeneous retino-cortical model , 1996, Photonics West.