Reconstructing images from their most singular fractal manifold

Real-world images are complex objects, difficult to describe but at the same time possessing a high degree of redundancy. A very recent study on the statistical properties of natural images reveals that natural images can be viewed through different partitions which are essentially fractal in nature. One particular fractal component, related to the most singular (sharpest)transitions in the image, seems to be highly informative about the whole scene. In this paper we will show how to decompose the image into their fractal components.We will see that the most singular component is related to (but not coincident with) the edges of the objects present in the scenes. We will propose a new, simple method to reconstruct the image with information contained in that most informative component.We will see that the quality of the reconstruction is strongly dependent on the capability to extract the relevant edges in the determination of the most singular set. We will discuss the results from the perspective of coding, proposing this method as a starting point for future developments.

[1]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[2]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[3]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[4]  J. Nadal,et al.  Self-Similarity Properties of Natural Images Resemble Those of Turbulent Flows , 1998, cond-mat/0107314.

[5]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[6]  V. Mountcastle,et al.  Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. , 1975, Journal of neurophysiology.

[7]  Azriel Rosenfeld,et al.  Picture processing: 1985 , 1986, Comput. Vis. Graph. Image Process..

[8]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[9]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  Azriel Rosenfeld,et al.  Picture processing: 1972 , 1972, Comput. Graph. Image Process..

[11]  Daniel L. Ruderman,et al.  Designing receptive fields for highest fidelity , 1994 .

[12]  Ruderman,et al.  Multiscaling and information content of natural color images , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[13]  J. H. Hateren,et al.  Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation , 1992, Journal of Comparative Physiology A.

[14]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[15]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[16]  D. Ruderman.  The statistics of natural images , 1994 .

[17]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[18]  Antonio Turiel,et al.  The Multifractal Structure of Contrast Changes in Natural Images: From Sharp Edges to Textures , 2000, Neural Computation.

[19]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[20]  Refractor.  Vision , 2000, The Lancet.

[21]  N. Parga,et al.  Scene dependence of the non-Gaussian scaling properties of natural images , 2000, Network.

[22]  E. Bacry,et al.  Singularity spectrum of fractal signals from wavelet analysis: Exact results , 1993 .