Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations

Many machine vision applications, such as compression, pictorial database querying, and image understanding, often need to analyze in detail only a representative subset of the image, which may be arranged into sequences of loci called regions-of-interest (ROIs). We have investigated and developed a methodology that serves to automatically identify such a subset of aROIs (algorithmically detected ROIs) using different image processing algorithms (IPAs), and appropriate clustering procedures. In human perception, an internal representation directs top-down, context-dependent sequences of eye movements to fixate on similar sequences of hROIs (human identified ROIs). In the paper, we introduce our methodology and we compare aROIs with hROIs as a criterion for evaluating and selecting bottom-up, context-free algorithms. An application is finally discussed.

[1]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[2]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[3]  L. Kaufman,et al.  “Center-of-gravity” Tendencies for fixations and flow patterns , 1969 .

[4]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[5]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[6]  L. Stark,et al.  The trajectories of saccadic eye movements. , 1979, Scientific American.

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  P. Locher,et al.  SYMMETRY CATCHES THE EYE , 1987 .

[9]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[10]  P. Vaidyanathan.  Multirate Systems And Filter Banks , 1992 .

[11]  Olivier Rioul,et al.  Fast algorithms for discrete and continuous wavelet transforms , 1992, IEEE Trans. Inf. Theory.

[12]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[13]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[14]  J. M. Hans du Buf,et al.  A review of recent texture segmentation and feature extraction techniques , 1993 .

[15]  Christof Koch,et al.  Control of Selective Visual Attention: Modeling the Where Pathway , 1995, NIPS.

[16]  L. Stark,et al.  Evidence for a global scanpath strategy in viewing abstract compared with realistic images , 1995, Neuropsychologia.

[17]  Amlan Kundu,et al.  Enhancement of JPEG coded images by adaptive spatial filtering , 1995, Proceedings., International Conference on Image Processing.

[18]  L W Stark,et al.  String editing analysis of human visual search. , 1995, Optometry and vision science : official publication of the American Academy of Optometry.

[19]  V. D. Ges.  The Discrete Symmetry Transform in Computer , 1995 .

[20]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[21]  L. Stark,et al.  Experimental metaphysics: The scanpath as an epistemological mechanism , 1996 .

[22]  Andrew B. Watson,et al.  Perceptual adaptive JPEG coding , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[23]  Yong Yu,et al.  Visual Imagery and Virtual Reality , 1997 .

[24]  Serge J. Belongie,et al.  Region-based image querying , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[25]  Lawrence Stark,et al.  Top-down and bottom-up image processing , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[26]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[27]  Christophe De Vleeschouwer,et al.  Fuzzy logic system able to detect interesting areas of a video sequence , 1997, Electronic Imaging.

[28]  Anthony J. Maeder,et al.  Automatic identification of perceptually important regions in an image , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[29]  L. Stark,et al.  Autonomous Image Processing Algorithms Locate Region-of-Interests: The Mars Rover Application , 1998 .

[30]  Claudio M. Privitera,et al.  Evaluating image processing algorithms that predict regions of interest , 1998, Pattern Recognit. Lett..

[31]  Claudio M. Privitera,et al.  Focused JPEG encoding based upon automatic preidentified regions of interest , 1999, Electronic Imaging.

[32]  Claudio M. Privitera,et al.  The segmentation of cursive handwriting: an approach based on off-line recovery of the motor-temporal information , 1999, IEEE Trans. Image Process..

[33]  Claudio M. Privitera,et al.  Scanpath memory binding: multiple read-out experiments , 1999, Electronic Imaging.

[34]  Claudio M. Privitera,et al.  Locating regions-of-interest for the Mars Rover expedition , 2000 .

[35]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[36]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .