Retrieval by classification of images containing large manmade objects using perceptual grouping

Abstract This paper applies perceptual grouping rules to the retrieval by classification of images containing large manmade objects such as buildings, towers, bridges, and other architectural objects. The semantic interrelationships between primitive image features are exploited by perceptual grouping to extract structure to detect the presence of manmade objects. Segmentation and detailed object representation are not required. The system analyzes each image to extract features that are strong evidence of the presence of these objects. These features are generated by the strong boundaries typical of manmade structures: straight line segments, longer linear lines, coterminations, “L” junctions, “U” junctions, parallel lines, parallel groups, “significant” parallel groups, cotermination graph, and polygons. A K -nearest neighbor framework is employed to classify these features and retrieve the images that contain manmade objects. Results are demonstrated for two databases of monocular outdoor images.

[1]  Jake K. Aggarwal,et al.  CAD-based vision: object recognition in cluttered range images using recognition strategies , 1993 .

[2]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[3]  Edward M. Riseman,et al.  Scale space matching and image retrieval , 1996 .

[4]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[5]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[6]  W. Eric L. Grimson,et al.  On the recognition of curved objects , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[7]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jake K. Aggarwal,et al.  Lower-level and higher-level approaches to content-based image retrieval , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[10]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[11]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[13]  Ramesh Jain,et al.  Storage and Retrieval for Still Image and Video Databases IV , 1996 .

[14]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Vijay V. Raghavan,et al.  Design and evaluation of algorithms for image retrieval by spatial similarity , 1995, TOIS.

[16]  Dragutin Petkovic,et al.  Automatic and semiautomatic methods for image annotation and retrieval in query by image content (QBIC) , 1995, Electronic Imaging.

[17]  W. Geisler,et al.  Perceptual organization of two-dimensional patterns. , 2000, Psychological review.

[18]  K. Boyer,et al.  Perceptual Organization for Artificial Vision Systems , 2000 .

[19]  A. Gibbons Algorithmic Graph Theory , 1985 .

[20]  Ramakant Nevatia,et al.  Detection and description of buildings from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Virginio Cantoni Human and machine vision : analogies and divergencies , 1994 .

[22]  Jake K. Aggarwal,et al.  Applying perceptual grouping to content-based image retrieval: building images , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[23]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[24]  J. Hochberg Effects of the Gestalt revolution: the Cornell symposium on perception. , 1957, Psychology Review.

[25]  Alberto Del Bimbo,et al.  Visual image retrieval by elastic deformation of object sketches , 1994, Proceedings of 1994 IEEE Symposium on Visual Languages.

[26]  Kim L. Boyer,et al.  Quantitative measures of change based on feature organization: eigenvalues and eigenvectors , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Jake K. Aggarwal,et al.  Model-based object recognition in dense-range images—a review , 1993, CSUR.

[28]  Josef Kittler,et al.  A hierarchical approach to line extraction , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Kim L. Boyer,et al.  Quantitative Measures of Change Based on Feature Organization: Eigenvalues and Eigenvectors , 1998, Comput. Vis. Image Underst..

[30]  J. McCafferty Human and machine vision: computing perceptual organisation , 1990 .

[31]  Martin D. Levine,et al.  Vision in Man and Machine , 1985 .

[32]  Jake K. Aggarwal,et al.  Applying perceptual organization to the detection of man-made objects in non-urban scenes , 1992, Pattern Recognit..

[33]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[34]  Terri Gullickson,et al.  Encyclopedia of human behavior , 1995 .

[35]  Euripides G. M. Petrakis,et al.  Methodology for the representation, indexing and retrieval of images by content , 1993, Image Vis. Comput..

[36]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Thomas M. Strat,et al.  Recognizing objects in a natural environment: a contextual vision system (CVS) , 1989 .

[38]  Bruce A. Draper,et al.  ISR: a database for symbolic processing in computer vision , 1989, Computer.

[39]  Michael J. Tarr,et al.  VISUAL REPRESENTATION: FROM FEATURES TO OBJECTS , 1994 .

[40]  Edward M. Riseman,et al.  Image Retrieval Using Scale-Space Matching , 1996, ECCV.

[41]  J. Ashley,et al.  Automatic and Semi-Automatic Methods for Image Annotation and Retrieval in QBIC , 1995 .

[42]  Pat Langley,et al.  Learning to Detect Rooftops in Aerial Images , 1997 .

[43]  K. Ramesh Babu,et al.  Linear Feature Extraction and Description , 1979, IJCAI.

[44]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[45]  J. B. Burns,et al.  Extracting straight lines , 1987 .

[46]  Josef Kittler,et al.  Low-level Grouping of Straight Line Segments , 1991 .

[47]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[48]  D. Jacobs What Makes Viewpoint Invariant Properties Perceptually Salient?: A Computational Perspective , 2000 .