Under Consideration for Publication in Knowledge and Information Systems Object Discovery in High-resolution Remote Sensing Images: a Semantic Perspective

Given its importance, the problem of object discovery in high-resolution remote-sensing (HRRS) imagery has received a lot of attention in the literature. Despite the vast amount of expert endeavor spent on this problem, more efforts have been expected to discover and utilize hidden semantics of images for object detection. To that end, in this paper, we address this problem from two semantic perspectives. First, we propose a semantic-aware two-stage image segmentation approach, which preserves the semantics of real-world objects during the segmentation process. Second, to better capture semantic features for object discovery, we exploit a hyperclique pattern discovery method to find complex objects that consist of several co-existing individual objects that usually form a unique semantic concept. We consider the identified groups of co-existing objects as new feature sets and feed them into the learning model for better performance of image retrieval. Experiments with real-world datasets show that, with reliable segmentation and new semantic features as starting points, we can improve the performance of object discovery in terms of various external criteria.

[1]  Masahito Hirakawa,et al.  Knowledge-assisted content-based retrieval for multimedia databases , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[2]  Max J. Egenhofer,et al.  Query Processing in Spatial-Query-by-Sketch , 1997, J. Vis. Lang. Comput..

[3]  Glenn Fung,et al.  SVM Feature Selection for Classification of SPECT Images of Alzheimer's Disease Using Spatial Information , 2005, ICDM.

[4]  Rangasami L. Kashyap,et al.  Generalized Affinity-Based Association Rule Mining for Multimedia Database Queries , 2001, Knowledge and Information Systems.

[5]  G. Sohn,et al.  Extraction of buildings from high-resolution satellite data and airborne Lidar , 2000 .

[6]  Masahito Hirakawa,et al.  Knowledge-assisted content based retrieval for multimedia databases , 1994, IEEE MultiMedia.

[7]  Shashi Shekhar,et al.  Spatial Databases: A Tour , 2003 .

[8]  Glenn Fung,et al.  SVM feature selection for classification of SPECT images of Alzheimer's disease using spatial information , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[9]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..

[10]  Aidong Zhang,et al.  SemQuery: Semantic Clustering and Querying on Heterogeneous Features for Visual Data , 2002, IEEE Trans. Knowl. Data Eng..

[11]  Latifur Khan,et al.  Automatic image annotation and retrieval using weighted feature selection , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[12]  Naphtali Rishe,et al.  Content-based image retrieval , 1995, Multimedia Tools and Applications.

[13]  Ankur Teredesai,et al.  CoMMA: a framework for integrated multimedia mining using multi-relational associations , 2005, Knowledge and Information Systems.

[14]  R. Manmatha,et al.  Multiple Bernoulli relevance models for image and video annotation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Zhi-Hua Zhou,et al.  Multi-Instance Multi-Label Learning with Application to Scene Classification , 2006, NIPS.

[16]  J. T. Robinson,et al.  Progressive search and retrieval in large image archives , 1998, IBM J. Res. Dev..

[17]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[18]  Vijayalakshmi Atluri,et al.  Texture-Based Remote-Sensing Image Segmentation , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[19]  R. Manmatha,et al.  Automatic image annotation and retrieval using cross-media relevance models , 2003, SIGIR.

[20]  Lei Zhu,et al.  Keyblock: an approach for content-based image retrieval , 2000, ACM Multimedia.

[21]  Hui Xiong,et al.  Mining strong affinity association patterns in data sets with skewed support distribution , 2003, Third IEEE International Conference on Data Mining.

[22]  Jaime G. Carbonell,et al.  Machine learning research , 1981, SGAR.

[23]  Terry E. Weymouth,et al.  Semantic Queries in Image Databases , 1991, Visual Database Systems.

[24]  Thomas Hofmann,et al.  Multi-Instance Multi-Label Learning with Application to Scene Classification , 2007 .

[25]  Emmanuel P. Baltsavias,et al.  Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems☆ , 2004 .

[26]  W. Bruce Croft,et al.  Relevance-Based Language Models , 2001, SIGIR '01.

[27]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[28]  W. Bruce Croft,et al.  Cross-lingual relevance models , 2002, SIGIR '02.

[29]  Y. Mori,et al.  Image-to-word transformation based on dividing and vector quantizing images with words , 1999 .

[30]  Marco Pastori,et al.  Information mining in remote sensing image archives: system concepts , 2003, IEEE Trans. Geosci. Remote. Sens..

[31]  Marina Müller OBJECT RECOGNITION BASED ON HIGH SPATIAL RESOLUTION PANCHROMATIC SATELLITE IMAGERY , 1999 .