Detecting Man-Made Structures and Changes in Satellite Imagery With a Content-Based Information Retrieval System Built on Self-Organizing Maps

The increasing amount and resolution of satellite sensors demand new techniques for browsing remote sensing image archives. Content-based querying allows an efficient retrieval of images based on the information they contain, rather than their acquisition date or geographical extent. Self-organizing maps (SOMs) have been successfully applied in the PicSOM system to content-based image retrieval in databases of conventional images. In this paper, we investigate and extend the potential of PicSOM for the analysis of remote sensing data. We propose methods for detecting man-made structures, as well as supervised and unsupervised change detection, based on the same framework. In this paper, a database was artificially created by splitting each satellite image to be analyzed into small images. After training the PicSOM on this imagelet database, both interactive and off-line queries were made to detect man-made structures, as well as changes between two very high resolution images from different years. Experimental results were both evaluated quantitatively and discussed qualitatively, and suggest that this new approach is suitable for analyzing very high resolution optical satellite imagery. Possible applications of this work include interactive detection of man-made structures or supervised monitoring of sensitive sites

[1]  Mihai Datcu,et al.  Information mining in remote sensing image archives: system evaluation , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Sebastiano Impedovo,et al.  Image basic features indexing techniques for video skimming , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[4]  Leen-Kiat Soh,et al.  Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices , 1999, IEEE Trans. Geosci. Remote. Sens..

[5]  Jing-Fa Zhang,et al.  Change detection of earthquake-damaged buildings on remote sensing image and its application in seismic disaster assessment , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[6]  Jorma Laaksonen,et al.  Self-Organizing Map Application for Retrieval of Man-Made Structures in Remote Sensing Data , 2005 .

[7]  Eric Moulines,et al.  FEATURE SELECTION FOR SATELLITE IMAGE INDEXING , 2005 .

[8]  Mihai Datcu,et al.  New architectures for remote sensing image archives , 1997, IGARSS'97. 1997 IEEE International Geoscience and Remote Sensing Symposium Proceedings. Remote Sensing - A Scientific Vision for Sustainable Development.

[9]  M. Schroder,et al.  User-oriented content labeling in remote sensing image archives , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[10]  T. Häme,et al.  An unsupervised change detection and recognition system for forestry , 1998 .

[11]  Marco Pastori,et al.  Information Mining in Remote Sensing Image Archives — Part A : System Concepts , 2003 .

[12]  Erkki Oja,et al.  PicSOM-self-organizing image retrieval with MPEG-7 content descriptors , 2002, IEEE Trans. Neural Networks.

[13]  Morton J. Canty,et al.  Automation of change detection procedures for nuclear safeguards-related monitoring purposes , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[14]  T. M. Lillesand,et al.  Remote Sensing and Image Interpretation , 1980 .

[15]  Paul de Fraipont,et al.  Earth observation and case-based systems for flood risk management , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[16]  D. Fraser,et al.  Multisource Data Fusion with , 1999 .

[17]  S. Gopal,et al.  Remote sensing of forest change using artificial neural networks , 1996, IEEE Trans. Geosci. Remote. Sens..

[18]  J. Kittler,et al.  Feature Set Search Alborithms , 1978 .

[19]  Leen-Kiat Soh,et al.  Segmentation of satellite imagery of natural scenes using data mining , 1999, IEEE Trans. Geosci. Remote. Sens..

[20]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[21]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[22]  Mihai Datcu,et al.  Interactive learning and probabilistic retrieval in remote sensing image archives , 2000, IEEE Trans. Geosci. Remote. Sens..

[23]  Marco Pastori,et al.  Information mining in remote sensing image archives: system concepts , 2003, IEEE Trans. Geosci. Remote. Sens..

[24]  Ram M. Narayanan,et al.  Integrated spectral and spatial information mining in remote sensing imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[25]  G. Healey,et al.  Retrieving Multispectral Satellite Images Using Physics-Based Invariant Representations , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  M. Schroder,et al.  Query by image content from remote sensing archives , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[27]  Klaus Seidel Architecture of a New Generation of Remote Sensing Ground Segments , 1999 .

[28]  Erkki Oja,et al.  Class distributions on SOM surfaces for feature extraction and object retrieval , 2004, Neural Networks.

[29]  Erkki Oja,et al.  Self-Organising Maps as a Relevance Feedback Technique in Content-Based Image Retrieval , 2001, Pattern Analysis & Applications.

[30]  Hubert Rehrauer The role of scale for image description and image query: an application to remote sensing images , 2000 .

[31]  M. Schroeder Interactive learning in remote-sensing image databases , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[32]  Teuvo Kohonen,et al.  Self-Organizing Maps, Third Edition , 2001, Springer Series in Information Sciences.