Order Sensitive Scoring for Objective Evaluation of Remote Sensing - Image Retrieval System

In order to make the evaluation result become fair and consistent without relying on user judgement, we proposed a new mechanism of objective evaluation for remote sensing image retrieval system. This mechanism is performed by dividing the image database into some subjects and select one subject as a ground truth. Subsequently, we take an image of the ground truth as a query Q. Retrieval accurate ratio (pAR) for query Q will be computed as a comparison between utility value and maximum possible utility. This pAR value can provide the non-degeneracy score. We repeat the retrieval process for all the images in the ground truth as the query and take averaged accurate ratio (pAAR) for a subject as the average value of all the accurate ratio for all queries in a subject. These process is performed for all subjects in the database, thus we can obtain the mean averaged accurate ratio (pmAAR) as mean value of all averaged accurate ratio for all subjects.

[1]  Jing Sun,et al.  An effective image retrieval mechanism using family-based spatial consistency filtration with object region , 2010, Int. J. Autom. Comput..

[2]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  G. N. Srinivasan,et al.  Statistical Texture Analysis , 2008 .

[4]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[5]  Fuhui Long,et al.  Fundamentals of Content-Based Image Retrieval , 2003 .

[6]  M. Pietikäinen,et al.  TEXTURE ANALYSIS WITH LOCAL BINARY PATTERNS , 2004 .

[7]  Guojun Lu,et al.  Content-based Image Retrieval Using Gabor Texture Features , 2000 .

[8]  N. J. Leite,et al.  An architecture for content-based retrieval of remote sensing images , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[9]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  N. Ruan,et al.  Semantic-Based Image Retrieval in Remote Sensing Archive: An Ontology Approach , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.