Relevance feedback for shape-based pathology in spine x-ray image retrieval

Relevance feedback (RF) has become an active research area in Content-based Image Retrieval (CBIR). RF attempts to bridge the gap between low-level image features and high-level human visual perception by analyzing and employing user feedback in an effort to refine the retrieval results to better reflect individual user preference. Need for overcoming this gap is more evident in medical image retrieval due to commonly found characteristics in medical images, viz., (1) images belonging to different pathological categories exhibit subtle differences, and (2) the subjective nature of images often elicits different opinions, even among experts. The National Library of Medicine maintains a collection of digitized spine X-rays from the second National Health and Nutrition Examination Survey (NHANES II). A pathology found frequently in these images is the Anterior Osteophyte (AO), which is of interest to researchers in bone morphometry and osteoarthritis. Since this pathology is manifested as deviation in shape, we have proposed the use of partial shape matching (PSM) methods for pathology-specific spinal X-ray image retrieval. Shape matching tends to suffer from the variability in the pathology expressed by the vertebral shape. This paper describes a novel weight-updating approach to RF. The algorithm was tested and evaluated on a subset of data selected from the image collection. The ground truth was established using Macnab's classification to determine pathology type and a grading system developed by us to express the pathology severity. Experimental results show nearly 20% overall improvement on retrieving the correct pathological category, from 69% without feedback to 88.75% with feedback.

[1]  Yanchun Zhang,et al.  An overview of content-based image retrieval techniques , 2004, 18th International Conference on Advanced Information Networking and Applications, 2004. AINA 2004..

[2]  Dah-Jye Lee,et al.  Similarity measurement using polygon curve representation and Fourier descriptors for shape-based vertebral image retrieval , 2003, SPIE Medical Imaging.

[3]  Nikolas P. Galatsanos,et al.  A similarity learning approach to content-based image retrieval: application to digital mammography , 2004, IEEE Transactions on Medical Imaging.

[4]  D Resnick,et al.  Traction osteophytes of the lumbar spine: radiographic-pathologic correlation. , 1988, Radiology.

[5]  P. Muneesawang,et al.  A neural network approach for learning image similarity in adaptive CBIR , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[6]  Shi-Min Hu,et al.  Optimal adaptive learning for image retrieval , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[8]  L. Rodney Long,et al.  Evaluation of shape similarity measurement methods for spine X-ray images , 2004, J. Vis. Commun. Image Represent..

[9]  Wei-Ying Ma,et al.  Learning similarity measure for natural image retrieval with relevance feedback , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Arnold W. M. Smeulders,et al.  Concept-based retrieval of biomedical images , 2003, SPIE Medical Imaging.

[11]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  B. J. Doherty,et al.  Morphologic Study of Lumbar Vertebral Osteophytes , 1998, Southern medical journal.

[13]  Alessandra Lumini,et al.  A new approach for relevance feedback through positive and negative samples , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[14]  Nikolas P. Galatsanos,et al.  Relevance feedback based on incremental learning for mammogram retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[15]  L. Rodney Long,et al.  Relevance feedback for spine X-ray retrieval , 2005, 18th IEEE Symposium on Computer-Based Medical Systems (CBMS'05).

[16]  Sameer Antani,et al.  Evaluating Partial Shape Queries for Pathology-based Retrieval of Vertebra , 2004 .

[17]  Irwin King,et al.  Relevance feedback based on parameter estimation of target distribution , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[18]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[19]  Djemel Ziou,et al.  Learning from negative example in relevance feedback for content-based image retrieval , 2002, Object recognition supported by user interaction for service robots.

[20]  Zhong Jin,et al.  Integrated probability function and its application to content-based image retrieval by relevance feedback , 2003, Pattern Recognit..

[21]  L. Rodney Long,et al.  Partial shape matching of spine X-ray shapes using dynamic programming , 2004, Proceedings. 17th IEEE Symposium on Computer-Based Medical Systems.

[22]  Ingemar J. Cox,et al.  PicHunter: Bayesian relevance feedback for image retrieval , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Latifur Khan,et al.  Image classification using neural networks and ontologies , 2002, Proceedings. 13th International Workshop on Database and Expert Systems Applications.

[24]  I Macnab,et al.  The traction spur. An indicator of segmental instability. , 1971, The Journal of bone and joint surgery. American volume.