A new approach for effective retrieval and indexing of medical images

Abstract The use of medical imaging has increased manifold in past decade. The medical images have become more and more informative about the patient’s anatomy. Thus, the medical images are now not only used for diagnosis purpose but also stored for R&D purpose in order to have better understanding and deeper insights into the cause and cure of various diseases. For real-time retrieval of medical images from such storage repositories there is a grave need of an effective and efficient biomedical image indexing and retrieval approach. In this quest, this paper presents a new approach for the retrieval of CT and MR images using orthogonal Fourier-Mellin moments (OFMMs). OFMMs have excellent information representation capability that enables them to pack the entire image information in very less number of coefficients. This property makes the proposed approach not only effective but also computationally very efficient and most favorable among all the existing approaches. The proposed approach has been tested and compared with numerous existing, state-of-the-art as well as recently published biomedical indexing and retrieval approaches on four standard databases namely, Emphysema CT, NEMA CT, NEMA MRI and OASIS MRI. Additional experiments have been conducted to analyze the noise robustness ability of the proposed and all the compared approaches. The reported results show a significant increase of about 7% and 20% (average) in the retrieval rate of the proposed approach over all the existing approaches on noise free and noisy images, respectively, of all four test medical databases.

[1]  Chandan Singh,et al.  Error Analysis in the Computation of Orthogonal Rotation Invariant Moments , 2013, Journal of Mathematical Imaging and Vision.

[2]  Chandan Singh,et al.  Color texture description with novel local binary patterns for effective image retrieval , 2018, Pattern Recognit..

[3]  Dimitris E. Koulouriotis,et al.  A Unified Methodology for Computing Accurate Quaternion Color Moments and Moment Invariants , 2014, IEEE Transactions on Image Processing.

[4]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[5]  Prabir Kumar Biswas,et al.  A Survey on Current Content based Image Retrieval Methods , 2002 .

[6]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[7]  Subrahmanyam Murala,et al.  Local ternary co-occurrence patterns: A new feature descriptor for MRI and CT image retrieval , 2013, Neurocomputing.

[8]  Agma J. M. Traina,et al.  Retrieval by content of medical images using texture for tissue identification , 2003, 16th IEEE Symposium Computer-Based Medical Systems, 2003. Proceedings..

[9]  Mehmet A. Orgun,et al.  A novel biomedical image indexing and retrieval system via deep preference learning , 2018, Comput. Methods Programs Biomed..

[10]  Shiv Ram Dubey,et al.  Novel local bit-plane dissimilarity pattern for computed tomography image retrieval , 2016 .

[11]  Gwénolé Quellec,et al.  Wavelet optimization for content-based image retrieval in medical databases , 2010, Medical Image Anal..

[12]  Yee Ming Chen,et al.  Face recognition using combined multiple feature extraction based on Fourier-Mellin approach for single example image per person , 2010, Pattern Recognit. Lett..

[13]  Hamid Behnam,et al.  Classification of Benign and Malignant Breast Masses Based on Shape and Texture Features in Sonography Images , 2012, Journal of Medical Systems.

[14]  T. B. J. Andrew,et al.  Integrated Wavelet and Fourier-Mellin invariant feature in fingerprint verification system , 2003, WBMA '03.

[15]  Agma J. M. Traina,et al.  MultiWaveMed: a system for medical image retrieval through wavelets transformations , 2003, 16th IEEE Symposium Computer-Based Medical Systems, 2003. Proceedings..

[16]  Subrahmanyam Murala,et al.  MRI and CT image indexing and retrieval using local mesh peak valley edge patterns , 2014, Signal Process. Image Commun..

[17]  D. Venkata Rao,et al.  Local quantized extrema patterns for content-based natural and texture image retrieval , 2015, Human-centric Computing and Information Sciences.

[18]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[19]  Subrahmanyam Murala,et al.  Local Mesh Patterns Versus Local Binary Patterns: Biomedical Image Indexing and Retrieval , 2014, IEEE Journal of Biomedical and Health Informatics.

[20]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  U. C. Niranjan,et al.  Linear Models of Cumulative Distribution Function for Content-based Medical Image Retrieval , 2007, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[22]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[23]  R. Balasubramanian,et al.  Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking , 2012, Signal Process..

[24]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[25]  Ahmet Ekin,et al.  Local Structure-Based Region-of-Interest Retrieval in Brain MR Images , 2010, IEEE Transactions on Information Technology in Biomedicine.

[26]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[27]  Bin Xiao,et al.  Scaling and rotation invariant analysis approach to object recognition based on Radon and Fourier-Mellin transforms , 2007, Pattern Recognit..

[28]  Shiv Ram Dubey,et al.  Local Wavelet Pattern: A New Feature Descriptor for Image Retrieval in Medical CT Databases , 2015, IEEE Transactions on Image Processing.

[29]  Lauge Sørensen,et al.  Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns , 2010, IEEE Transactions on Medical Imaging.

[30]  Satish Kumar Singh,et al.  Local directional gradient pattern: a local descriptor for face recognition , 2022, Multimedia Tools and Applications.

[31]  Y. Sheng,et al.  Orthogonal Fourier–Mellin moments for invariant pattern recognition , 1994 .

[32]  Shiv Ram Dubey,et al.  Local Bit-Plane Decoded Pattern: A Novel Feature Descriptor for Biomedical Image Retrieval , 2016, IEEE Journal of Biomedical and Health Informatics.

[33]  Shiv Ram Dubey,et al.  Local Diagonal Extrema Pattern: A New and Efficient Feature Descriptor for CT Image Retrieval , 2015, IEEE Signal Processing Letters.

[34]  Mandyam D. Srinath,et al.  Invariant character recognition with Zernike and orthogonal Fourier-Mellin moments , 2002, Pattern Recognit..

[35]  Otman A. Basir,et al.  Semantic Image Retrieval in Magnetic Resonance Brain Volumes , 2012, IEEE Transactions on Information Technology in Biomedicine.

[36]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  S. Gupta,et al.  Local mesh ternary patterns: a new descriptor for MRI and CT biomedical image indexing and retrieval , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[38]  Balasubramanian Raman,et al.  Local tri-directional patterns: A new texture feature descriptor for image retrieval , 2016, Digit. Signal Process..

[39]  S. Gupta,et al.  Local quantized extrema quinary pattern: a new descriptor for biomedical image indexing and retrieval , 2017, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[40]  Shao-Hu Peng,et al.  Texture feature extraction based on a uniformity estimation method for local brightness and structure in chest CT images , 2010, Comput. Biol. Medicine.

[41]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[42]  Raveendran Paramesran,et al.  Efficient computation of radial moment functions using symmetrical property , 2006, Pattern Recognit..

[43]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[44]  Chandan Singh,et al.  On the fast computation of orthogonal Fourier–Mellin moments with improved numerical stability , 2010, Journal of Real-Time Image Processing.

[45]  Subrahmanyam Murala,et al.  Spherical symmetric 3D local ternary patterns for natural, texture and biomedical image indexing and retrieval , 2015, Neurocomputing.

[46]  Partha Pratim Roy,et al.  Local Neighborhood Intensity Pattern: A new texture feature descriptor for image retrieval , 2017, Expert Syst. Appl..

[47]  Chandan Singh,et al.  An efficient and robust multi-frame image super-resolution reconstruction using orthogonal Fourier-Mellin moments , 2017, Displays.