Image-guided decision support system for pathology

Abstract. We present a content-based image retrieval system that supports decision making in clinical pathology. The image-guided decision support system locates, retrieves, and displays cases which exhibit morphological profiles consistent to the case in question. It uses an image database containing 261 digitized specimens which belong to three classes of lymphoproliferative disorders and a class of healthy leukocytes. The reliability of the central module, the fast color segmenter, makes possible unsupervised on-line analysis of the query image and extraction of the features of interest: shape, area, and texture of the nucleus. The nuclear shape is characterized through similarity invariant Fourier descriptors, while the texture analysis is based on a multiresolution simultaneous autoregressive model. The system performance was assessed through ten-fold cross-validated classification and compared with that of a human expert. To facilitate a natural man-machine interface, speech recognition and voice feedback are integrated. Client-server communication is multithreaded, Internet-based, and provides access to supporting clinical records and video databases.

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  S. Pileri,et al.  Mantle Cell Lymphoma , 2022, The EBMT/EHA CAR-T Cell Handbook.

[3]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Yanxi Liu,et al.  A classification based similarity metric for 3D image retrieval , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[5]  Dorin Comaniciu,et al.  Decision support system for multiuser remote microscopy in telepathology , 1999, Proceedings 12th IEEE Symposium on Computer-Based Medical Systems (Cat. No.99CB36365).

[6]  Bruce A. Draper,et al.  FOCUS: Searching for multi-colored objects in a diverse image database , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Matti Pietikäinen,et al.  An Experimental Comparison of Autoregressive and Fourier-Based Descriptors in 2D Shape Classification , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Chahab Nastar,et al.  Efficient query refinement for image retrieval , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[9]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[10]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Proceedings of International Conference on Image Processing.

[11]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[12]  Ramesh C. Jain,et al.  Pattern Recognition Methods in Image and Video Databases: Past, Present and Future , 1998, SSPR/SPR.

[13]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[15]  A. López-Guillermo,et al.  Mantle cell lymphoma , 1998, Seminars in hematology.

[16]  Thomas S. Huang,et al.  Supporting similarity queries in MARS , 1997, MULTIMEDIA '97.

[17]  H. Müller-Hermelink,et al.  Image analysis detects lineage-specific morphologic markers in leukemic blast cells. , 1996, American journal of clinical pathology.

[18]  G. Wyszecki,et al.  Color Science Concepts and Methods , 1982 .

[19]  Vladimir Pavlovic,et al.  Toward multimodal human-computer interface , 1998, Proc. IEEE.

[20]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[21]  Thomas S. Huang,et al.  A Modified Fourier Descriptor for Shape Matching in MARS , 1998, Image Databases and Multi-Media Search.

[22]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Fang Liu,et al.  Real-time recognition with the entire Brodatz texture database , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  R. Warnke,et al.  A revised European-American classification of lymphoid neoplasms proposed by the International Lymphoma Study Group. A summary version. , 1995, American journal of clinical pathology.

[25]  Peter Meer,et al.  Image Segmentation from Consensus Information , 1997, Comput. Vis. Image Underst..

[26]  Ingemar J. Cox,et al.  An optimized interaction strategy for Bayesian relevance feedback , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[27]  Myron Flickner,et al.  Query by Image and Video Content , 1995 .

[28]  Charles R. Giardina,et al.  Elliptic Fourier features of a closed contour , 1982, Comput. Graph. Image Process..

[29]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[30]  P. Meer,et al.  Retrieval performance improvement through low rank corrections , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[31]  Kohji Fukunaga,et al.  Introduction to Statistical Pattern Recognition-Second Edition , 1990 .

[32]  M. Mitschke,et al.  Eecient Query Reenement for Image Retrieval , 1998 .

[33]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..