PathMiner: A Web-Based Tool for Computer-Assisted Diagnostics in Pathology

Large-scale, multisite collaboration has become indispensable for a wide range of research and clinical activities that rely on the capacity of individuals to dynamically acquire, share, and assess images and correlated data. In this paper, we report the development of a Web-based system, PathMiner , for interactive telemedicine, intelligent archiving, and automated decision support in pathology. The PathMiner system supports network-based submission of queries and can automatically locate and retrieve digitized pathology specimens along with correlated molecular studies of cases from ldquoground-truthrdquo databases that exhibit spectral and spatial profiles consistent with a given query image. The statistically most probable diagnosis is provided to the individual who is seeking decision support. To test the system under real-case scenarios, a pipeline infrastructure was developed and a network-based test laboratory was established at strategic sites at the University of Medicine and Dentistry of New Jersey-Robert Wood Johnson Medical School, Robert Wood Johnson University Hospital, the University of Pennsylvania School of Medicine, Hospital of the University of Pennsylvania, The Cancer Institute of New Jersey, and Rutgers University. The average five-class classification accuracy of the system was 93.18% based on a tenfold cross validation on a close dataset containing 3691 imaged specimens. We also conducted prospective performance studies with the PathMiner system in real applications in which the specimens exhibited large variations in staining characters compared with the training data. The average five-class classification accuracy in this open-set experiment was 87.22%. We also provide the comparative results with the previous literature and the PathMiner system shows superior performance.

[1]  Charles R. Giardina,et al.  Elliptic Fourier features of a closed contour , 1982, Comput. Graph. Image Process..

[2]  D. Grobbee,et al.  Neural network‐based screening (NNS) in cervical cytology: No need for the light microscope? , 2001, Diagnostic cytopathology.

[3]  Arthur W. Wetzel Computational Aspects of Pathology Image Classification and Retrieval , 1997, The Journal of Supercomputing.

[4]  Kristin J. Dana,et al.  3D Texture Recognition Using Bidirectional Feature Histograms , 2004, International Journal of Computer Vision.

[5]  Andrew Zisserman,et al.  Classifying Images of Materials: Achieving Viewpoint and Illumination Independence , 2002, ECCV.

[6]  Lin Yang,et al.  Automatic Image Analysis of Histopathology Specimens Using Concave Vertex Graph , 2008, MICCAI.

[7]  R. Kiss,et al.  Computer-assisted analysis of epiluminescence microscopy images of pigmented skin lesions. , 1999, Cytometry.

[8]  David W. Scott,et al.  Parametric Statistical Modeling by Minimum Integrated Square Error , 2001, Technometrics.

[9]  F. Billmeyer Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd ed., by Gunter Wyszecki and W. S. Stiles, John Wiley and Sons, New York, 1982, 950 pp. Price: $75.00 , 1983 .

[10]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[12]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[13]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[14]  Jitendra Malik,et al.  Recognizing surfaces using three-dimensional textons , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  John R. Josephson,et al.  RED: A red-cell antibody identification expert module , 1985, Journal of Medical Systems.

[16]  Lin Yang,et al.  Classification of hematologic malignancies using texton signatures , 2007, Pattern Analysis and Applications.

[17]  James Ze Wang,et al.  Content-based image indexing and searching using Daubechies' wavelets , 1998, International Journal on Digital Libraries.

[18]  B. Nathwani,et al.  Evaluation of an expert system on lymph node pathology. , 1997, Human pathology.

[19]  Peter Meer,et al.  Unsupervised segmentation based on robust estimation and color active contour models , 2005, IEEE Transactions on Information Technology in Biomedicine.

[20]  F. Schnorrenberg,et al.  Content-based retrieval of breast cancer biopsy slides. , 2000, Technology and health care : official journal of the European Society for Engineering and Medicine.

[21]  Bidyut Baran Chaudhuri,et al.  An efficient method based on watershed and rule-based merging for segmentation of 3-D histo-pathological images , 2001, Pattern Recognit..

[22]  M. Cenci,et al.  PAPNET-assisted primary screening of conventional cervical smears. , 2000, Anticancer research.

[23]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[25]  James Ze Wang,et al.  IRM: integrated region matching for image retrieval , 2000, ACM Multimedia.

[26]  Moncef Gabbouj,et al.  Parallel Marker-Based Image Segmentation with Watershed Transformation , 1998, J. Parallel Distributed Comput..

[27]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[28]  A. H. Levy,et al.  Computers and videodiscs in pathology education: ECLIPS as an example of one approach. , 1986, Human pathology.

[29]  Lin Yang,et al.  High Throughput Analysis of Breast Cancer Specimens on the Grid , 2007, MICCAI.

[30]  Dorin Comaniciu,et al.  Image-guided decision support system for pathology , 1999, Machine Vision and Applications.

[31]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .