Quantitative assessment and classification of tissue-based biomarker expression with color content analysis.

CONTEXT The use of computer aids has been suggested as a way to reduce interobserver variability that is known to exist in the interpretation of immunohistochemical staining in pathology. Such computer aids should be automated in their usage but also they should be trained in an automated and reproducible fashion. OBJECTIVE To present a computer aid for the quantitative analysis of tissue-based biomarkers, based on color content analysis. DESIGN The developed system incorporates an automated algorithm to allow retraining based on the color properties of different training sets. The algorithm first generates a color palette containing the colors present in a training subset. Based on the palette, color histograms are derived and are used as feature vectors to a pattern recognition system, which returns an output proportional to biomarker continuous expression or a categorical classification. The method was evaluated on a database of HER2/neu digital breast cancer slides, for which expression scores from a pathologist panel were available. The system was retrained and evaluated on different transformations of the database, including compression, blurring, and changes in illumination, to examine its robustness to different imaging conditions frequently met in digital pathology. RESULTS Results showed high agreement between the results of the algorithm and the truth from the pathologist panel as well as robustness to image transformations. CONCLUSIONS The results of the study are encouraging for the potential of this method as a computer aid to assess biomarker expression in a consistent and reproducible manner.

[1]  E. Frenkel,et al.  Assessment of HER-2/neu status in breast cancer. Automated Cellular Imaging System (ACIS)-assisted quantitation of immunohistochemical assay achieves high accuracy in comparison with fluorescence in situ hybridization assay as the standard. , 2001, American journal of clinical pathology.

[2]  Dorin Comaniciu,et al.  Image-guided decision support system for pathology , 1999, Machine Vision and Applications.

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  J. Doroshow Targeting EGFR in non-small-cell lung cancer. , 2005, The New England journal of medicine.

[5]  Paul Scheunders,et al.  A genetic c-Means clustering algorithm applied to color image quantization , 1997, Pattern Recognit..

[6]  R. Walker,et al.  Quantification of immunohistochemistry—issues concerning methods, utility and semiquantitative assessment I , 2006, Histopathology.

[7]  W. McGuire,et al.  Correlations between estrogen receptor, progesterone receptor, and patient characteristics in human breast cancer. , 1984, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[8]  Marilyn M. Bui,et al.  Using image analysis as a tool for assessment of prognostic and predictive biomarkers for breast cancer: How reliable is it? , 2010, Journal of pathology informatics.

[9]  J. Papadimitriou,et al.  Computerized image analysis of p53 and proliferating cell nuclear antigen expression in benign, hyperplastic, and malignant endometrium. , 2001, Archives of pathology & laboratory medicine.

[10]  Klaus Kayser,et al.  Quantification of virtual slides: Approaches to analysis of content-based image information , 2011, Journal of pathology informatics.

[11]  Ioannis Pitas,et al.  Color-based descriptors for image fingerprinting , 2006, IEEE Transactions on Multimedia.

[12]  R. Steele,et al.  Scoring of p53, VEGF, Bcl-2 and APAF-1 immunohistochemistry and interobserver reliability in colorectal cancer , 2006, Modern Pathology.

[13]  H A Lehr,et al.  Quantitative evaluation of HER-2/neu status in breast cancer by fluorescence in situ hybridization and by immunohistochemistry with image analysis. , 2001, American journal of clinical pathology.

[14]  M. Duffy,et al.  Objective measurement of breast cancer oestrogen receptor status through digital image analysis. , 2003, European journal of surgical oncology : the journal of the European Society of Surgical Oncology and the British Association of Surgical Oncology.

[15]  Jiang Gu,et al.  Virtual microscopy and virtual slides in teaching, diagnosis, and research , 2005 .

[16]  J. Bartlett,et al.  The clinical evaluation of HER‐2 status: which test to use? , 2003, The Journal of pathology.

[17]  Qiang Wu,et al.  Microscope Image Processing , 2010 .

[18]  I Vergote,et al.  A scoring system for immunohistochemical staining: consensus report of the task force for basic research of the EORTC-GCCG. European Organization for Research and Treatment of Cancer-Gynaecological Cancer Cooperative Group. , 1997, Journal of clinical pathology.

[19]  R. Henderson,et al.  Immunohistochemical determination of estrogen and progesterone receptor status in breast cancer. , 1993, American journal of clinical pathology.

[20]  Alexis B. Carter,et al.  HIMSS10 – Perspectives from a newcomer pathologist and a seasoned attendee pathologist: Pathologists should attend! , 2010, Journal of pathology informatics.

[21]  M. Dowsett,et al.  Trastuzumab after adjuvant chemotherapy in HER2-positive breast cancer. , 2005, The New England journal of medicine.

[22]  D. Larsimont,et al.  Evaluation of HER-2/NEU Protein Expression in Breast Cancer by Immunohistochemistry: An Interlaboratory Study Assessing the Reproducibility of HER-2/NEU Testing , 2002, Breast Cancer Research and Treatment.

[23]  A. Dc,et al.  Should immunohistochemical examination replace biochemical hormone receptor assays in breast cancer , 1993 .

[24]  D S Weinberg,et al.  Color images in telepathology: how many colors do we need? , 1997, Human pathology.

[25]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[26]  Youli Zu,et al.  Validation of tissue microarray immunohistochemistry staining and interpretation in diffuse large B-cell lymphoma , 2005, Leukemia & lymphoma.

[27]  K. Bloom,et al.  Enhanced accuracy and reliability of HER-2/neu immunohistochemical scoring using digital microscopy. , 2004, American journal of clinical pathology.

[28]  D. Allred,et al.  Progesterone receptor by immunohistochemistry and clinical outcome in breast cancer: a validation study , 2004, Modern Pathology.

[29]  S. Lakhani,et al.  Current and future approach to the pathologist's assessment for targeted therapy in breast cancer , 2009, Pathology.

[30]  A. Kak,et al.  Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. , 2003, Radiology.

[31]  Lei Zheng,et al.  Design and analysis of a content-based pathology image retrieval system , 2003, IEEE Transactions on Information Technology in Biomedicine.

[32]  Peng Gao,et al.  Application of fuzzy c-means clustering in data analysis of metabolomics. , 2009, Analytical chemistry.

[33]  Thomas Rüdiger,et al.  Inter‐laboratory and inter‐observer reproducibility of immunohistochemical assessment of the Ki‐67 labelling index in a large multi‐centre trial , 2002, The Journal of pathology.

[34]  David L Rimm,et al.  Automated Quantitative Analysis of Tissue Microarrays Reveals an Association between High Bcl-2 Expression and Improved Outcome in Melanoma , 2004, Cancer Research.

[35]  Kyle J. Myers,et al.  Automated Quantitative Assessment of HER-2/neu Immunohistochemical Expression in Breast Cancer , 2009, IEEE Transactions on Medical Imaging.

[36]  A. Chott,et al.  Effect of formalin tissue fixation and processing on immunohistochemistry. , 2000, The American journal of surgical pathology.

[37]  Robert Pinard,et al.  Development of an Unsupervised Pixel-based Clustering Algorithm for Compartmentalization of Immunohistochemical Expression Using Automated QUantitative Analysis , 2009, Applied immunohistochemistry & molecular morphology : AIMM.

[38]  J. Baak,et al.  Prognostic value of proliferation in invasive breast cancer: a review , 2004, Journal of Clinical Pathology.

[39]  K. Edmiston,et al.  HER-2 Status in Breast Cancer: Correlation of Gene Amplification by FISH With Immunohistochemistry Expression Using Advanced Cellular Imaging System , 2006, Applied immunohistochemistry & molecular morphology : AIMM.

[40]  H. Tsuda,et al.  Quantitative immunohistochemical evaluation of HER2/neu expression with HercepTestTM in breast carcinoma by image analysis , 2001, Pathology international.

[41]  Kristine A. Erps,et al.  Overview of telepathology, virtual microscopy, and whole slide imaging: prospects for the future. , 2009, Human pathology.

[42]  John R. Mackey,et al.  Phase III Randomized Trial Comparing Doxorubicin and Cyclophosphamide Followed by Docetaxel (AC→T) with Doxorubicin and Cyclophosphamide Followed by Docetaxel and Trastuzumab (AC→TH) with Docetaxel, Carboplatin and Trastuzumab (TCH) in Her2neu Positive Early Breast Cancer Patients: BCIRG 006 Study. , 2009 .

[43]  D. Lubeck,et al.  Cost‐effectiveness analysis of trastuzumab in the adjuvant setting for treatment of HER2‐positive breast cancer , 2007, Cancer.

[44]  Jorma Isola,et al.  Adjuvant docetaxel or vinorelbine with or without trastuzumab for breast cancer. , 2006, The New England journal of medicine.

[45]  Anne Vincent-Salomon,et al.  High inter-observer agreement in immunohistochemical evaluation of HER-2/neu expression in breast cancer: a multicentre GEFPICS study. , 2006, European journal of cancer.

[46]  Anthony Rhodes,et al.  American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer. , 2006, Archives of pathology & laboratory medicine.

[47]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[48]  Mitch Dowsett,et al.  Proliferation marker Ki-67 in early breast cancer. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[49]  C. Osborne,et al.  Steroid hormone receptors in breast cancer management , 2004, Breast Cancer Research and Treatment.

[50]  J. Epstein,et al.  Static image analysis of skin specimens: the application of telepathology to frozen section evaluation. , 1997, Human pathology.

[51]  L. Holmberg,et al.  The p53 gene in breast cancer: prognostic value of complementary DNA sequencing versus immunohistochemistry. , 1996, Journal of the National Cancer Institute.

[52]  T. Aas,et al.  Specific P53 mutations are associated with de novo resistance to doxorubicin in breast cancer patients , 1996, Nature Medicine.

[53]  Aldo Badano,et al.  Observer variability in the interpretation of HER2/neu immunohistochemical expression with unaided and computer-aided digital microscopy. , 2011, Archives of pathology & laboratory medicine.

[54]  T. Kuopio,et al.  Immunohistochemical staining of estrogen and progesterone receptors: aspects for evaluating positivity and defining the cutpoints. , 2005, Anticancer research.

[55]  M. Kendall Rank Correlation Methods , 1949 .

[56]  G. Barosi,et al.  Cost effectiveness of adjuvant trastuzumab in human epidermal growth factor receptor 2-positive breast cancer. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[57]  Michael T. Orchard,et al.  Color quantization of images , 1991, IEEE Trans. Signal Process..

[58]  Eric Ziegl,et al.  Statistical Methods for the Analysis of Biomedical Data , 1989 .

[59]  Adhemar Longatto-Filho,et al.  Computer-assisted Immunohistochemical Analysis of Cervical Cancer Biomarkers Using Low-cost and Simple Software , 2007, Applied immunohistochemistry & molecular morphology : AIMM.

[60]  Greg Yothers,et al.  Trastuzumab plus adjuvant chemotherapy for operable HER2-positive breast cancer. , 2005, The New England journal of medicine.

[61]  A Böcking,et al.  Interobserver reproducibility of immunocytochemical estrogen- and progesterone receptor status assessment in breast cancer. , 1996, Anticancer research.

[62]  B. Molnár,et al.  Digital slide and virtual microscopy based routine and telepathology evaluation of routine gastrointestinal biopsy specimens , 2003 .

[63]  D. Rimm,et al.  Immunohistochemistry and quantitative analysis of protein expression. , 2009, Archives of pathology & laboratory medicine.

[64]  Yukako Yagi,et al.  Primary histologic diagnosis using automated whole slide imaging: a validation study , 2006, BMC clinical pathology.

[65]  T. Seidal,et al.  Interpretation and Quantification of Immunostains , 2001, The American journal of surgical pathology.

[66]  Ronald S Weinstein,et al.  Innovations in medical imaging and virtual microscopy. , 2005, Human pathology.

[67]  John J Spinelli,et al.  HER-2/neu in Breast Cancer: Interobserver Variability and Performance of Immunohistochemistry with 4 Antibodies Compared with Fluorescent In Situ Hybridization , 2001, Modern Pathology.

[68]  O. Kallioniemi,et al.  Immunohistochemical determination of estrogen and progesterone receptors in human breast carcinoma. Correlation with histopathology and dna flow cytometry , 1990, Cancer.

[69]  Stephen M Hewitt,et al.  Tissue microarrays: bridging the gap between research and the clinic , 2005, Expert review of proteomics.

[70]  K A Matkowskyj,et al.  Quantitative Immunohistochemistry by Measuring Cumulative Signal Strength Using Commercially Available Software Photoshop and Matlab , 2000, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[71]  S. Kvaløy,et al.  Immunohistochemical expression of CD23 and CD40 may identify prognostically favorable subgroups of diffuse large B-cell lymphoma: a Nordic Lymphoma Group Study. , 2003, Clinical cancer research : an official journal of the American Association for Cancer Research.

[72]  R M Levenson,et al.  Quantification of immunohistochemistry—issues concerning methods, utility and semiquantitative assessment II , 2006, Histopathology.

[73]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[74]  C. Floyd,et al.  Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammograms. , 2006, Medical physics.

[75]  T Vrekoussis,et al.  Image analysis of breast cancer immunohistochemistry-stained sections using ImageJ: an RGB-based model. , 2009, Anticancer research.