Multimodal Information Integration and Fusion for Histology Image Classification

Biomedical imaging technology has become an important tool for medical research and clinical practice. A large amount of imaging data is generated and collected every day. Managing and analyzing these data sets require the corresponding development of the computer based algorithms for automatic processing. Histology image classification is one of the important tasks in the bio-image informatics field and has broad applications in phenotype description and disease diagnosis. This study proposes a novel framework of histology image classification. The original images are first divided into several blocks and a set of visual features is extracted for each block. An array of C-RSPM Collateral Representative Subspace Projection Modeling models is then built that each model is based on one block from the same location in original images. Finally, the C-Value Enhanced Majority Voting CEWMV algorithm is developed to derive the final classification label for each testing image. To evaluate this framework, the authors compare its performance with several well-known classifiers using the benchmark data available from IICBU data repository. The results demonstrate that this framework achieves promising performance and performs significantly better than other classifiers in the comparison.

[1]  Ian Witten,et al.  Data Mining , 2000 .

[2]  Shu-Ching Chen,et al.  Network intrusion detection through Adaptive Sub-Eigenspace Modeling in multiagent systems , 2007, ACM Trans. Auton. Adapt. Syst..

[3]  Min Chen,et al.  An Effective Multi-concept Classifier for Video Streams , 2008, 2008 IEEE International Conference on Semantic Computing.

[4]  Xi Long,et al.  Multiclass detection of cells in multicontrast composite images , 2010, Comput. Biol. Medicine.

[5]  Anil K. Jain,et al.  Automated Gland Segmentation and Classification for Gleason Grading of Prostate Tissue Images , 2010, 2010 20th International Conference on Pattern Recognition.

[6]  Rong Pan,et al.  Automated segmentation of mouse brain images using extended MRF , 2009, NeuroImage.

[7]  Shu-Ching Chen,et al.  Collateral Representative Subspace Projection Modeling for Supervised Classification , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[8]  Shu-Ching Chen,et al.  Florida International University and University of Miami TRECVID 2008 - High Level Feature Extraction , 2008, TRECVID.

[9]  Min Hyeok Bae Automated segmentation methods for mouse brain images , 2009 .

[10]  Lior Shamir,et al.  Source Code for Biology and Medicine Open Access Wndchrm – an Open Source Utility for Biological Image Analysis , 2022 .

[11]  Péter Horváth,et al.  Enhanced CellClassifier: a multi-class classification tool for microscopy images , 2010, BMC Bioinformatics.

[12]  Nasir M. Rajpoot,et al.  A Robust Adaptive Wavelet-based Method for Classification of Meningioma Histology Images , 2009 .

[13]  Hamdan O. Alanazi,et al.  An Automated White Blood Cell Nucleus Localization and Segmentation using Image Arithmetic and Automatic Threshold , 2010 .

[14]  Fabio A. González,et al.  Histopathology Image Classification Using Bag of Features and Kernel Functions , 2009, AIME.

[15]  Ismail Khalil,et al.  Handbook of Research on Mobile Multimedia , 2006 .

[16]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[17]  Shu-Ching Chen,et al.  Histology Image Classification Using Supervised Classification and Multimodal Fusion , 2010, 2010 IEEE International Symposium on Multimedia.

[18]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[19]  Mei-Ling Shyu,et al.  Correlation-Based Ranking for Large-Scale Video Concept Retrieval , 2010, Int. J. Multim. Data Eng. Manag..

[20]  Radosav S. Pantelic,et al.  Automated sub-cellular phenotype classification: an introduction and recent results , 2006 .

[21]  Anant Madabhushi,et al.  A Boosted Bayesian Multiresolution Classifier for Prostate Cancer Detection From Digitized Needle Biopsies , 2012, IEEE Transactions on Biomedical Engineering.

[22]  Yuping Yang,et al.  Personalized redirection of communication and data , 2004 .

[23]  Wei Wang,et al.  Detection and classification of thyroid follicular lesions based on nuclear structure from histopathology images , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[24]  Steven L. Tanimoto,et al.  Segmentation of pictures into regions with a tile-by-tile method , 1982, Pattern Recognit..

[25]  Min Chen,et al.  Video Semantic Event/Concept Detection Using a Subspace-Based Multimedia Data Mining Framework , 2008, IEEE Transactions on Multimedia.

[26]  Andreas Uhl,et al.  Predicting the histology of colorectal lesions in a probabilistic framework , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[27]  Hanchuan Peng,et al.  Bioimage informatics: a new area of engineering biology , 2008, Bioinform..

[28]  Mahbubur Rahman Syed Multimedia technologies : concepts, methodologies, tools, and applications / Syed Mahbubur Rahman [editor]. , 2008 .

[29]  Mei-Ling Shyu,et al.  A Hybrid Layered Multiagent Architecture with Low Cost and Low Response Time Communication Protocol for Network Intrusion Detection Systems , 2009, 2009 International Conference on Advanced Information Networking and Applications.

[30]  Seiichiro Kagei,et al.  High-throughput classification of images of cells transfected with cDNA clones. , 2003, Comptes rendus biologies.

[31]  Shu-Ching Chen,et al.  Video Event Detection with Combined Distance-Based and Rule-Based Data Mining Techniques , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[32]  Kelsey Hegarty,et al.  Multimedia learning designs: using authentic learning interactions in medicine, dentistry, and health sciences , 2008 .

[33]  Guangshu Hu,et al.  An automatic integrated approach for stained neuron detection in studying neuron migration , 2009, Microscopy research and technique.

[34]  O. Sertel,et al.  Computer-aided Prognosis of Neuroblastoma: Detection of mitosis and karyorrhexis cells in digitized histological images , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.