Layer-based visualization and biomedical information exploration of multi-channel large histological data

BACKGROUND AND OBJECTIVE Modern microscopes can acquire multi-channel large histological data from tissues of human beings or animals, which contain rich biomedical information for disease diagnosis and biological feature analysis. However, due to the large size, fuzzy tissue structure, and complicated multiple elements integrated in the image color space, it is still a challenge for current software systems to effectively calculate histological data, show the inner tissue structures and unveil hidden biomedical information. Therefore, we developed new algorithms and a software platform to address this issue. METHODS This paper presents a multi-channel biomedical data computing and visualization system that can efficiently process large 3D histological images acquired from high-resolution microscopes. A novelty of our system is that it can dynamically display a volume of interest and extract tissue information using a layer-based data navigation scheme. During the data exploring process, the actual resolution of the loaded data can be dynamically determined and updated, and data rendering is synchronized in four display windows at each data layer, where 2D textures are extracted from the imaging volume and mapped onto the displayed clipping planes in 3D space. RESULTS To test the efficiency and scalability of this system, we performed extensive evaluations using several different hardware systems and large histological color datasets acquired from a CryoViz 3D digital system. The experimental results demonstrated that our system can deliver interactive data navigation speed and display detailed imaging information in real time, which is beyond the capability of commonly available biomedical data exploration software platforms. CONCLUSION Taking advantage of both CPU (central processing unit) main memory and GPU (graphics processing unit) graphics memory, the presented software platform can efficiently compute, process and visualize very large biomedical data and enhance data information. The performance of this system can satisfactorily address the challenges of navigating and interrogating volumetric multi-spectral large histological image at multiple resolution levels.

[1]  Nuria Lopez-Bigas,et al.  Visualizing multidimensional cancer genomics data , 2013, Genome Medicine.

[2]  Markus Hadwiger,et al.  Ssecrett and NeuroTrace: Interactive Visualization and Analysis Tools for Large-Scale Neuroscience Data Sets , 2010, IEEE Computer Graphics and Applications.

[3]  Kevin W Eliceiri,et al.  Visualization approaches for multidimensional biological image data. , 2007, BioTechniques.

[4]  Shu-Ching Chen,et al.  Computational Health Informatics in the Big Data Age , 2016, ACM Comput. Surv..

[5]  Markus Hadwiger,et al.  High-Quality Multimodal Volume Rendering for Preoperative Planning of Neurosurgical Interventions , 2007, IEEE Transactions on Visualization and Computer Graphics.

[6]  Callen T Wallace,et al.  Data management and archiving in a large microscopy‐and‐imaging, multi‐user facility: Problems and solutions , 2015, Molecular reproduction and development.

[7]  Enrico Gobbetti,et al.  A single-pass GPU ray casting framework for interactive out-of-core rendering of massive volumetric datasets , 2008, The Visual Computer.

[8]  L. Zhao,et al.  Big data visualization identifies the multidimensional molecular landscape of human gliomas , 2016, Proceedings of the National Academy of Sciences.

[9]  L. Rodney Long,et al.  Histology image analysis for carcinoma detection and grading , 2012, Comput. Methods Programs Biomed..

[10]  Sylvain Lefebvre,et al.  GigaVoxels: ray-guided streaming for efficient and detailed voxel rendering , 2009, I3D '09.

[11]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[12]  Darren Treanor,et al.  Toward routine use of 3D histopathology as a research tool. , 2012, The American journal of pathology.

[13]  Bang Wong,et al.  Visualizing biological data—now and in the future , 2010, Nature Methods.

[14]  Hanchuan Peng,et al.  Visualization and Analysis of 3D Microscopic Images , 2012, PLoS Comput. Biol..

[15]  Jeffrey A. Fessler,et al.  Intensity-based image registration using robust correlation coefficients , 2004, IEEE Transactions on Medical Imaging.

[16]  Zhipeng Jia,et al.  Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features , 2017, BMC Bioinformatics.

[17]  Hanchuan Peng,et al.  Virtual finger boosts three-dimensional imaging and microsurgery as well as terabyte volume image visualization and analysis , 2014, Nature Communications.

[18]  Kwan-Liu Ma,et al.  Transform Coding for Hardware-accelerated Volume Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[19]  Kirby G. Vosburgh,et al.  3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support , 2014 .

[20]  Qi Zhang,et al.  Volume Visualization: A Technical Overview with a Focus on Medical Applications , 2011, Journal of Digital Imaging.

[21]  Sergei V. Kalinin,et al.  Big Data Analytics for Scanning Transmission Electron Microscopy Ptychography , 2016, Scientific Reports.

[22]  Qi Zhang,et al.  GPU-Based Visualization and Synchronization of 4-D Cardiac MR and Ultrasound Images , 2012, IEEE Transactions on Information Technology in Biomedicine.

[23]  Hanchuan Peng,et al.  TeraFly: real-time three-dimensional visualization and annotation of terabytes of multidimensional volumetric images , 2016, Nature Methods.

[24]  Carmen C. Y. Poon,et al.  Big Data for Health , 2015, IEEE Journal of Biomedical and Health Informatics.

[25]  Qi Zhang,et al.  Multimodality Neurological Data Visualization With Multi-VOI-Based DTI Fiber Dynamic Integration , 2016, IEEE Journal of Biomedical and Health Informatics.

[26]  Joel H. Saltz,et al.  Histopathological Image Analysis Using Model-Based Intermediate Representations and Color Texture: Follicular Lymphoma Grading , 2009, J. Signal Process. Syst..

[27]  Bernd Hamann,et al.  Multiresolution techniques for interactive texture-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[28]  Gilles Louppe,et al.  Collaborative analysis of multi-gigapixel imaging data using Cytomine , 2016, Bioinform..

[29]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[30]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[31]  E. Barillot,et al.  Genome Alteration Print (GAP): a tool to visualize and mine complex cancer genomic profiles obtained by SNP arrays , 2009, Genome Biology.

[32]  Robert B. West,et al.  Automated Analysis and Classification of Histological Tissue Features by Multi-Dimensional Microscopic Molecular Profiling , 2015, PloS one.

[33]  Phedias Diamandis,et al.  Visualizing histopathologic deep learning classification and anomaly detection using nonlinear feature space dimensionality reduction , 2018, BMC Bioinformatics.

[34]  DEBASHISH ROY,et al.  3D Cryo‐Imaging: A Very High‐Resolution View of the Whole Mouse , 2009, Anatomical record.

[35]  Rui Xu,et al.  Three-dimensional reconstruction of light microscopy image sections: present and future , 2015, Frontiers of Medicine.

[36]  Joe Michael Kniss,et al.  Interactive Texture-Based Volume Rendering for Large Data Sets , 2001, IEEE Computer Graphics and Applications.

[37]  Qolamreza R. Razlighi,et al.  Spatial Mutual Information as Similarity Measure for 3-D Brain Image Registration , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[38]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2004, Medical Image Anal..

[39]  Utkarsh Ayachit,et al.  The ParaView Guide: A Parallel Visualization Application , 2015 .

[40]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[41]  Jean Yeh,et al.  Big Data and the Future of Radiology Informatics. , 2016, Academic radiology.

[42]  Markus Hadwiger,et al.  Interactive Volume Exploration of Petascale Microscopy Data Streams Using a Visualization-Driven Virtual Memory Approach , 2012, IEEE Transactions on Visualization and Computer Graphics.

[43]  Markus Hadwiger,et al.  Exploring the Connectome: Petascale Volume Visualization of Microscopy Data Streams , 2013, IEEE Computer Graphics and Applications.