High Dynamic Range Microscopy for Cytopathological Cancer Diagnosis

Cancer is one of the most common causes of death. Cytopathological, i.e., cell-based, diagnosis of cancer can be applied in screening scenarios and allows an early and highly sensitive detection of cancer, thus increasing the chance for cure. The detection of cancer on cells addressed in this paper is based on bright field light microscopy. The cells are imaged with a camera mounted on a microscope, allowing to measure cell properties. However, these cameras exhibit only a limited dynamic range, which often makes the quantification of properties difficult or even impossible. Consequently, to allow a computer-assisted analysis of microscopy images, the imaging has to be improved. To this end, we show how the dynamic range can be increased by acquiring a set of differently exposed cell images. These high dynamic range (HDR) images allow to measure cellular features that are otherwise difficult to capture, if at all. We show that HDR microscopy not only increases the dynamic range, but furthermore reduces noise and improves the acquisition of colors. We develop HDR microscopy-based algorithms, which are essential for cytopathological oncology and early cancer detection and only possible with HDR microscopy imaging. We show the detection of certain subcellular features, so-called AgNORs, in silver (Ag) stained specimens. Furthermore, we give examples of two further applications, namely: 1) the detection of stained cells in immunocytochemical preparations and 2) color separation for nuclear segmentation of specimens stained with low contrast.

[1]  Thomas Würflinger,et al.  Robust automatic coregistration, segmentation, and classification of cell nuclei in multimodal cytopathological microscopic images. , 2004, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[2]  Sabine Süsstrunk,et al.  Modeling the Opto-Electronic Conversion Function (OECF) for Application in the Stitching of Panoramic Images , 2002 .

[3]  Stephan Helling,et al.  Algorithms for spectral color stimulus reconstruction with a seven-channel multispectral camera , 2004, CGIV.

[4]  Dietrich Meyer-Ebrecht,et al.  High Dynamic Range Images as a Basis for Detection of Argyrophilic Nucleolar Organizer Regions Under Varying Stain Intensities , 2006, 2006 International Conference on Image Processing.

[5]  T. Aach,et al.  HDR-Microscopy of Cell Specimens: Imaging and Image Analysis , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[6]  Til Aach,et al.  Noise in high dynamic range imaging , 2008, 2008 15th IEEE International Conference on Image Processing.

[7]  Frank M. Candocia,et al.  Analysis and enhancements to piecewise linear comparametric image registration , 2005, IEEE Transactions on Image Processing.

[8]  Steve Mann,et al.  Comparametric equations with practical applications in quantigraphic image processing , 2000, IEEE Trans. Image Process..

[9]  Johannes Brauers,et al.  Multispectral Filter-Wheel Cameras: Geometric Distortion Model and Compensation Algorithms , 2008, IEEE Transactions on Image Processing.

[10]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Til Aach,et al.  Segmentation and Detection of Nuclei in Silver Stained Cell Specimens for Early Cancer Diagnosis , 2007, 2007 IEEE International Conference on Image Processing.

[12]  K. H. Barratt.  Digital Coding of Waveforms , 1985 .

[13]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Takeo Kanade,et al.  Statistical Calibration of the CCD Imaging Process , 2001, ICCV.

[15]  P. Duesberg,et al.  Chromosomal chaos and cancer. , 2007, Scientific American.

[16]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[17]  T. Aach,et al.  An Evaluation Framework for the Accuracy of Camera Transfer Functions Estimated from Differently Exposed Images , 2006, 2006 IEEE Southwest Symposium on Image Analysis and Interpretation.

[18]  Sameer Singh,et al.  Advanced Algorithmic Approaches to Medical Image Segmentation , 2002, Advances in Computer Vision and Pattern Recognition.

[19]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[20]  P. Duesberg,et al.  Aneuploidy versus gene mutation as cause of cancer , 2001 .

[21]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[22]  J. F. Reid,et al.  RGB calibration for color image analysis in machine vision , 1996, IEEE Trans. Image Process..

[23]  Bernd Jähne,et al.  Practical handbook on image processing for scientific and technical applications , 2004 .

[24]  Stan Sclaroff,et al.  Deformable shape detection and description via model-based region grouping , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[25]  Hideaki Haneishi,et al.  Beyond Red-Green-Blue (RGB) : Spectrum-Based Color Imaging Technology , 2008 .

[26]  Frank M. Candocia,et al.  A semiparametric model for accurate camera response function modeling and exposure estimation from comparametric data , 2005, IEEE Transactions on Image Processing.

[27]  Johannes Brauers,et al.  Vision Color Accuracy and Noise Analysis in Multispectral HDR Imaging , 2008 .

[28]  Peter D. Burns,et al.  Analysis Multispectral Image Capture , 1996, CIC.

[29]  P. Duesberg,et al.  Aneuploidy Approaching a Perfect Score in Predicting and Preventing Cancer: Highlights from a Conference Held in Oakland, CA in January, 2004 , 2004, Cell cycle.

[30]  Charles E. H. Berger,et al.  Color Separation in Forensic Image Processing , 2006, Journal of forensic sciences.

[31]  Alessandro Neri,et al.  Image Acquisition , 2009, Encyclopedia of GIS.

[32]  Frank M. Candocia,et al.  Image registration in range using a constrained piecewise linear model , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[33]  A. Ruifrok,et al.  Comparison of Quantification of Histochemical Staining By Hue-Saturation-Intensity (HSI) Transformation and Color-Deconvolution , 2003, Applied immunohistochemistry & molecular morphology : AIMM.

[34]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[36]  A. Nicolini,et al.  Needle aspiration techniques in preoperative selection of patients with thyroid nodules: a long-term study. , 1996, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[37]  Johannes Brauers,et al.  Multispectral high dynamic range imaging , 2008, Electronic Imaging.

[38]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[39]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[40]  Til Aach,et al.  Towards Fully Automatic Acquisition of Multimodal Cytopathological Microscopy Images with Autofocus and Scene Matching , 2007, Methods of Information in Medicine.

[41]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[42]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[43]  Mahdi Nezamabadi,et al.  Color Appearance Models , 2014, J. Electronic Imaging.

[44]  A. Böcking,et al.  Towards a Single Cell Cancer Diagnosis. Multimodal and Monocellular Measurements of Markers and Morphology (5M) , 2004, Cellular oncology : the official journal of the International Society for Cellular Oncology.