Quantitative Imaging with a Mobile Phone Microscope

Use of optical imaging for medical and scientific applications requires accurate quantification of features such as object size, color, and brightness. High pixel density cameras available on modern mobile phones have made photography simple and convenient for consumer applications; however, the camera hardware and software that enables this simplicity can present a barrier to accurate quantification of image data. This issue is exacerbated by automated settings, proprietary image processing algorithms, rapid phone evolution, and the diversity of manufacturers. If mobile phone cameras are to live up to their potential to increase access to healthcare in low-resource settings, limitations of mobile phone–based imaging must be fully understood and addressed with procedures that minimize their effects on image quantification. Here we focus on microscopic optical imaging using a custom mobile phone microscope that is compatible with phones from multiple manufacturers. We demonstrate that quantitative microscopy with micron-scale spatial resolution can be carried out with multiple phones and that image linearity, distortion, and color can be corrected as needed. Using all versions of the iPhone and a selection of Android phones released between 2007 and 2012, we show that phones with greater than 5 MP are capable of nearly diffraction-limited resolution over a broad range of magnifications, including those relevant for single cell imaging. We find that automatic focus, exposure, and color gain standard on mobile phones can degrade image resolution and reduce accuracy of color capture if uncorrected, and we devise procedures to avoid these barriers to quantitative imaging. By accommodating the differences between mobile phone cameras and the scientific cameras, mobile phone microscopes can be reliably used to increase access to quantitative imaging for a variety of medical and scientific applications.

[1]  Sung-Jea Ko,et al.  A video camera system with enhanced zoom tracking and auto white balance , 2002, IEEE Trans. Consumer Electron..

[2]  Alexander C. Flint Determining optimal medical image compression: psychometric and image distortion analysis , 2012, BMC Medical Imaging.

[3]  Amy L. Gryshuk,et al.  Cell-Phone-Based Platform for Biomedical Device Development and Education Applications , 2011, PloS one.

[4]  Mark S. Rea,et al.  Color rendering: A tale of two metrics , 2008 .

[5]  Livia Bellina,et al.  Mobile cell-phones (M-phones) in telemicroscopy: increasing connectivity of isolated laboratories , 2009, Diagnostic pathology.

[6]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[7]  J. Rovamo,et al.  Michelson contrast, RMS contrast and energy of various spatial stimuli at threshold , 1993, Vision Research.

[8]  Aydogan Ozcan,et al.  Integrated rapid-diagnostic-test reader platform on a cellphone. , 2012, Lab on a chip.

[9]  G. Whitesides,et al.  Simple telemedicine for developing regions: camera phones and paper-based microfluidic devices for real-time, off-site diagnosis. , 2008, Analytical chemistry.

[10]  Matthias Ochs,et al.  Quantitative microscopy of the lung: a problem-based approach. Part 1: basic principles of lung stereology. , 2013, American journal of physiology. Lung cellular and molecular physiology.

[11]  Peter Hufnagl,et al.  Image standards in Tissue-Based Diagnosis (Diagnostic Surgical Pathology) , 2008, Diagnostic pathology.

[12]  Takashi Andou,et al.  Emergency Image Transfer System through a Mobile Telephone in Japan: Technical Note , 2003, Neurosurgery.

[13]  Natarajan Sriraam,et al.  Internet transmission of DICOM images with effective low bandwidth utilization , 2006, Digit. Signal Process..

[14]  Oleg S. Pianykh,et al.  Digital Imaging and Communications in Medicine (DICOM) , 2017, Radiopaedia.org.

[15]  W.E. Snyder,et al.  Color image processing pipeline , 2005, IEEE Signal Processing Magazine.

[16]  John Frean,et al.  Microscopic images transmitted by mobile cameraphone. , 2007, Transactions of the Royal Society of Tropical Medicine and Hygiene.

[17]  Thomas W. Parks,et al.  Joint demosaicing and denoising , 2006, IEEE Transactions on Image Processing.

[18]  Kaida Xiao,et al.  Colour management system for displaying microscope images , 2012, Displays.

[19]  Min Wu,et al.  Image acquisition forensics: Forensic analysis to identify imaging source , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Derek Tseng,et al.  Lensfree microscopy on a cellphone. , 2010, Lab on a chip.

[21]  David N Breslauer,et al.  Mobile Phone Based Clinical Microscopy for Global Health Applications , 2009, PloS one.

[22]  Nicolas Chevrollier,et al.  Data and Image Transfer Using Mobile Phones to Strengthen Microscopy-Based Diagnostic Services in Low and Middle Income Country Laboratories , 2011, PloS one.

[23]  John R. Rogers,et al.  Three-bar resolution versus MTF: how different can they be anyway? , 2008, Optical Engineering + Applications.

[24]  P. Nath,et al.  Label-free biodetection using a smartphone. , 2013, Lab on a chip.

[25]  Gaurav Sharma,et al.  Digital color imaging , 1997, IEEE Trans. Image Process..

[26]  Benjamin Speich,et al.  Mobile phone microscopy for the diagnosis of soil-transmitted helminth infections: a proof-of-concept study. , 2013, The American journal of tropical medicine and hygiene.

[27]  R L Shoemaker,et al.  Digital microscopy. , 1984, Monographs in clinical cytology.

[28]  Sanjay Razdan,et al.  The camera phone: a novel aid in urologic practice. , 2006, Urology.

[29]  D Smutek,et al.  Quality measurement of lossy compression in medical imaging. , 2005, Prague medical report.

[30]  Thomas W. Parks,et al.  Joint demosaicing and denoising , 2006, IEEE Trans. Image Process..

[31]  Tetsuya Kuno,et al.  A new automatic exposure system for digital still cameras , 1998 .

[32]  Wen-Chung Kao,et al.  Design considerations of color image processing pipeline for digital cameras , 2006, IEEE Transactions on Consumer Electronics.

[33]  Jitendra Malik,et al.  Automated Tuberculosis Diagnosis Using Fluorescence Images from a Mobile Microscope , 2012 .

[34]  Louis D. Silverstein,et al.  Observer Performance Using Virtual Pathology Slides: Impact of LCD Color Reproduction Accuracy , 2012, Journal of Digital Imaging.

[35]  Stelzer Contrast, resolution, pixelation, dynamic range and signal‐to‐noise ratio: fundamental limits to resolution in fluorescence light microscopy , 1998 .

[36]  Kenneth R. Spring,et al.  Video Microscopy: The Fundamentals , 1986 .

[37]  D. H. Kelly Spatial Frequency, Bandwidth, and Resolution , 1965 .

[38]  Zeev Zalevsky,et al.  Space–bandwidth product of optical signals and systems , 1996 .

[39]  N. Kehtarnavaz,et al.  Development and Real-Time Implementation of Auto White Balancing Scoring Algorithm , 2002, Real Time Imaging.

[40]  I. T. Young,et al.  Quantitative Microscopy , 1984, Definitions.

[41]  Mahdi Nezamabadi,et al.  Color Appearance Models , 2014, J. Electronic Imaging.

[42]  R. Hofmann-Wellenhof,et al.  Mobile teledermatology for skin tumour screening: diagnostic accuracy of clinical and dermoscopic image tele‐evaluation using cellular phones , 2011, The British journal of dermatology.