A Low-Cost Automated Digital Microscopy Platform for Automatic Identification of Diatoms

Currently, microalgae (i.e., diatoms) constitute a generally accepted bioindicator of water quality and therefore provide an index of the status of biological ecosystems. Diatom detection for specimen counting and sample classification are two difficult time-consuming tasks for the few existing expert diatomists. To mitigate this challenge, in this work, we propose a fully operative low-cost automated microscope, integrating algorithms for: (1) stage and focus control, (2) image acquisition (slide scanning, stitching, contrast enhancement), and (3) diatom detection and a prospective specimen classification (among 80 taxa). Deep learning algorithms have been applied to overcome the difficult selection of image descriptors imposed by classical machine learning strategies. With respect to the mentioned strategies, the best results were obtained by deep neural networks with a maximum precision of 86% (with the YOLO network) for detection and 99.51% for classification, among 80 different species (with the AlexNet network). All the developed operational modules are integrated and controlled by the user from the developed graphical user interface running in the main controller. With the developed operative platform, it is noteworthy that this work provides a quite useful toolbox for phycologists in their daily challenging tasks to identify and classify diatoms.

[1]  Janice L. Pappas,et al.  Legendre shape descriptors and shape group determination of specimens in the Cymbella cistula species complex , 2003 .

[2]  Elsa D. Angelini,et al.  Denoising of Microscopy Images: A Review of the State-of-the-Art, and a New Sparsity-Based Method , 2018, IEEE Transactions on Image Processing.

[3]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[4]  Saúl Blanco,et al.  Naturally and Environmentally Driven Variations in Diatom Morphology: Implications for Diatom-Based Assessment of Water Quality , 2020 .

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[7]  J. M. Carr,et al.  A simple, inexpensive method for cleaning diatoms , 1986 .

[8]  H. D. Buf,et al.  Automatic diatom identification , 2002 .

[9]  Peter van Beek,et al.  An autofocus heuristic for digital cameras based on supervised machine learning , 2015, J. Heuristics.

[10]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Saso Dzeroski,et al.  Hierarchical classification of diatom images using ensembles of predictive clustering trees , 2012, Ecol. Informatics.

[12]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[13]  D. John,et al.  Use of Algae for Monitoring Rivers III, edited by J. Prygiel, B.A. Whitton and J. Bukowska (eds) , 1999, Journal of Applied Phycology.

[14]  Yi Shen,et al.  Region level based multi-focus image fusion using quaternion wavelet and normalized cut , 2014, Signal Process..

[15]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Nan Wang,et al.  Automatic plankton image classification combining multiple view features via multiple kernel learning , 2017, BMC Bioinformatics.

[17]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[18]  Antanas Verikas,et al.  Phase congruency-based detection of circular objects applied to analysis of phytoplankton images , 2012, Pattern Recognit..

[19]  Stephan Saalfeld,et al.  Globally optimal stitching of tiled 3D microscopic image acquisitions , 2009, Bioinform..

[20]  Fei Zhou,et al.  Unsupervised pixel-wise classification for Chaetoceros image segmentation , 2018, Neurocomputing.

[21]  Nan Wang,et al.  Robust and automatic cell detection and segmentation from microscopic images of non-setae phytoplankton species , 2017, IET Image Process..

[22]  Jingqiang Li Autofocus searching algorithm considering human visual system limitations , 2005 .

[23]  Stephan Hoyer,et al.  Assessing microscope image focus quality with deep learning , 2018, BMC Bioinformatics.

[24]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[25]  Yang Liu,et al.  Using river microalgae as indicators for freshwater biomonitoring: Review of published research and future directions , 2017 .

[26]  Manuel G. Forero,et al.  A Tuning Method for Diatom Segmentation Techniques , 2017 .

[27]  Pieter Vanormelingen,et al.  An Inordinate Fondness? The Number, Distributions, and Origins of Diatom Species , 2013, The Journal of eukaryotic microbiology.

[28]  A G Valdecasas,et al.  On the extended depth of focus algorithms for bright field microscopy. , 2001, Micron.

[29]  Ralph R. Martin,et al.  A model of diatom shape and texture for analysis, synthesis and identification , 2006, Machine Vision and Applications.

[30]  Jörg Piper,et al.  A review of high-grade imaging of diatoms and radiolarians in light microscopy optical- and software-based techniques , 2011 .

[31]  Oscar Déniz-Suárez,et al.  Semantic versus instance segmentation in microscopic algae detection , 2020, Eng. Appl. Artif. Intell..

[32]  Gabriel Cristóbal,et al.  Overview: Antecedents, Motivation and Necessity , 2020 .

[33]  Emanuele Trucco,et al.  Accelerating Convolutional Sparse Coding for Curvilinear Structures Segmentation by Refining SCIRD-TS Filter Banks , 2016, IEEE Transactions on Medical Imaging.

[34]  Gabriel Cristóbal,et al.  Automated Diatom Classification (Part A): Handcrafted Feature Approaches , 2017 .

[35]  José Luis Espinosa-Aranda,et al.  Low-cost oblique illumination: an image quality assessment , 2018, Journal of biomedical optics.

[36]  E. Bécares,et al.  Are biotic indices sensitive to river toxicants? A comparison of metrics based on diatoms and macro-invertebrates. , 2010, Chemosphere.

[37]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[38]  J. F. Brenner,et al.  An automated microscope for cytologic research a preliminary evaluation. , 1976, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[39]  Nan Wang,et al.  A Hybrid Convolutional Neural Network for Plankton Classification , 2016, ACCV Workshops.

[40]  Kenneth K Y Wong,et al.  High-throughput time-stretch imaging flow cytometry for multi-class classification of phytoplankton. , 2016, Optics express.

[41]  J. Piper,et al.  Microscopic Modalities and Illumination Techniques , 2020 .

[42]  Gabriel Cristóbal,et al.  Automated Diatom Classification (Part B): A Deep Learning Approach , 2017 .

[43]  Huazhong Yang,et al.  Scene-Adaptive Image Acquisition for Focus Stacking , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[44]  Abhishek Dutta,et al.  The VIA Annotation Software for Images, Audio and Video , 2019, ACM Multimedia.

[45]  María Trujillo,et al.  Automated Identification and Classification of Diatoms from Water Resources , 2018, CIARP.

[46]  David G. Mann,et al.  The species concept in diatoms , 1999 .

[47]  Natasha Gelfand,et al.  Generalized autofocus , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[48]  Horst Bunke,et al.  Diatom identification: a double challenge called ADIAC , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[49]  Siavash Yazdanfar,et al.  Simple and robust image-based autofocusing for digital microscopy. , 2008, Optics express.

[50]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[51]  Michael Unser,et al.  Complex wavelets for extended depth‐of‐field: A new method for the fusion of multichannel microscopy images , 2004, Microscopy research and technique.

[52]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[53]  M. Guiry,et al.  HOW MANY SPECIES OF ALGAE ARE THERE? , 2012, Journal of phycology.

[54]  Peter van Beek,et al.  Improved image selection for focus stacking in digital photography , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[55]  Alessio Papini,et al.  A new algorithm to reduce noise in microscopy images implemented with a simple program in python , 2012, Microscopy research and technique.

[56]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Antanas Verikas,et al.  A novel technique to extract accurate cell contours applied for segmentation of phytoplankton images , 2014, Machine Vision and Applications.

[58]  Gabriel Cristóbal,et al.  Multifocus and Multiexposure Techniques , 2020 .