SHERPA: an image segmentation and outline feature extraction tool for diatoms and other objects

BackgroundLight microscopic analysis of diatom frustules is widely used both in basic and applied research, notably taxonomy, morphometrics, water quality monitoring and paleo-environmental studies. In these applications, usually large numbers of frustules need to be identified and/or measured. Although there is a need for automation in these applications, and image processing and analysis methods supporting these tasks have previously been developed, they did not become widespread in diatom analysis. While methodological reports for a wide variety of methods for image segmentation, diatom identification and feature extraction are available, no single implementation combining a subset of these into a readily applicable workflow accessible to diatomists exists.ResultsThe newly developed tool SHERPA offers a versatile image processing workflow focused on the identification and measurement of object outlines, handling all steps from image segmentation over object identification to feature extraction, and providing interactive functions for reviewing and revising results. Special attention was given to ease of use, applicability to a broad range of data and problems, and supporting high throughput analyses with minimal manual intervention.ConclusionsTested with several diatom datasets from different sources and of various compositions, SHERPA proved its ability to successfully analyze large amounts of diatom micrographs depicting a broad range of species. SHERPA is unique in combining the following features: application of multiple segmentation methods and selection of the one giving the best result for each individual object; identification of shapes of interest based on outline matching against a template library; quality scoring and ranking of resulting outlines supporting quick quality checking; extraction of a wide range of outline shape descriptors widely used in diatom studies and elsewhere; minimizing the need for, but enabling manual quality control and corrections. Although primarily developed for analyzing images of diatom valves originating from automated microscopy, SHERPA can also be useful for other object detection, segmentation and outline-based identification problems.

[1]  Josué Álvarez-Borrego,et al.  Comparative analysis of several digital methods to recognize diatoms , 2010 .

[2]  Paul L. Rosin,et al.  A Convexity Measurement for Polygons , 2002, BMVC.

[3]  Jack Sklansky,et al.  Finding the convex hull of a simple polygon , 1982, Pattern Recognit. Lett..

[4]  Geoffrey E. Hinton,et al.  Learning Generative Texture Models with extended Fields-of-Experts , 2009, BMVC.

[5]  J. Neustupa,et al.  Ecological variation within traditional diatom morphospecies: diversity of Frustulia rhomboides sensu lato (Bacillariophyceae) in European freshwater habitats , 2012 .

[6]  G. Cortese,et al.  Climate mediated size variability of diatom Fragilariopsis kerguelensis in the Southern Ocean , 2013 .

[7]  Chenhui Yang,et al.  Automatic Identification of Diatoms with Circular Shape using Texture Analysis , 2011, J. Softw..

[8]  Regine Jahn,et al.  Does the Cosmopolitan Diatom Gomphonema parvulum (Kützing) Kützing Have a Biogeography? , 2014, PloS one.

[9]  Julien Claude,et al.  Morphometrics with R , 2009 .

[10]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[11]  David G. Mann,et al.  The Sellaphora pupula species complex (Bacillariophyceae): morphometric analysis, ultrastructure and mating data provide evidence for five new species , 2004 .

[12]  Paul L. Rosin Measuring shape: ellipticity, rectangularity, and triangularity , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  S. Pizer,et al.  The Image Processing Handbook , 1994 .

[14]  A. Kuwata,et al.  Effects of nutrients on diatom skeletal silicification: Evidence from Neodenticula seminae culture experiments and morphometric analysis , 2009 .

[15]  J. Neustupa,et al.  Pseudocryptic diversity versus cosmopolitanism in diatoms: a case study on Navicula cryptocephala Kütz. (Bacillariophyceae) and morphologically similar taxa. , 2010, Protist.

[16]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[17]  R. Gnatovsky,et al.  Resting stages and ecology of the planktonic diatom Aulacoseira skvortzowii in Lake Baikal , 2008 .

[18]  H. D. Buf,et al.  Automatic diatom identification , 2002 .

[19]  R. Crawford,et al.  Spatial and temporal distribution of assemblages of the diatom Corethron criophilum in the polar frontal region of the South Atlantic , 1997 .

[20]  J. Neustupa,et al.  Geometric morphometrics - a sensitive method to distinguish diatom morphospecies: a case study on the sympatric populations of Reimeria sinuata and Gomphonema tergestinum (Bacillariophyceae) from the River Bečva, Czech Republic , 2009 .

[21]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[22]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Danling Tang,et al.  Morphometry and cell volumes of diatoms from a tropical estuary of India , 2009 .

[24]  David G. Mann,et al.  Diatoms: Biology and Morphology of the Genera , 1990 .

[25]  Frédéric Rimet,et al.  First evidence of the existence of semi-cryptic species and of a phylogeographic structure in the Gomphonema parvulum (Kützing) Kützing complex (Bacillariophyta). , 2013, Protist.

[26]  A Guide to the Morphology of the Diatom Frustule. , 1982 .

[27]  Janice L. Pappas,et al.  Quantitative shape analysis as a diagnostic and prescriptive tool in determining Fragilariforma (Bacillariophyta) taxon status , 2009 .

[28]  C. Klingenberg MorphoJ: an integrated software package for geometric morphometrics , 2011, Molecular ecology resources.

[29]  R. E. Loke,et al.  IDENTIFICATION BY CURVATURE OF CONVEX AND CONCAVE SEGMENTS , 2002 .

[30]  John P. Smol,et al.  The diatoms: applications for the environmental and earth sciences , 2012 .

[31]  J. Neustupa,et al.  Morphometric study of Navicula morphospecies (Bacillariophyta) with respect to diatom life cycle. , 2009 .

[32]  Janice L. Pappas,et al.  Fourier shape analysis and fuzzy measure shape group differentiation of Great Lakes Asterionella Hassall (Heterokontophyta, Bacillariophyceae) , 2001 .

[33]  A. Marchetti,et al.  Diatom elemental and morphological changes in response to iron limitation: a brief review with potential paleoceanographic applications , 2009, Geobiology.

[34]  R. Gersonde,et al.  Glacial‐interglacial size variability in the diatom Fragilariopsis kerguelensis: Possible iron/dust controls? , 2012 .

[35]  Daiqing Mou,et al.  SEPARATING TABELLARIA (BACILLARIOPHYCEAE) SHAPE GROUPS BASED ON FOURIER DESCRIPTORS 1 , 1992 .

[36]  L. Hoffmann,et al.  Taxonomy, morphology and distribution of the Sellaphora stroemii complex (Bacillariophyceae) , 2009 .

[37]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[38]  F. Tadeo,et al.  DIATOMS CLASSIFICATION USING FREQUENCY DOMAIN TECHNIQUES , 2003 .

[39]  Rainer Gersonde,et al.  Morphometric variability in the diatom Fragilariopsis kerguelensis: Implications for Southern Ocean paleoceanography , 2007 .

[40]  D. Mann,et al.  Spatial and temporal stability of demes in Diploneis smithii/D. fusca (Bacillariophyta) supports a narrow species concept , 2000 .

[41]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[42]  Pieter Vanormelingen,et al.  An Inordinate Fondness? The Number, Distributions, and Origins of Diatom Species , 2013, The Journal of eukaryotic microbiology.

[43]  Rainer Gersonde,et al.  Quaternary surface water temperature estimations: Calibration of a diatom transfer function for the Southern Ocean , 1998 .

[44]  David H. Jewson,et al.  Vertical mixing, size change and resting stage formation of the planktonic diatom Aulacoseira baicalensis , 2010 .