Pattern Recognition Software and Techniques for Biological Image Analysis

The increasing prevalence of automated image acquisition systems is enabling new types of microscopy experiments that generate large image datasets. However, there is a perceived lack of robust image analysis systems required to process these diverse datasets. Most automated image analysis systems are tailored for specific types of microscopy, contrast methods, probes, and even cell types. This imposes significant constraints on experimental design, limiting their application to the narrow set of imaging methods for which they were designed. One of the approaches to address these limitations is pattern recognition, which was originally developed for remote sensing, and is increasingly being applied to the biology domain. This approach relies on training a computer to recognize patterns in images rather than developing algorithms or tuning parameters for specific image processing tasks. The generality of this approach promises to enable data mining in extensive image repositories, and provide objective and quantitative imaging assays for routine use. Here, we provide a brief overview of the technologies behind pattern recognition and its use in computer vision for biological and biomedical imaging. We list available software tools that can be used by biologists and suggest practical experimental considerations to make the best use of pattern recognition techniques for imaging assays.

[1]  Erik Brauner,et al.  Informatics and Quantitative Analysis in Biological Imaging , 2003, Science.

[2]  E. Myers,et al.  A 3D Digital Atlas of C. elegans and Its Application To Single-Cell Analyses , 2009, Nature Methods.

[3]  Fleischacker Dp,et al.  Reagent-saving method for incubation and washing of blotting membranes , 1993 .

[4]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  A. Kapelner,et al.  An Interactive Statistical Image Segmentation and Visualization System , 2007, International Conference on Medical Information Visualisation - BioMedical Visualisation (MediVis 2007).

[6]  Lior Shamir,et al.  WND-CHARM: Multi-purpose image classification using compound image transforms , 2008, Pattern Recognit. Lett..

[7]  C J Fuller,et al.  Image analysis benchmarking methods for high‐content screen design , 2010, Journal of microscopy.

[8]  Sorin Draghici,et al.  Machine Learning and Its Applications to Biology , 2007, PLoS Comput. Biol..

[9]  I. Goldberg,et al.  Quantitative Image Analysis Reveals Distinct Structural Transitions during Aging in Caenorhabditis elegans Tissues , 2008, PloS one.

[10]  Lani F. Wu,et al.  Image-based multivariate profiling of drug responses from single cells , 2007, Nature Methods.

[11]  Chris H. Q. Ding,et al.  Minimum redundancy feature selection from microarray gene expression data , 2003, Computational Systems Bioinformatics. CSB2003. Proceedings of the 2003 IEEE Bioinformatics Conference. CSB2003.

[12]  Hanchuan Peng,et al.  Automatic recognition and annotation of gene expression patterns of fly embryos , 2007, Bioinform..

[13]  Polina Golland,et al.  CellProfiler Analyst: data exploration and analysis software for complex image-based screens , 2008, BMC Bioinformatics.

[14]  Ambuj K. Singh,et al.  Bisque: a platform for bioimage analysis and management , 2009, Bioinform..

[15]  Lior Shamir,et al.  Source Code for Biology and Medicine Open Access Wndchrm – an Open Source Utility for Biological Image Analysis , 2022 .

[16]  Eugene W. Myers,et al.  Clustering gene expression patterns of fly embryos , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[17]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[18]  Brendan McCane,et al.  Red blood cell segmentation using guided contour tracing , 2006 .

[19]  G Li,et al.  Segmentation of touching cell nuclei using gradient flow tracking , 2008, Journal of microscopy.

[20]  S. Soltani,et al.  SURVEY A Survey of Thresholding Techniques , 1988 .

[21]  Michael Brady,et al.  Advanced phase-based segmentation of multiple cells from brightfield microscopy images , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[22]  K. Eliceiri,et al.  Bioimage informatics for experimental biology. , 2009, Annual review of biophysics.

[23]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[24]  Thorsten Joachims,et al.  Estimating the Generalization Performance of an SVM Efficiently , 2000, ICML.

[25]  Tony Lindeberg,et al.  Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention , 1993, International Journal of Computer Vision.

[26]  Robert F. Murphy,et al.  Principles of Bioimage Informatics: Focus on Machine Learning of Cell Patterns , 2009, BioLINK@ISMB/ECCB.

[27]  Tomasz J. Macura Automating the quantitative analysis of microscopy images , 2009 .

[28]  Hanchuan Peng,et al.  Bioimage informatics: a new area of engineering biology , 2008, Bioinform..

[29]  E Meijering,et al.  Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[30]  M V Boland,et al.  Automated recognition of patterns characteristic of subcellular structures in fluorescence microscopy images. , 1998, Cytometry.

[31]  Ge Cong,et al.  Model-based segmentation of nuclei , 2000, Pattern Recognit..

[32]  Xiao Liu,et al.  Straightening Caenorhabditis elegans images , 2007, Bioinform..

[33]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[34]  Anne E Carpenter,et al.  Systematic genome-wide screens of gene function , 2004, Nature Reviews Genetics.

[35]  M. West,et al.  Image segmentation and dynamic lineage analysis in single‐cell fluorescence microscopy , 2009, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[36]  Robert F. Murphy,et al.  A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells , 2001, Bioinform..

[37]  Lior Shamir,et al.  An image informatics method for automated quantitative analysis of phenotype visual similarities , 2009, 2009 IEEE/NIH Life Science Systems and Applications Workshop.

[38]  Ingo Mierswa,et al.  YALE: rapid prototyping for complex data mining tasks , 2006, KDD '06.

[39]  Anne E Carpenter,et al.  Introduction to the Quantitative Analysis of Two-Dimensional Fluorescence Microscopy Images for Cell-Based Screening , 2009, PLoS Comput. Biol..

[40]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  P.K Sahoo,et al.  A survey of thresholding techniques , 1988, Comput. Vis. Graph. Image Process..

[42]  Eugene W. Myers,et al.  VANO: a volume-object image annotation system , 2009, Bioinform..

[43]  Dimitris N. Metaxas,et al.  Open science - combining open data and open source software: Medical image analysis with the Insight Toolkit , 2005, Medical Image Anal..

[44]  Gyan Bhanot,et al.  Computerized Image-Based Detection and Grading of Lymphocytic Infiltration in HER2+ Breast Cancer Histopathology , 2010, IEEE Transactions on Biomedical Engineering.

[45]  Anne E Carpenter,et al.  CellProfiler: free, versatile software for automated biological image analysis. , 2007, BioTechniques.

[46]  Péter Horváth,et al.  Enhanced CellClassifier: a multi-class classification tool for microscopy images , 2010, BMC Bioinformatics.

[47]  M. Smithson Statistics with confidence , 2000 .

[48]  Polina Golland,et al.  Scoring diverse cellular morphologies in image-based screens with iterative feedback and machine learning , 2009, Proceedings of the National Academy of Sciences.

[49]  M. Pool,et al.  NeuriteTracer: A novel ImageJ plugin for automated quantification of neurite outgrowth , 2008, Journal of Neuroscience Methods.

[50]  Douglas A. Creager,et al.  The Open Microscopy Environment (OME) Data Model and XML file: open tools for informatics and quantitative analysis in biological imaging , 2005, Genome Biology.

[51]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[52]  M V Boland,et al.  Automated analysis of patterns in fluorescence-microscope images. , 1999, Trends in cell biology.

[53]  Queensland Section Staff Ieee 1994 Second Australian and New Zealand Conference on Intelligent Information Systems , 1994 .

[54]  Lior Shamir,et al.  IICBU 2008: a proposed benchmark suite for biological image analysis , 2008, Medical & Biological Engineering & Computing.

[55]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[56]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[57]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[58]  Tao Ju,et al.  A Digital Atlas to Characterize the Mouse Brain Transcriptome , 2005, PLoS Comput. Biol..

[59]  Kai Huang,et al.  Feature reduction for improved recognition of subcellular location patterns in fluorescence microscope images , 2003, SPIE BiOS.

[60]  Gunnar Rätsch,et al.  Support Vector Machines and Kernels for Computational Biology , 2008, PLoS Comput. Biol..

[61]  David A Schiffmann,et al.  Open microscopy environment and findspots: integrating image informatics with quantitative multidimensional image analysis. , 2006, BioTechniques.

[62]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[63]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[64]  Jason R. Swedlow,et al.  In Vivo Analysis of Cajal Body Movement, Separation, and Joining in Live Human Cells , 2000, The Journal of cell biology.

[65]  Ian H. Witten,et al.  WEKA: a machine learning workbench , 1994, Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference.