Automated processing of zebrafish imaging data: a survey.

Due to the relative transparency of its embryos and larvae, the zebrafish is an ideal model organism for bioimaging approaches in vertebrates. Novel microscope technologies allow the imaging of developmental processes in unprecedented detail, and they enable the use of complex image-based read-outs for high-throughput/high-content screening. Such applications can easily generate Terabytes of image data, the handling and analysis of which becomes a major bottleneck in extracting the targeted information. Here, we describe the current state of the art in computational image analysis in the zebrafish system. We discuss the challenges encountered when handling high-content image data, especially with regard to data quality, annotation, and storage. We survey methods for preprocessing image data for further analysis, and describe selected examples of automated image analysis, including the tracking of cells during embryogenesis, heartbeat detection, identification of dead embryos, recognition of tissues and anatomical landmarks, and quantification of behavioral patterns of adult fish. We review recent examples for applications using such methods, such as the comprehensive analysis of cell lineages during early development, the generation of a three-dimensional brain atlas of zebrafish larvae, and high-throughput drug screens based on movement patterns. Finally, we identify future challenges for the zebrafish image analysis community, notably those concerning the compatibility of algorithms and data formats for the assembly of modular analysis pipelines.

[1]  Raphaël Marée,et al.  A rich internet application for remote visualization and collaborative annotation of digital slides in histology and cytology , 2013, Diagnostic Pathology.

[2]  R C MacPhail,et al.  Acute neuroactive drug exposures alter locomotor activity in larval zebrafish. , 2010, Neurotoxicology and teratology.

[3]  Jan de Sonneville,et al.  A High-Throughput Screen for Tuberculosis Progression , 2011, PloS one.

[4]  Karen Ocorr,et al.  A new method for detection and quantification of heartbeat parameters in Drosophila, zebrafish, and embryonic mouse hearts. , 2009, BioTechniques.

[5]  F. Del Bene,et al.  Optical Sectioning Deep Inside Live Embryos by Selective Plane Illumination Microscopy , 2004, Science.

[6]  Charless C. Fowlkes,et al.  A Quantitative Spatiotemporal Atlas of Gene Expression in the Drosophila Blastoderm , 2008, Cell.

[7]  S. Haggarty,et al.  Zebrafish Behavioral Profiling Links Drugs to Biological Targets and Rest/Wake Regulation , 2010, Science.

[8]  Asmi H. Shah,et al.  Facilitating Drug Discovery: An Automated High-content Inflammation Assay in Zebrafish , 2012, Journal of visualized experiments : JoVE.

[9]  Xiaoyin Xu,et al.  Automated analysis of zebrafish images for phenotypic changes in drug discovery , 2011, Journal of Neuroscience Methods.

[10]  Markus Reischl,et al.  Zebrafish embryos as models for embryotoxic and teratological effects of chemicals. , 2009, Reproductive toxicology.

[11]  F. Del Bene,et al.  Report of the Second European Zebrafish Principal Investigator Meeting in Karlsruhe, Germany, March 21-24, 2012. , 2013, Zebrafish.

[12]  Robert Rallo,et al.  Automated Phenotype Recognition for Zebrafish Embryo Based In Vivo High Throughput Toxicity Screening of Engineered Nano-Materials , 2012, PloS one.

[13]  Mushfiqur R. Sarker,et al.  Automated Zebrafish Chorion Removal and Single Embryo Placement , 2012, Journal of laboratory automation.

[14]  Raphaël Marée,et al.  Phenotype Classification of Zebrafish Embryos by Supervised Learning , 2012, PloS one.

[15]  Merle G Paule,et al.  Ketamine induces motor neuron toxicity and alters neurogenic and proneural gene expression in zebrafish , 2013, Journal of applied toxicology : JAT.

[16]  Ravindra Peravali,et al.  Automated feature detection and imaging for high-resolution screening of zebrafish embryos. , 2011, BioTechniques.

[17]  M. J. Ledesma-Carbayo,et al.  An automatic quantification and registration strategy to create a gene expression atlas of zebrafish embryogenesis , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  N. Trede,et al.  The zebrafish as a model for cancer , 2010, Disease Models & Mechanisms.

[19]  L. Paavolainen,et al.  BioImageXD: an open, general-purpose and high-throughput image-processing platform , 2012, Nature Methods.

[20]  Markus Reischl,et al.  Automated high-throughput mapping of promoter-enhancer interactions in zebrafish embryos , 2009, Nature Methods.

[21]  Stephen T. C. Wong,et al.  ZFIQ: a software package for zebrafish biology , 2008, Bioinform..

[22]  Mehmet Fatih Yanik,et al.  Fully automated cellular-resolution vertebrate screening platform with parallel animal processing. , 2011, Lab on a chip.

[23]  Michael Tsang,et al.  Automated image‐based phenotypic analysis in zebrafish embryos , 2009, Developmental dynamics : an official publication of the American Association of Anatomists.

[24]  Michael Liebling,et al.  Cardiac tissue and erythrocyte separation in bright-field microscopy images of the embryonic zebrafish heart for motion estimation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[25]  Markus Reischl,et al.  Data mining tools , 2011, WIREs Data Mining Knowl. Discov..

[26]  Markus Reischl,et al.  Methods for Automated High-Throughput Toxicity Testing Using Zebrafish Embryos , 2010, KI.

[27]  Stephen T. C. Wong,et al.  Computerized image analysis for quantitative neuronal phenotyping in zebrafish , 2006, Journal of Neuroscience Methods.

[28]  Joachim Wittbrodt,et al.  Similarity analysis of cell movements in video microscopy , 2012, 2012 IEEE Symposium on Biological Data Visualization (BioVis).

[29]  Stefan Schulz,et al.  A modular, low-cost robot for zebrafish handling , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Nigel W. Hardy,et al.  Promoting coherent minimum reporting guidelines for biological and biomedical investigations: the MIBBI project , 2008, Nature Biotechnology.

[31]  Siddharth Gaikwad,et al.  Characterization of behavioral and endocrine effects of LSD on zebrafish , 2010, Behavioural Brain Research.

[32]  P. Bourgine,et al.  Cell Lineage Reconstruction of Early Zebrafish Embryos Using Label-Free Nonlinear Microscopy , 2010, Science.

[33]  Ralf Mikut,et al.  Identification of Nonvisual Photomotor Response Cells in the Vertebrate Hindbrain , 2013, The Journal of Neuroscience.

[34]  Siddharth Gaikwad,et al.  Automated high-throughput neurophenotyping of zebrafish social behavior , 2012, Journal of Neuroscience Methods.

[35]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[36]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[37]  Markus Reischl,et al.  Information Fusion of Image Analysis, Video Object Tracking, and Data Mining of Biological Images using the Open Source MATLAB Toolbox Gait-CAD , 2012 .

[38]  Andreas Stemmer,et al.  Image-Based Fluidic Sorting System for Automated Zebrafish Egg Sorting into Multiwell Plates , 2011, Journal of laboratory automation.

[39]  Andrés Santos,et al.  Methodology for Reconstructing Early Zebrafish Development From In Vivo Multiphoton Microscopy , 2012, IEEE Transactions on Image Processing.

[40]  Alessandro Sarti,et al.  Cells Segmentation From 3-D Confocal Images of Early Zebrafish Embryogenesis , 2010, IEEE Transactions on Image Processing.

[41]  Xiaoyin Xu,et al.  Computational techniques in zebrafish image processing and analysis , 2013, Journal of Neuroscience Methods.

[42]  Nadine Peyriéras,et al.  Segmentation of 3D cell membrane images by PDE methods and its applications , 2011, Comput. Biol. Medicine.

[43]  Philipp J. Keller,et al.  Reconstruction of Zebrafish Early Embryonic Development by Scanned Light Sheet Microscopy , 2008, Science.

[44]  Periklis Pantazis,et al.  Surface functionalization of barium titanate SHG nanoprobes for in vivo imaging in zebrafish , 2012, Nature Protocols.

[45]  Alessandro Sarti,et al.  4D Embryogenesis image analysis using PDE methods of image processing , 2010, Kybernetika.

[46]  Michael Liebling,et al.  In vivo, high-throughput imaging for functional characterization of the embryonic zebrafish heart , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[47]  H Burkhardt,et al.  XuvTools: free, fast and reliable stitching of large 3D datasets , 2009, Journal of microscopy.

[48]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[49]  Xiaobo Zhou,et al.  An Automated Method for Cell Detection in Zebrafish , 2008, Neuroinformatics.

[50]  Achim Streit,et al.  LAMBDA -- The LSDF Execution Framework for Data Intensive Applications , 2012, 2012 20th Euromicro International Conference on Parallel, Distributed and Network-based Processing.

[51]  David Pastor-Escuredo,et al.  $3D+t$ Morphological Processing: Applications to Embryogenesis Image Analysis , 2012, IEEE Transactions on Image Processing.

[52]  Evan J. Kyzar,et al.  Three-Dimensional Neurophenotyping of Adult Zebrafish Behavior , 2011, PloS one.

[53]  Miguel A. Luengo-Oroz,et al.  Wavelet-based image fusion in multi-view three-dimensional microscopy , 2012, Bioinform..

[54]  B. S. Manjunath,et al.  Biological imaging software tools , 2012, Nature Methods.

[55]  Karen Ocorr,et al.  Semi-automated Optical Heartbeat Analysis of small hearts. , 2009, Journal of visualized experiments : JoVE.

[56]  Chris Allan,et al.  OME Remote Objects (OMERO): a flexible, model-driven data management system for experimental biology , 2012, Nature Methods.

[57]  Tetsu Nemoto,et al.  A computer image processing system for quantification of zebrafish behavior , 2004, Journal of Neuroscience Methods.

[58]  Xinghua Lou Biomedical Data Analysis with Prior Knowledge : Modeling and Learning , 2011 .

[59]  Thomas Brox,et al.  Multiview Deblurring for 3-D Images from Light-Sheet-Based Fluorescence Microscopy , 2012, IEEE Transactions on Image Processing.

[60]  Yizhou Yu,et al.  Interactive Image Segmentation Based on Level Sets of Probabilities , 2012, IEEE Transactions on Visualization and Computer Graphics.

[61]  Gerald Brenner-Weiss,et al.  A Chemical Screening System for Glucocorticoid Stress Hormone Signaling in an Intact Vertebrate , 2012, ACS chemical biology.

[62]  Erik Meijering,et al.  Methods for cell and particle tracking. , 2012, Methods in enzymology.

[63]  Alessandro Sarti,et al.  3D early embryogenesis image filtering by nonlinear partial differential equations , 2010, Medical Image Anal..

[64]  Ullrich Köthe,et al.  Deltr: Digital embryo lineage tree reconstructor , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[65]  Michael J. Parsons,et al.  Automated Reporter Quantification In Vivo: High-Throughput Screening Method for Reporter-Based Assays in Zebrafish , 2012, PloS one.

[66]  Nicolas Chenouard,et al.  Icy: an open bioimage informatics platform for extended reproducible research , 2012, Nature Methods.

[67]  Wim De Coen,et al.  Locomotor activity in zebrafish embryos: a new method to assess developmental neurotoxicity. , 2010, Neurotoxicology and teratology.

[68]  Julie H. Simpson,et al.  BrainAligner: 3D Registration Atlases of Drosophila Brains , 2011, Nature Methods.

[69]  Robbert Creton,et al.  Automated analysis of behavior in zebrafish larvae , 2009, Behavioural Brain Research.

[70]  M. Paule,et al.  In vivo imaging and quantitative analysis of changes in axon length using transgenic zebrafish embryos. , 2011, Neurotoxicology and teratology.

[71]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[72]  Mehmet Fatih Yanik,et al.  High-throughput in vivo vertebrate screening , 2010, Nature Methods.

[73]  Markus Reischl,et al.  Robust identification of coagulated zebrafish eggs using image processing and classification techniques , 2009 .

[74]  L Shamir,et al.  Assessing the efficacy of low‐level image content descriptors for computer‐based fluorescence microscopy image analysis , 2011, Journal of microscopy.

[75]  Raphaël Marée,et al.  Automatic Localization of Interest Points in Zebrafish Images with Tree-Based Methods , 2011, PRIB.

[76]  Ying Cao,et al.  Chemical modifier screen identifies HDAC inhibitors as suppressors of PKD models , 2009, Proceedings of the National Academy of Sciences.

[77]  Olaf Ronneberger,et al.  Comprehensive catecholaminergic projectome analysis reveals single-neuron integration of zebrafish ascending and descending dopaminergic systems , 2011, Nature communications.

[78]  Stephan Saalfeld,et al.  Software for bead-based registration of selective plane illumination microscopy data , 2010, Nature Methods.

[79]  Nadine Peyriéras,et al.  4D Numerical Schemes for Cell Image Segmentation and Tracking. , 2011 .

[80]  A. Vogt,et al.  A high-content screening assay in transgenic zebrafish identifies two novel activators of fgf signaling. , 2011, Birth defects research. Part C, Embryo today : reviews.

[81]  A. Roach,et al.  Zebrafish offer the potential for a primary screen to identify a wide variety of potential anticonvulsants , 2007, Epilepsy Research.

[82]  D H Brooks,et al.  Automated identification of neurons in 3D confocal datasets from zebrafish brainstem , 2009, Journal of microscopy.

[83]  Shuk Han Cheng,et al.  Noninvasive technique for measurement of heartbeat regularity in zebrafish (Danio rerio) embryos , 2009, BMC biotechnology.

[84]  Christian Laggner,et al.  Rapid behavior—based identification of neuroactive small molecules in the zebrafish , 2009, Nature chemical biology.

[85]  Xiaoyin Xu,et al.  A High-Throughput Analysis Method to Detect Regions of Interest and Quantify Zebrafish Embryo Images , 2010, Journal of biomolecular screening.

[86]  Christopher Lynnes,et al.  KDD Services at the Goddard Earth Sciences Distributed Active Archive Center , 2001 .

[87]  Fred A. Hamprecht,et al.  Structured Learning for Cell Tracking , 2011, NIPS.

[88]  Drew N. Robson,et al.  Brain-wide neuronal dynamics during motor adaptation in zebrafish , 2012, Nature.

[89]  Christian Pylatiuk,et al.  High-Throughput Screening of Zebrafish Embryos Using Automated Heart Detection and Imaging , 2012, Journal of laboratory automation.

[90]  Thomas Brox,et al.  ViBE-Z: a framework for 3D virtual colocalization analysis in zebrafish larval brains , 2012, Nature Methods.

[91]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[92]  C. Rueden,et al.  Metadata matters: access to image data in the real world , 2010, The Journal of cell biology.

[93]  S. Fraser,et al.  PhOTO Zebrafish: A Transgenic Resource for In Vivo Lineage Tracing during Development and Regeneration , 2012, PloS one.

[94]  Joachim Wittbrodt,et al.  Quantitative analysis of embryogenesis: a perspective for light sheet microscopy. , 2012, Developmental cell.

[95]  Jeroen Bakkers,et al.  Zebrafish as a model to study cardiac development and human cardiac disease , 2011, Cardiovascular research.

[96]  Oliver Bandmann,et al.  Zebrafish as a new animal model for movement disorders , 2008, Journal of neurochemistry.

[97]  Ambuj K. Singh,et al.  Bisque: a platform for bioimage analysis and management , 2009, Bioinform..

[98]  J. Livet,et al.  Multicolor Brainbow imaging in zebrafish. , 2011, Cold Spring Harbor protocols.

[99]  Annemarie H Meijer,et al.  Identification and real-time imaging of a myc-expressing neutrophil population involved in inflammation and mycobacterial granuloma formation in zebrafish. , 2008, Developmental and comparative immunology.

[100]  Monte Westerfield,et al.  The zebrafish : disease models and chemical screens , 2011 .

[101]  Ullrich Köthe,et al.  A Discrete Chain Graph Model for 3d+t Cell Tracking with High Misdetection Robustness , 2012, ECCV.

[102]  Thorsten Meinl,et al.  KNIME: The Konstanz Information Miner , 2007, GfKl.

[103]  Urban Liebel,et al.  A high-throughput chemically induced inflammation assay in zebrafish , 2010, BMC Biology.

[104]  M. Luengo-Oroz,et al.  Image analysis for understanding embryo development: a bridge from microscopy to biological insights. , 2011, Current opinion in genetics & development.

[105]  Edward A Burton,et al.  Automated measurement of zebrafish larval movement , 2011, The Journal of physiology.

[106]  Ranjeet Devarakonda,et al.  Data sharing and retrieval using OAI-PMH , 2011, Earth Sci. Informatics.

[107]  Periklis Pantazis,et al.  Second harmonic generating (SHG) nanoprobes for in vivo imaging , 2010, Proceedings of the National Academy of Sciences.