GAMer 2: A system for 3D mesh processing of cellular electron micrographs

Recent advances in electron microscopy have, for the first time, enabled imaging of single cells in 3D at a nanometer length scale resolution. An uncharted frontier for in silico biology is the ability to simulate cellular processes using these observed geometries. Enabling such simulations will require a system for going from electron micrographs to 3D volume meshes, which can then form the basis of computer simulations of such processes using numerical techniques such as the Finite Element Method (FEM). In this paper, we develop an end-to-end pipeline for this task by adapting and extending computer graphics mesh processing and smoothing algorithms. Our workflow makes use of our recently rewritten mesh processing software, GAMer 2, which implements several mesh conditioning algorithms and serves as a platform to connect different pipeline steps. We apply this pipeline to a series of electron micrographs of neuronal dendrite morphology explored at three different length scales and demonstrate that the resultant meshes are suitable for finite element simulations. Our pipeline, which consists of free and open-source community driven tools, is a step towards routine physical simulations of biological processes in realistic geometries. We posit that a new frontier at the intersection of computational technologies and single cell biology is now open. Innovations in algorithms to reconstruct and simulate cellular length scale phenomena based on emerging structural data will enable realistic physical models and advance discovery. Author summary 3D imaging of cellular components and associated reconstruction methods have made great strides in the past decade, opening windows into the complex intraceullar organization. These advances also mean that computational tools need to be developed to work with these images not just for purposes of visualization but also for biophysical simulations. Here, we describe a pipeline that takes images from electron microscopy as input and produces smooth surface and volume meshes as output. These meshes are suitable for building high-quality finite element simulations of cellular processes modeled by ordinary and partial differential equations, bringing us closer to realizing the goal of generating high-resolution simulations of such phenomena in realistic geometries. We demonstrate the utility of this pipeline by meshing 3D reconstructions of dendritic spines, calculating the curvatures of the different component membranes, and conducting finite-element simulations of reaction-diffusion equations using the generated meshes. The software tools employed in our pipeline are community driven, open source, and free. We believe that technologies such as those presented will enable a new frontier in biophysical simulations in realistic geometries.

[1]  Michael Holst,et al.  Efficient mesh optimization schemes based on Optimal Delaunay Triangulations , 2011 .

[2]  Michael J. Holst,et al.  Feature-preserving surface mesh smoothing via suboptimal Delaunay triangulation , 2013, Graph. Model..

[3]  Davi D Bock,et al.  Volume electron microscopy for neuronal circuit reconstruction , 2012, Current Opinion in Neurobiology.

[4]  C. Genoud,et al.  Volume scanning electron microscopy for imaging biological ultrastructure , 2016, Biology of the cell.

[5]  T. Bartol,et al.  Monte Carlo Methods for Simulating Realistic Synaptic Microphysiology Using MCell , 2000 .

[6]  J. Shewchuk What Is a Good Linear Finite Element? Interpolation, Conditioning, Anisotropy, and Quality Measures , 2002 .

[7]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[8]  Zeyun Yu,et al.  High-Fidelity Geometric Modelling for Biomedical Applications , 2008 .

[9]  Joachim Schöberl,et al.  NETGEN An advancing front 2D/3D-mesh generator based on abstract rules , 1997 .

[10]  Bernardo L. Sabatini,et al.  Biphasic Synaptic Ca Influx Arising from Compartmentalized Electrical Signals in Dendritic Spines , 2009, PLoS biology.

[11]  Erik De Schutter,et al.  Parallel STEPS: Large Scale Stochastic Spatial Reaction-Diffusion Simulation with High Performance Computers , 2016, Front. Neuroinform..

[12]  Terrence J. Sejnowski,et al.  VolRoverN: Enhancing Surface and Volumetric Reconstruction for Realistic Dynamical Simulation of Cellular and Subcellular Function , 2013, Neuroinformatics.

[13]  Harald F Hess,et al.  Contacts between the endoplasmic reticulum and other membranes in neurons , 2017, Proceedings of the National Academy of Sciences.

[14]  David M. Beazley,et al.  Automated scientific software scripting with SWIG , 2003, Future Gener. Comput. Syst..

[15]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[16]  Padmini Rangamani,et al.  Geometric Control of Frequency Modulation of cAMP Oscillations due to Calcium in Dendritic Spines , 2019, Biophysical journal.

[17]  Eric T. Trautman,et al.  A Complete Electron Microscopy Volume of the Brain of Adult Drosophila melanogaster , 2017, Cell.

[18]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Vito Mennella,et al.  Super-Resolution Microscopy: From Single Molecules to Supramolecular Assemblies. , 2015, Trends in cell biology.

[20]  Johan Hattne,et al.  Stochastic reaction-diffusion simulation with MesoRD , 2005, Bioinform..

[21]  Hans-Peter Seidel,et al.  A General Framework for Mesh Decimation , 1998, Graphics Interface.

[22]  B. Jähne,et al.  A tensor approach for local structure analysis in multi-dimensional images , 1996 .

[23]  D. Bray,et al.  Receptor clustering as a cellular mechanism to control sensitivity , 1998, Nature.

[24]  Michael J. Holst,et al.  The Implementation of the Colored Abstract Simplicial Complex and Its Application to Mesh Generation , 2019, ACM Trans. Math. Softw..

[25]  T. Sejnowski,et al.  Dendritic spine geometry and spine apparatus organization govern the spatiotemporal dynamics of calcium , 2019, The Journal of general physiology.

[26]  T. Bartol,et al.  Miniature endplate current rise times less than 100 microseconds from improved dual recordings can be modeled with passive acetylcholine diffusion from a synaptic vesicle. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[27]  J Andrew McCammon,et al.  Feature-preserving adaptive mesh generation for molecular shape modeling and simulation. , 2008, Journal of molecular graphics & modelling.

[28]  Kenji Shimada,et al.  An Angle-Based Approach to Two-Dimensional Mesh Smoothing , 2000, IMR.

[29]  G. Dziuk Finite Elements for the Beltrami operator on arbitrary surfaces , 1988 .

[30]  Ravi Iyengar,et al.  Decoding Information in Cell Shape , 2013, Cell.

[31]  Daniele Panozzo,et al.  Tetrahedral meshing in the wild , 2018, ACM Trans. Graph..

[32]  J R Kremer,et al.  Computer visualization of three-dimensional image data using IMOD. , 1996, Journal of structural biology.

[33]  Johannes E. Schindelin,et al.  TrakEM2 Software for Neural Circuit Reconstruction , 2012, PloS one.

[34]  Bernardo L Sabatini,et al.  Neuronal Activity Regulates Diffusion Across the Neck of Dendritic Spines , 2005, Science.

[35]  Alan Demlow,et al.  Higher-Order Finite Element Methods and Pointwise Error Estimates for Elliptic Problems on Surfaces , 2009, SIAM J. Numer. Anal..

[36]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[37]  G. Knott,et al.  Serial Section Scanning Electron Microscopy of Adult Brain Tissue Using Focused Ion Beam Milling , 2008, The Journal of Neuroscience.

[38]  Herbert Edelsbrunner,et al.  An incremental algorithm for Betti numbers of simplicial complexes on the 3-sphere , 1995, Comput. Aided Geom. Des..

[39]  K. Svoboda,et al.  Ca2+ signaling in dendritic spines , 2001, Current Opinion in Neurobiology.

[40]  Wing Kam Liu,et al.  Nonlinear Finite Elements for Continua and Structures , 2000 .

[41]  Alan Demlow,et al.  An Adaptive Finite Element Method for the Laplace-Beltrami Operator on Implicitly Defined Surfaces , 2007, SIAM J. Numer. Anal..

[42]  Carl-Fredrik Westin,et al.  Representing Local Structure Using Tensors II , 2011, SCIA.

[43]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[44]  Ravi Iyengar,et al.  Geometric principles of second messenger dynamics in dendritic spines , 2019, Scientific Reports.

[45]  Narayanan Kasthuri,et al.  Stacked Endoplasmic Reticulum Sheets Are Connected by Helicoidal Membrane Motifs , 2013, Cell.

[46]  Marc Pouget,et al.  Estimating differential quantities using polynomial fitting of osculating jets , 2003, Comput. Aided Geom. Des..

[47]  Yongjie Zhang,et al.  3D Finite Element Meshing from Imaging Data. , 2005, Computer methods in applied mechanics and engineering.

[48]  Mark Meyer,et al.  Implicit fairing of irregular meshes using diffusion and curvature flow , 1999, SIGGRAPH.

[49]  Pascal Fua,et al.  The effects of aging on neuropil structure in mouse somatosensory cortex—A 3D electron microscopy analysis of layer 1 , 2018, PloS one.

[50]  W. Marshall,et al.  Differential Geometry Meets the Cell , 2013, Cell.

[51]  Padmini Rangamani,et al.  Geometric control of frequency modulation of cAMP oscillations due to Ca2+-bursts in dendritic spines , 2019, bioRxiv.

[52]  D. Resasco,et al.  Virtual Cell: computational tools for modeling in cell biology , 2012, Wiley interdisciplinary reviews. Systems biology and medicine.

[53]  Matthew B Stone,et al.  Super-Resolution Microscopy: Shedding Light on the Cellular Plasma Membrane. , 2017, Chemical reviews.

[54]  Shira Knafo,et al.  PIP3 controls synaptic function by maintaining AMPA receptor clustering at the postsynaptic membrane , 2009, Nature Neuroscience.

[55]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[56]  J. Bourne,et al.  Uniform Serial Sectioning for Transmission Electron Microscopy , 2006, The Journal of Neuroscience.

[57]  Erik De Schutter,et al.  Accurate Reaction-Diffusion Operator Splitting on Tetrahedral Meshes for Parallel Stochastic Molecular Simulations , 2015, The Journal of chemical physics.

[58]  P. Rangamani,et al.  Cell shape regulates subcellular organelle location to control early Ca2+ signal dynamics in vascular smooth muscle cells , 2018, Scientific Reports.

[59]  V. Parthasarathy,et al.  A comparison of tetrahedron quality measures , 1994 .

[60]  Michael J. Holst,et al.  Adaptive Numerical Treatment of Elliptic Systems on Manifolds , 2001, Adv. Comput. Math..

[61]  Padmini Rangamani,et al.  Computational Modeling Reveals Frequency Modulation of Calcium-cAMP/PKA Pathway in Dendritic Spines , 2019, Biophysical journal.

[62]  Pierre Alliez,et al.  Error-Bounded and Feature Preserving Surface Remeshing with Minimal Angle Improvement , 2017, IEEE Transactions on Visualization and Computer Graphics.

[63]  Hang Si,et al.  TetGen, a Delaunay-Based Quality Tetrahedral Mesh Generator , 2015, ACM Trans. Math. Softw..

[64]  Mason A. Porter,et al.  A roadmap for the computation of persistent homology , 2015, EPJ Data Science.

[65]  Bertrand R. Caré,et al.  Receptor clustering affects signal transduction at the membrane level in the reaction-limited regime. , 2013 .

[66]  Andrew Gillette,et al.  Finite Element Exterior Calculus for Evolution Problems , 2012, 1202.1573.

[67]  Purbasha Sarkar,et al.  From Voxels to Knowledge: A Practical Guide to the Segmentation of Complex Electron Microscopy 3D-Data , 2014, Journal of visualized experiments : JoVE.

[68]  S Borrett,et al.  Reporting methods for processing and analysis of data from serial block face scanning electron microscopy , 2016, Journal of microscopy.

[69]  Andreas Hellander,et al.  URDME: a modular framework for stochastic simulation of reaction-transport processes in complex geometries , 2012, BMC Systems Biology.

[70]  José Jesús Fernández,et al.  An improved algorithm for anisotropic nonlinear diffusion for denoising cryo-tomograms. , 2003, Journal of structural biology.

[71]  D. Arnold,et al.  Finite element exterior calculus: From hodge theory to numerical stability , 2009, 0906.4325.

[72]  Kuo-Young Cheng,et al.  A sharpness dependent filter for mesh smoothing , 2005, Comput. Aided Geom. Des..

[73]  Hans-Christian Hege,et al.  Visualization and Mathematics III , 2011 .

[74]  Andrew T. T. McRae,et al.  Automating the solution of PDEs on the sphere and other manifolds in FEniCS 1.2 , 2013 .

[75]  Chandrajit L. Bajaj,et al.  Surface Smoothing and Quality Improvement of Quadrilateral/Hexahedral Meshes with Geometric Flow. , 2005 .

[76]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[77]  Lucas Pelkmans,et al.  Multiplexed protein maps link subcellular organization to cellular states , 2018, Science.

[78]  Yoko Shibata,et al.  Mechanisms Determining the Morphology of the Peripheral ER , 2010, Cell.

[79]  Bernardo L. Sabatini,et al.  NMDA Receptor-Mediated Calcium Transients in Dendritic Spines , 2009 .

[80]  Tony DeRose,et al.  Mesh optimization , 1993, SIGGRAPH.

[81]  M. Holst,et al.  Finite Element Exterior Calculus for Parabolic Evolution Problems on Riemannian Hypersurfaces , 2015, Journal of Computational Mathematics.

[82]  M. Sheng,et al.  The postsynaptic organization of synapses. , 2011, Cold Spring Harbor perspectives in biology.

[83]  P. Magistretti,et al.  3D cellular reconstruction of cortical glia and parenchymal morphometric analysis from Serial Block-Face Electron Microscopy of juvenile rat , 2019, Progress in Neurobiology.

[84]  Anders Logg,et al.  The FEniCS Project Version 1.5 , 2015 .

[85]  Erik De Schutter,et al.  STEPS: efficient simulation of stochastic reaction–diffusion models in realistic morphologies , 2012, BMC Systems Biology.

[86]  Craig Gotsman,et al.  Online reconstruction of 3D objects from arbitrary cross-sections , 2011, TOGS.

[87]  M. Helmstaedter,et al.  Dense connectomic reconstruction in layer 4 of the somatosensory cortex , 2018, Science.

[88]  Frédo Durand,et al.  Non-iterative, feature-preserving mesh smoothing , 2003, ACM Trans. Graph..

[89]  Zeyun Yu,et al.  A segmentation-free approach for skeletonization of gray-scale images via anisotropic vector diffusion , 2004, CVPR 2004.

[90]  Christophe Geuzaine,et al.  Gmsh: A 3‐D finite element mesh generator with built‐in pre‐ and post‐processing facilities , 2009 .

[91]  John E. Stone,et al.  Lattice microbes: High‐performance stochastic simulation method for the reaction‐diffusion master equation , 2013, J. Comput. Chem..

[92]  William R. Gray Roncal,et al.  Saturated Reconstruction of a Volume of Neocortex , 2015, Cell.

[93]  Scott B. Baden,et al.  Fast Monte Carlo Simulation Methods for Biological Reaction-Diffusion Systems in Solution and on Surfaces , 2008, SIAM J. Sci. Comput..

[94]  Michael J. Holst,et al.  Geometric Variational Crimes: Hilbert Complexes, Finite Element Exterior Calculus, and Problems on Hypersurfaces , 2010, Foundations of Computational Mathematics.

[95]  Michael J. Holst,et al.  Semilinear Mixed Problems on Hilbert Complexes and Their Numerical Approximation , 2010, Foundations of Computational Mathematics.

[96]  Herbert Edelsbrunner,et al.  Topology preserving edge contraction , 1998 .

[97]  M. Zaccolo,et al.  The Role of Type 4 Phosphodiesterases in Generating Microdomains of cAMP: Large Scale Stochastic Simulations , 2010, PloS one.

[98]  Joshua Vaughan,et al.  A model for the generation and interconversion of ER morphologies , 2014, Proceedings of the National Academy of Sciences.

[99]  Yasuo Kawaguchi,et al.  Large Volume Electron Microscopy and Neural Microcircuit Analysis , 2018, Front. Neural Circuits.

[100]  C. Peddie,et al.  Exploring the third dimension: volume electron microscopy comes of age. , 2014, Micron.

[101]  Ravi Iyengar,et al.  Cell Shape and Negative Links in Regulatory Motifs Together Control Spatial Information Flow in Signaling Networks , 2008, Cell.

[102]  D. Bray,et al.  Stochastic simulation of chemical reactions with spatial resolution and single molecule detail , 2004, Physical biology.

[103]  Christopher J. Obara,et al.  Increased spatiotemporal resolution reveals highly dynamic dense tubular matrices in the peripheral ER , 2016, Science.

[104]  H. Knutsson Representing Local Structure Using Tensors , 1989 .

[105]  W. Denk,et al.  Serial Block-Face Scanning Electron Microscopy to Reconstruct Three-Dimensional Tissue Nanostructure , 2004, PLoS biology.

[106]  Jean-Daniel Boissonnat,et al.  Three-dimensional reconstruction of complex shapes based on the Delaunay triangulation , 1993, Electronic Imaging.

[107]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[108]  L. Váša,et al.  Mesh Statistics for Robust Curvature Estimation , 2016, Comput. Graph. Forum.

[109]  Ritvik Vasan,et al.  Applications and Challenges of Machine Learning to Enable Realistic Cellular Simulations , 2019, Frontiers in Physics.

[110]  Paolo Cignoni,et al.  A comparison of mesh simplification algorithms , 1998, Comput. Graph..

[111]  Jean-Marie Morvan,et al.  On the angular defect of triangulations and the pointwise approximation of curvatures , 2003, Comput. Aided Geom. Des..

[112]  Christel Genoud,et al.  Is EM dead? , 2013, Journal of Cell Science.

[113]  Michael J. Holst,et al.  Quality tetrahedral mesh smoothing via boundary-optimized Delaunay triangulation , 2012, Comput. Aided Geom. Des..