Image analysis and interactive visualization techniques for electron microscopy tomograms

Images are an important data source in modern science and engineering. A continued challenge is to perform measurements on and extract useful information from the image data, i.e., to perform image analysis. Additionally, the image analysis results need to be visualized for best comprehension and to enable correct assessments. In this thesis, research is presented about digital image analysis and three-dimensional (3-D) visualization techniques for use with transmission electron microscopy (TEM) image data and in particular electron tomography, which provides 3-D reconstructions of the nano-structures. The electron tomograms are difficult to interpret because of, e.g., low signal-to-noise ratio, artefacts that stem from sample preparation and insufficient reconstruction information. Analysis is often performed by visual inspection or by registration, i.e., fitting, of molecular models to the image data. Setting up a visualization can however be tedious, and there may be large intra- and inter-user variation in how visualization parameters are set. Therefore, one topic studied in this thesis concerns automatic setup of the transfer function used in direct volume rendering of these tomograms. Results indicate that histogram and gradient based measures are useful in producing automatic and coherent visualizations. Furthermore, research has been conducted concerning registration of templates built using molecular models. Explorative visualization techniques are presented that can provide means of visualizing and navigating model parameter spaces. This gives a new type of visualization feedback to the biologist interpretating the TEM data. The introduced probabilistic template has an improved coverage of the molecular flexibility, by incorporating several conformations into a static model. Evaluation by cross-validation shows that the probabilistic template gives a higher correlation response than using a Protein Databank (PDB) devised model. The software ProViz (for Protein Visualization) is also introduced, where selected developed techniques have been incorporated and are demonstrated in practice.

[1]  Gabor T. Herman,et al.  Image Reconstruction From Projections , 1975, Real Time Imaging.

[2]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.

[3]  R. Nussinov,et al.  Sequence dependence of C-end rule peptides in binding and activation of neuropilin-1 receptor. , 2013, Journal of structural biology.

[4]  J. Dubochet,et al.  Cryo-electron microscopy of viruses , 1984, Nature.

[5]  Niels Volkmann,et al.  Confidence intervals for fitting of atomic models into low-resolution densities , 2009, Acta crystallographica. Section D, Biological crystallography.

[6]  P. Gilbert Iterative methods for the three-dimensional reconstruction of an object from projections. , 1972, Journal of theoretical biology.

[7]  J R Kremer,et al.  Computer visualization of three-dimensional image data using IMOD. , 1996, Journal of structural biology.

[8]  Jean-Michel Dischler,et al.  Second Order Pre-Integrated Volume Rendering , 2008, 2008 IEEE Pacific Visualization Symposium.

[9]  Wolfgang Baumeister,et al.  A visual approach to proteomics , 2006, Nature Reviews Molecular Cell Biology.

[10]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[11]  S Bals,et al.  3D Imaging of Nanomaterials by Discrete Tomography , 2006, Microscopy and Microanalysis.

[12]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[13]  Stefan Birmanns,et al.  Using Sculptor and Situs for simultaneous assembly of atomic components into low-resolution shapes. , 2011, Journal of structural biology.

[14]  Thomas Ertl,et al.  Smart Hardware-Accelerated Volume Rendering , 2003, VisSym.

[15]  David W Ritchie,et al.  gEMfitter: a highly parallel FFT-based 3D density fitting tool with GPU texture memory acceleration. , 2013, Journal of structural biology.

[16]  G T Herman,et al.  ART: mathematics and applications. A report on the mathematical foundations and on the applicability to real data of the algebraic reconstruction techniques. , 1973, Journal of theoretical biology.

[17]  Conrad C. Huang,et al.  UCSF Chimera, MODELLER, and IMP: an integrated modeling system. , 2012, Journal of structural biology.

[18]  A. Besson,et al.  Direct electron imaging in electron microscopy with monolithic active pixel sensors. , 2007, Ultramicroscopy.

[19]  P. Chacón,et al.  Multi-resolution contour-based fitting of macromolecular structures. , 2002, Journal of molecular biology.

[20]  William E. Lorensen,et al.  The Transfer Function Bake-Off , 2001, IEEE Computer Graphics and Applications.

[21]  Christof Rezk-Salama,et al.  High-Level User Interfaces for Transfer Function Design with Semantics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[22]  Leonardo G. Trabuco,et al.  Flexible fitting of atomic structures into electron microscopy maps using molecular dynamics. , 2008, Structure.

[23]  I. Yamashita,et al.  Lipid Nanotube Encapsulating Method in Low-Energy Scanning Transmission Electron Microscopy Analyses , 2009 .

[24]  Danny C. Sorensen,et al.  Simulating nanoscale functional motions of biomolecules , 2006 .

[25]  J. Frank Electron tomography : methods for three-dimensional visualization of structures in the cell , 2005 .

[26]  N. Volkmann,et al.  Quantitative fitting of atomic models into observed densities derived by electron microscopy. , 1999, Journal of structural biology.

[27]  A. Roseman Docking structures of domains into maps from cryo-electron microscopy using local correlation. , 2000, Acta crystallographica. Section D, Biological crystallography.

[28]  Valerio Pascucci,et al.  The contour spectrum , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[29]  Frederick P. Brooks,et al.  Force display performs better than visual display in a simple 6-D docking task , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[30]  Joe Michael Kniss,et al.  Gaussian transfer functions for multi-field volume visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[31]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[32]  Ross T. Whitaker,et al.  Curvature-based transfer functions for direct volume rendering: methods and applications , 2003, IEEE Visualization, 2003. VIS 2003..

[33]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[34]  Mark Horowitz,et al.  Markov random field based automatic image alignment for electron tomography. , 2007, Journal of structural biology.

[35]  Stuart Kleinfelder,et al.  Active pixel sensor array as a detector for electron microscopy. , 2005, Ultramicroscopy.

[36]  Ivan Grubisic,et al.  Biased coarse-grained molecular dynamics simulation approach for flexible fitting of X-ray structure into cryo electron microscopy maps. , 2010, Journal of structural biology.

[37]  M. Rossmann,et al.  Fitting atomic models into electron-microscopy maps. , 2000, Acta crystallographica. Section D, Biological crystallography.

[38]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[39]  Sriram Subramaniam,et al.  Shape-Based Regularization of Electron Tomographic Reconstruction , 2012, IEEE Transactions on Medical Imaging.

[40]  Jinho Lee The Transfer Function BakeOff , 2001 .

[41]  D. J. De Rosier,et al.  Reconstruction of Three Dimensional Structures from Electron Micrographs , 1968, Nature.

[42]  M. Ament,et al.  Volume Rendering , 2015 .

[43]  K Schulten,et al.  VMD: visual molecular dynamics. , 1996, Journal of molecular graphics.

[44]  Stefan Birmanns,et al.  Interactive fitting augmented by force-feedback and virtual reality. , 2003, Journal of structural biology.

[45]  Marek Orzechowski,et al.  Flexible fitting of high-resolution x-ray structures into cryoelectron microscopy maps using biased molecular dynamics simulations. , 2008, Biophysical journal.

[46]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[47]  G Bricogne,et al.  Maximum-entropy three-dimensional reconstruction with deconvolution of the contrast transfer function: a test application with adenovirus. , 1996, Journal of structural biology.

[48]  W Wriggers,et al.  Modeling tricks and fitting techniques for multiresolution structures. , 2001, Structure.

[49]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[50]  Gabor T. Herman,et al.  Image reconstruction from projections : implementation and applications , 1979 .

[51]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[52]  J. Mccammon,et al.  Situs: A package for docking crystal structures into low-resolution maps from electron microscopy. , 1999, Journal of structural biology.

[53]  M. Baker,et al.  Bridging the information gap: computational tools for intermediate resolution structure interpretation. , 2001, Journal of molecular biology.

[54]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[55]  M. Topf,et al.  Scoring functions for cryoEM density fitting. , 2011, Journal of structural biology.

[56]  Conrad C. Huang,et al.  UCSF Chimera—A visualization system for exploratory research and analysis , 2004, J. Comput. Chem..