A novel fully automatic scheme for fiducial marker-based alignment in electron tomography.

Although the topic of fiducial marker-based alignment in electron tomography (ET) has been widely discussed for decades, alignment without human intervention remains a difficult problem. Specifically, the emergence of subtomogram averaging has increased the demand for batch processing during tomographic reconstruction; fully automatic fiducial marker-based alignment is the main technique in this process. However, the lack of an accurate method for detecting and tracking fiducial markers precludes fully automatic alignment. In this paper, we present a novel, fully automatic alignment scheme for ET. Our scheme has two main contributions: First, we present a series of algorithms to ensure a high recognition rate and precise localization during the detection of fiducial markers. Our proposed solution reduces fiducial marker detection to a sampling and classification problem and further introduces an algorithm to solve the parameter dependence of marker diameter and marker number. Second, we propose a novel algorithm to solve the tracking of fiducial markers by reducing the tracking problem to an incomplete point set registration problem. Because a global optimization of a point set registration occurs, the result of our tracking is independent of the initial image position in the tilt series, allowing for the robust tracking of fiducial markers without pre-alignment. The experimental results indicate that our method can achieve an accurate tracking, almost identical to the current best one in IMOD with half automatic scheme. Furthermore, our scheme is fully automatic, depends on fewer parameters (only requires a gross value of the marker diameter) and does not require any manual interaction, providing the possibility of automatic batch processing of electron tomographic reconstruction.

[1]  Albert F. Lawrence,et al.  Non-linear Bundle Adjustment for Electron Tomography , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[2]  Sandip Das,et al.  Simple algorithms for partial point set pattern matching under rigid motion , 2006, Pattern Recognit..

[3]  K. Taylor,et al.  Accurate marker-free alignment with simultaneous geometry determination and reconstruction of tilt series in electron tomography. , 2006, Ultramicroscopy.

[4]  Mark H Ellisman,et al.  Transform-based backprojection for volume reconstruction of large format electron microscope tilt series. , 2006, Journal of structural biology.

[5]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Daniel P. Huttenlocher,et al.  Fast affine point matching: an output-sensitive method , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Meng Cao,et al.  An automatic method of detecting and tracking fiducial markers for alignment in electron tomography. , 2011, Journal of electron microscopy.

[9]  John W Sedat,et al.  UCSF tomography: an integrated software suite for real-time electron microscopic tomographic data collection, alignment, and reconstruction. , 2007, Journal of structural biology.

[10]  J Heikkonen,et al.  Multiphase method for automatic alignment of transmission electron microscope images using markers. , 2001, Journal of structural biology.

[11]  Lihua Zhang,et al.  Genetic algorithm for affine point pattern matching , 2003, Pattern Recognit. Lett..

[12]  J. Frank Electron tomography : methods for three-dimensional visualization of structures in the cell , 2005 .

[13]  J. Briggs Structural biology in situ--the potential of subtomogram averaging. , 2013, Current opinion in structural biology.

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  Hanspeter Winkler,et al.  Marker-free dual-axis tilt series alignment. , 2013, Journal of structural biology.

[16]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[17]  Sébastien Phan,et al.  TxBR montage reconstruction for large field electron tomography. , 2012, Journal of structural biology.

[18]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[19]  Mark Horowitz,et al.  Markov random field based automatic image alignment for electron tomography. , 2007, Journal of structural biology.

[20]  Achilleas S Frangakis,et al.  Alignator: a GPU powered software package for robust fiducial-less alignment of cryo tilt-series. , 2010, Journal of structural biology.

[21]  José María Carazo,et al.  Marker-free image registration of electron tomography tilt-series , 2009, BMC Bioinformatics.

[22]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[23]  Michael C. Lawrence,et al.  Least-Squares Method of Alignment Using Markers , 1992 .

[24]  R. Guckenberger Determination of a common origin in the micrographs of tilt series in three-dimensional electron microscopy , 1982 .

[25]  D Ress,et al.  Automatic acquisition of fiducial markers and alignment of images in tilt series for electron tomography. , 1999, Journal of electron microscopy.

[26]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  J Frank,et al.  A marker-free alignment method for electron tomography. , 1995, Ultramicroscopy.

[28]  Salvatore Lanzavecchia,et al.  Simultaneous alignment of dual-axis tilt series. , 2010, Journal of structural biology.

[29]  Shimon Ullman,et al.  Recognizing solid objects by alignment with an image , 1990, International Journal of Computer Vision.

[30]  J R Kremer,et al.  Computer visualization of three-dimensional image data using IMOD. , 1996, Journal of structural biology.

[31]  J Heikkonen,et al.  Automatic alignment of transmission electron microscope tilt series without fiducial markers. , 2001, Journal of structural biology.

[32]  Renmin Han,et al.  A marker-free automatic alignment method based on scale-invariant features. , 2014, Journal of structural biology.

[33]  S S Brandt,et al.  Automatic TEM image alignment by trifocal geometry , 2006, Journal of microscopy.

[34]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[35]  Anja Seybert,et al.  Fiducial-less alignment of cryo-sections. , 2007, Journal of structural biology.