Factorization of the translation kernel for fast rigid image alignment

An important component of many image alignment methods is the calculation of inner products (correlations) between an image of $n\times n$ pixels and another image translated by some shift and rotated by some angle. For robust alignment of an image pair, the number of considered shifts and angles is typically high, thus the inner product calculation becomes a bottleneck. Existing methods, based on fast Fourier transforms (FFTs), compute all such inner products with computational complexity $\mathcal{O}(n^3 \log n)$ per image pair, which is reduced to $\mathcal{O}(N n^2)$ if only $N$ distinct shifts are needed. We propose to use a factorization of the translation kernel (FTK), an optimal interpolation method which represents images in a Fourier--Bessel basis and uses a rank-$H$ approximation of the translation kernel via an operator singular value decomposition (SVD). Its complexity is $\mathcal{O}(Hn(n + N))$ per image pair. We prove that $H = \mathcal{O}((W + \log(1/\epsilon))^2)$, where $2W$ is the magnitude of the maximum desired shift in pixels and $\epsilon$ is the desired accuracy. For fixed $W$ this leads to an acceleration when $N$ is large, such as when sub-pixel shift grids are considered. Finally, we present numerical results in an electron cryomicroscopy application showing speedup factors of $3$-$10$ with respect to the state of the art.

[1]  A. Goncharov,et al.  Determination of mutual orientation of identical particles from their projections by the moments method , 1988 .

[2]  Yoel Shkolnisky,et al.  Detecting consistent common lines in cryo-EM by voting. , 2010, Journal of structural biology.

[3]  Yoel Shkolnisky,et al.  Viewing Direction Estimation in Cryo-EM Using Synchronization , 2012, SIAM J. Imaging Sci..

[4]  Fred J Sigworth,et al.  Principles of cryo-EM single-particle image processing. , 2016, Microscopy.

[5]  Yoel Shkolnisky,et al.  Three-Dimensional Structure Determination from Common Lines in Cryo-EM by Eigenvectors and Semidefinite Programming , 2011, SIAM J. Imaging Sci..

[6]  J. Wimp Polynomial expansions of Bessel functions and some associated functions , 1962 .

[7]  Joakim Andén,et al.  Hyper-Molecules: on the Representation and Recovery of Dynamical Structures for Applications in Flexible Macro-Molecules in Cryo-EM , 2019, Inverse problems.

[8]  Leslie Greengard,et al.  Rapid Solution of the Cryo-EM Reconstruction Problem by Frequency Marching , 2016, SIAM J. Imaging Sci..

[9]  Sjors H W Scheres,et al.  Cryo-EM: A Unique Tool for the Visualization of Macromolecular Complexity. , 2015, Molecular cell.

[10]  M. van Heel Angular reconstitution: a posteriori assignment of projection directions for 3D reconstruction. , 1987, Ultramicroscopy.

[11]  Guillermo Sapiro,et al.  Atomic Resolution Cryo-EM Structure of β-Galactosidase. , 2018, Structure.

[12]  N Grigorieff,et al.  Frealign: An Exploratory Tool for Single-Particle Cryo-EM. , 2016, Methods in enzymology.

[13]  K. Murata,et al.  Cryo-electron microscopy for structural analysis of dynamic biological macromolecules. , 2018, Biochimica et biophysica acta. General subjects.

[14]  N. Grigorieff,et al.  Accurate determination of local defocus and specimen tilt in electron microscopy. , 2003, Journal of structural biology.

[15]  David J. Fleet,et al.  cryoSPARC: algorithms for rapid unsupervised cryo-EM structure determination , 2017, Nature Methods.

[16]  Ronald N. Bracewell,et al.  The Fourier Transform and Its Applications , 1966 .

[17]  Nikolaus Grigorieff,et al.  FREALIGN: high-resolution refinement of single particle structures. , 2007, Journal of structural biology.

[18]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.

[19]  A. Horwich,et al.  The crystal structure of the asymmetric GroEL–GroES–(ADP)7 chaperonin complex , 1997, Nature.

[20]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Charles A. Bouman,et al.  Rotationally-invariant non-local means for image denoising and tomography , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[22]  Wen Jiang,et al.  EMAN2: an extensible image processing suite for electron microscopy. , 2007, Journal of structural biology.

[23]  Dmitry Lyumkis,et al.  Likelihood-based classification of cryo-EM images using FREALIGN. , 2013, Journal of structural biology.

[24]  J Frank,et al.  Three-dimensional reconstruction of single particles embedded in ice. , 1992, Ultramicroscopy.

[25]  A.,et al.  FAST FOURIER TRANSFORMS FOR NONEQUISPACED DATA * , .

[26]  Sjors H.W. Scheres,et al.  A Bayesian View on Cryo-EM Structure Determination , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[27]  Amit Singer,et al.  Orientation Determination of Cryo-EM Images Using Least Unsquared Deviations , 2012, SIAM J. Imaging Sci..

[28]  Gregory S Chirikjian,et al.  Deblurring of class-averaged images in single-particle electron microscopy , 2010, Inverse problems.

[29]  Leslie Greengard,et al.  Accelerating the Nonuniform Fast Fourier Transform , 2004, SIAM Rev..

[30]  Laurent Joyeux,et al.  Efficiency of 2D alignment methods. , 2002, Ultramicroscopy.

[31]  Jeremy F. Magland,et al.  A parallel non-uniform fast Fourier transform library based on an "exponential of semicircle" kernel , 2018, SIAM J. Sci. Comput..

[32]  David J. Fleet,et al.  Building Proteins in a Day: Efficient 3D Molecular Structure Estimation with Electron Cryomicroscopy , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  P. Penczek,et al.  A Primer to Single-Particle Cryo-Electron Microscopy , 2015, Cell.

[34]  Dominika Elmlund,et al.  Cryogenic electron microscopy and single-particle analysis. , 2015, Annual review of biochemistry.

[35]  M van Heel,et al.  Statistical image analysis of electron micrographs of ribosomal subunits. , 1988, Methods in enzymology.

[36]  S Jonić,et al.  Spline-based image-to-volume registration for three-dimensional electron microscopy. , 2005, Ultramicroscopy.

[37]  Zhizhen Zhao,et al.  Fast Steerable Principal Component Analysis , 2014, IEEE Transactions on Computational Imaging.

[38]  Zhizhen Zhao,et al.  Rotationally Invariant Image Representation for Viewing Direction Classification in Cryo-EM , 2013, Journal of structural biology.

[39]  E. Schmidt Zur Theorie der linearen und nichtlinearen Integralgleichungen , 1907 .

[40]  Stefan Kunis,et al.  Using NFFT 3---A Software Library for Various Nonequispaced Fast Fourier Transforms , 2009, TOMS.

[41]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[42]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[43]  Pawel A Penczek,et al.  Cryo-EM image alignment based on nonuniform fast Fourier transform. , 2008, Ultramicroscopy.

[44]  M. Kreĭn,et al.  Introduction to the theory of linear nonselfadjoint operators , 1969 .