A Fast Fourier based Feature Descriptor and a Cascade Nearest Neighbour Search with an Efficient Matching Pipeline for Mosaicing of Microscopy Images

Automatic mosaicing is an important image processing application and we propose several improvements and simplifications to the image registration pipeline used in microscopy to automatically construct large images of whole specimen samples from a series of images. First of all we propose a feature descriptor based on the amplitude of a few elements of the Fourier transform, which makes it fast to compute and that can be used for any image matching and registration applications where scale and rotation invariance is not needed. Secondly, we propose a cascade matching approach that will reduce the time for the nearest neighbour search considerably, making it almost independent on feature vector length. Moreover, several improvements are proposed that will speed up the whole matching process. These are: faster interest point detection, a regular sampling strategy and a deterministic false positive removal procedure that finds the transformation. All steps of the improved pipeline are explained and the results comparative experiments are presented.

[1]  Andrea Marchetti,et al.  Optimal RANSAC-Towards a Repeatable Algorithm for Finding the Optimal Set , 2013, J. WSCG.

[2]  Sung-Hyuk Cha.  Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[3]  Radu Hristu,et al.  On the suitability of SIFT technique to deal with image modifications specific to confocal scanning laser microscopy. , 2010, Microscopy and microanalysis : the official journal of Microscopy Society of America, Microbeam Analysis Society, Microscopical Society of Canada.

[4]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[5]  Gustavo Carneiro,et al.  Phase-Based Local Features , 2002, ECCV.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[7]  Eduardo Romero,et al.  Virtual slide mosaicing using feature descriptors and a registration consistency measure , 2013, Other Conferences.

[8]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[9]  Andrea Marchetti,et al.  Rotation invariant feature matching-based on Gaussian filtered log polar transform and phase correlation , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[10]  Yan Dong,et al.  Automatic Registration Based on Improved SIFT for Medical Microscopic Sequence Images , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[11]  Anders Hast,et al.  Clustering in 2D as a Fast Deterministic Alternative to RANSAC , 2015, ICML 2015.

[12]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[13]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[14]  Kim-Hui Yap,et al.  Joint Image Registration and Super-Resolution From Low-Resolution Images With Zooming Motion , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Jinwhan Kim,et al.  Efficient image mosaicing for multi-robot visual underwater mapping , 2014, Pattern Recognit. Lett..

[16]  Suprava Patnaik,et al.  Image Registration Using Log Polar Transform and Phase Correlation to Recover Higher Scale , 2012 .

[17]  Anders Hast.  Robust and Invariant Phase Based Local Feature Matching , 2014, 2014 22nd International Conference on Pattern Recognition.

[18]  D. Lowe,et al.  Fast Matching of Binary Features , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[19]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Computing k-Nearest Neighbors , 1975, IEEE Transactions on Computers.

[20]  Alexandr Andoni,et al.  Nearest neighbor search : the old, the new, and the impossible , 2009 .

[21]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[22]  David Capel.  Image Mosaicing and Super-Resolution (Cphc/Bcs Distinguished Dissertations.) , 2004 .

[23]  Tobias Höllerer,et al.  Evaluation of Interest Point Detectors and Feature Descriptors for Visual Tracking , 2011, International Journal of Computer Vision.

[24]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[25]  Anders Hast,et al.  Invariant Interest Point Detection Based on Variations of the Spinor Tensor , 2014, WSCG 2014.

[26]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[27]  Amir Averbuch,et al.  A projection-based extension to phase correlation image alignment , 2007, Signal Process..

[28]  Hui Chen,et al.  Mosaicing of microscope images based on SURF , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[29]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[30]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[31]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[32]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[33]  Anders Hast,et al.  Incremental Spherical Linear Interpolation , 2004 .

[34]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[35]  P. V. Lukashevich,et al.  Medical image registration based on SURF detector , 2011, Pattern Recognition and Image Analysis.

[36]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[37]  Li Chen,et al.  A Nonlinear Least Square Technique for Simultaneous Image Registration and Super-Resolution , 2007, IEEE Transactions on Image Processing.

[38]  Anders Hast,et al.  A Simple and Efficient Feature Descriptor for Fast Matching , 2015, WSCG 2015.

[39]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[40]  Qing Li,et al.  A Panoramic Image Registration Algorithm Based on SURF , 2012 .

[41]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Edwin R. Hancock,et al.  A statistical approach to sparse multi-scale phase-based stereo , 2007, Pattern Recognit..

[43]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[44]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[45]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[46]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[47]  B. S. Manjunath,et al.  A Mathematical Comparison of Point Detectors , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[48]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[49]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[50]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[52]  Allen R. Tannenbaum,et al.  A new distance measure based on generalized Image Normalized Cross-Correlation for robust video tracking and image recognition , 2013, Pattern Recognit. Lett..

[53]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[54]  Steven Mills,et al.  Real-time aerial image mosaicing , 2010, 2010 25th International Conference of Image and Vision Computing New Zealand.

[55]  Changming Sun,et al.  Mosaicing of microscope images with global geometric and radiometric corrections , 2006, Journal of microscopy.

[56]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[57]  George Wolberg,et al.  Robust image registration using log-polar transform , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[58]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[59]  Wei-Yen Hsu,et al.  Automatic seamless mosaicing of microscopic images: enhancing appearance with colour degradation compensation and wavelet‐based blending , 2008, Journal of microscopy.

[60]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[61]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[62]  C. Morandi,et al.  Registration of Translated and Rotated Images Using Finite Fourier Transforms , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.