Fully automatic stitching and distortion correction of transmission electron microscope images.

In electron microscopy, a large field of view is commonly captured by taking several images of a sample region and then by stitching these images together. Non-linear lens distortions induced by the electromagnetic lenses of the microscope render a seamless stitching with linear transformations impossible. This problem is aggravated by large CCD cameras, as they are commonly in use nowadays. We propose a new calibration method based on ridge regression that compensates non-linear lens distortions, while ensuring that the geometry of the image is preserved. Our method estimates the distortion correction from overlapping image areas using automatically extracted correspondence points. Therefore, the estimation of the correction transform does not require any special calibration samples. We evaluate our method on simulated ground truth data as well as on real electron microscopy data. Our experiments demonstrate that the lens calibration robustly corrects large distortions with an average stitching error exceeding 10 pixels to sub-pixel accuracy within two iteration steps.

[1]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[2]  Simon K. Warfield,et al.  Accelerating Feature Based Registration Using the Johnson-Lindenstrauss Lemma , 2009, MICCAI.

[3]  Gideon P. Stein,et al.  Lens distortion calibration using point correspondences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Aiqi Wang,et al.  A Simple Method of Radial Distortion Correction with Centre of Distortion Estimation , 2009, Journal of Mathematical Imaging and Vision.

[5]  Joachim M. Buhmann,et al.  Fully Automatic Registration of Electron Microscopy Images with High and Low Resolution , 2007, Microscopy and Microanalysis.

[6]  Brad J Marsh,et al.  Reconstructing mammalian membrane architecture by large area cellular tomography. , 2007, Methods in cell biology.

[7]  Harpreet S. Sawhney,et al.  True Multi-Image Alignment and Its Application to Mosaicing and Lens Distortion Correction , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Harpreet S. Sawhney,et al.  True multi-image alignment and its application to mosaicing and lens distortion correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Simon K. Warfield,et al.  Alignment of Large Image Series Using Cubic B-Splines Tessellation: Application to Transmission Electron Microscopy Data , 2007, MICCAI.

[10]  Andrew W. Fitzgibbon,et al.  A rational function lens distortion model for general cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Mark H Ellisman,et al.  Transform-based backprojection for volume reconstruction of large format electron microscope tilt series. , 2006, Journal of structural biology.

[12]  Sing Bing Kang,et al.  Parameter-Free Radial Distortion Correction with Center of Distortion Estimation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Takeo Kanade,et al.  Geometric camera calibration using systems of linear equations , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[14]  R. Whitaker,et al.  Assembly of Large Three-Dimensional Volumes from Serial-Section Transmission Electron Microscopy , 2006 .

[15]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[17]  Kostas Daniilidis,et al.  Structure and motion from uncalibrated catadioptric views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Carlos Ortiz-de-Solorzano,et al.  Consistent and Elastic Registration of Histological Sections Using Vector-Spline Regularization , 2006, CVAMIA.

[19]  Ruzena Bajcsy,et al.  True single view point cone mirror omni-directional catadioptric system , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.