An Algorithm for image stitching and blending

In many clinical studies, including those of cancer, it is highly desirable to acquire images of whole tumour sections whilst retaining a microscopic resolution. A usual approach to this is to create a composite image by appropriately overlapping individual images acquired at high magnification under a microscope. A mosaic of these images can be accurately formed by applying image registration, overlap removal and blending techniques. We describe an optimised, automated, fast and reliable method for both image joining and blending. These algorithms can be applied to most types of light microscopy imaging. Examples from histology, from in vivo vascular imaging and from fluorescence applications are shown, both in 2D and 3D. The algorithms are robust to the varying image overlap of a manually moved stage, though examples of composite images acquired both with manually-driven and computer-controlled stages are presented. The overlap-removal algorithm is based on the cross-correlation method; this is used to determine and select the best correlation point between any new image and the previous composite image. A complementary image blending algorithm, based on a gradient method, is used to eliminate sharp intensity changes at the image joins, thus gradually blending one image onto the adjacent 'composite'. The details of the algorithm to overcome both intensity discrepancies and geometric misalignments between the stitched images will be presented and illustrated with several examples.

[1]  Rachel J Errington,et al.  Fluorescence techniques for drug delivery research: theory and practice. , 2005, Advanced drug delivery reviews.

[2]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  IndianInstituteof TechnologyBombay A Fast Method for Image Mosaicing using Geometric Hashing , 2002 .

[4]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[5]  A J Green,et al.  A comparison of image registration techniques for the correlation of radiolabelled antibody distribution with tumour morphology. , 1999, Physics in medicine and biology.

[6]  B Vojnovic,et al.  Mechanisms associated with tumor vascular shut-down induced by combretastatin A-4 phosphate: intravital microscopy and measurement of vascular permeability. , 2001, Cancer research.

[7]  Jun-Wei Hsieh,et al.  Fast stitching algorithm for moving object detection and mosaic construction , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[8]  Borivoj Vojnovic,et al.  Intravital imaging of tumour vascular networks using multi-photon fluorescence microscopy. , 2005, Advanced drug delivery reviews.

[9]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[10]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[11]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[12]  Tarek A. El-Ghazawi,et al.  Multi-resolution image registration using genetics , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[13]  Kenichi Kanatani,et al.  Image mosaicing by stratified matching , 2004, Image Vis. Comput..

[14]  Reinhard Klette,et al.  Image Stitching - Comparisons and New Techniques , 1999, CAIP.

[15]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[16]  Adam Baumberg,et al.  Blending Images for Texturing 3D Models , 2002, BMVC.

[17]  Borivoj Vojnovic,et al.  Imaging protein-protein interactions by multiphoton FLIM , 2003, European Conference on Biomedical Optics.