A new approach for image stitching technique using Dynamic Time Warping (DTW) algorithm towards scoliosis X-ray diagnosis

Abstract Consider a set of images of a single object, or scenery, taken from different viewpoints and time. Panorama image creation is the process of stitching such images into a single coordinate system to generate a wider viewing panoramic image. Image stitching consists of two processes which are image registration and image blending. In image registration, parts of two overlapping or consecutive images are considered to find an appropriate merging position and transformation to combine the images. In image blending, the intensities of pixels along the stitching line are modified so that they flow naturally without any noticeable break. In this paper, we propose a novel method that utilizes the Dynamic Time Warping (DTW) algorithm to match pairs of images for image stitching. We also perform a dimension reduction scheme that significantly reduces the computational complexity of the standard DTW without affecting its performance. The effectiveness of the proposed method is demonstrated in stitching 50 pairs of medical X-ray images and its performance is compared to those of normalized cross correlation (NCC), Minimum Average Correlation Energy (MACE) filters, sum-of-square-differences (SSD) and sum-of-absolute-differences (SAD). For the database used, the dimensionally reduced DTW outperforms the NCC, MACE, SSD and SAD methods in accuracy and average execution time. The method also outperforms two widely used stitching programs available on the internet called Hugin and Autostitch.

[1]  Hans-Rudolf Weiss,et al.  Scoliosis: a journal dedicated to multidisciplinary research on prevention, control, and treatment of scoliosis and other spinal deformities , 2006, Scoliosis.

[2]  Mingquan Wang,et al.  Research on stitching technique of medical infrared images , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[3]  R. Jayadevan,et al.  Dynamic Time Warping Based Static Hand Printed Signature Verification , 2009 .

[4]  Hee-Kit Wong,et al.  The natural history of adolescent idiopathic scoliosis , 2010, Indian journal of orthopaedics.

[5]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[6]  M. Phelps,et al.  Automated iterative three-dimensional registration of positron emission tomography images. , 1993, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[7]  János Abonyi,et al.  Correlation based dynamic time warping of multivariate time series , 2012, Expert Syst. Appl..

[8]  L. Bidaut,et al.  Automated registration of dynamic MR images for the quantification of myocardial perfusion , 2001, Journal of magnetic resonance imaging : JMRI.

[9]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[10]  Eamonn J. Keogh,et al.  Dimensionality Reduction for Fast Similarity Search in Large Time Series Databases , 2001, Knowledge and Information Systems.

[11]  Hans-Peter Kriegel,et al.  Periodic Pattern Analysis in Time Series Databases , 2009, DASFAA.

[12]  Svetha Venkatesh,et al.  THRESHOLD DYNAMIC TIME WARPING FOR SPATIAL ACTIVITY RECOGNITION , 2007 .

[13]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[14]  Hamzah Arof,et al.  On improving Dynamic Time Warping for pattern matching , 2012 .

[15]  Hao Wang,et al.  MOCC: A Fast and Robust Correlation-Based Method for Interest Point Matching under Large Scale Changes , 2010, EURASIP J. Adv. Signal Process..

[16]  D. Burton,et al.  Adolescent idiopathic scoliosis: natural history and long term treatment effects , 2006, Scoliosis.

[17]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[18]  Suresh Venkatasubramanian,et al.  Curve Matching, Time Warping, and Light Fields: New Algorithms for Computing Similarity between Curves , 2007, Journal of Mathematical Imaging and Vision.

[19]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[20]  Fatimah Ibrahim,et al.  Development of Automated Image Stitching System for Radiographic Images , 2012, Journal of Digital Imaging.

[21]  Muzaffar Bashir,et al.  Reduced Dynamic Time Warping for Handwriting Recognition Based on Multidimensional Time Series of a Novel Pen Device , 2008 .

[22]  B. V. K. Vijaya Kumar,et al.  Incremental updating of advanced correlation filters for biometric authentication systems , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[23]  Reinhard Klette,et al.  Image Stitching - Comparisons and New Techniques , 1999, CAIP.

[24]  Hayri Sever,et al.  Silhouette Extraction from Street View Images , 2014 .

[25]  Borivoj Vojnovic,et al.  An Algorithm for image stitching and blending , 2005, SPIE BiOS.

[26]  W. Eric L. Grimson,et al.  Object Detection and Localization by Dynamic Template Warping , 1998, International Journal of Computer Vision.

[27]  Yingen Xiong,et al.  Fast panorama stitching for high-quality panoramic images on mobile phones , 2010, IEEE Transactions on Consumer Electronics.

[28]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[29]  Hamzah Arof,et al.  Pattern correlation approach towards face detection system framework , 2008, 2008 International Symposium on Information Technology.

[30]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[31]  Abhinav Kumar,et al.  Automatic Image Alignment and Stitching of Medical Images with Seam Blending , 2010 .

[32]  Eamonn J. Keogh,et al.  Exact indexing of dynamic time warping , 2002, Knowledge and Information Systems.