Multi-Dimensional Dynamic Time Warping for Image Texture Similarity

Modern content-based image retrieval systems use different features to represent properties (e.g., color, shape, texture) of the visual content of an image. Retrieval is performed by example where a query image is given as input and an appropriate metric is used to find the best matches in the corresponding feature space. Both selecting the features and the distance metric continue to be active areas of research. In this paper, we propose a new approach, based on the recently proposed Multidimensional Dynamic Time Warping (MD-DTW) distance [1], for assessing the texture similarity of images with structured textures. The MD-DTW allows the detection and comparison of arbitrarily shifted patterns between multi-dimensional series, such as those found in structured textures. Chaos theory tools are used as a preprocessing step to uncover and characterize regularities in structured textures. The main advantage of the proposed approach is that explicit selection and extraction of texture features is not required (i.e., similarity comparisons are performed directly on the raw pixel data alone). The method proposed in this preliminary investigation is shown to be valid by proving that it creates a statistically significant image texture similarity measure.

[1]  E. A. Jackson,et al.  Perspectives of nonlinear dynamics , 1990 .

[2]  David Sankoff,et al.  Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison , 1983 .

[3]  Rohini K. Srihari,et al.  Intelligent Indexing and Semantic Retrieval of Multimodal Documents , 2004, Information Retrieval.

[4]  F. Takens Detecting strange attractors in turbulence , 1981 .

[5]  Alfredo Medio,et al.  Chaotic Dynamics: Theory and Applications to Economics , 1993 .

[6]  Masao Sakauchi,et al.  A flexible content-based image retrieval system with combined scene description keyword , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[7]  Alfredo Medio,et al.  Chaotic Dynamics Macintosh Disk: Theory and Applications to Economics , 1993 .

[8]  Joseph B. Kruskall,et al.  The Symmetric Time-Warping Problem : From Continuous to Discrete , 1983 .

[9]  The fractal research and predicating on the times series of sunspot relative number , 1999 .

[10]  Andrew Nicola Edmonds Time series prediction using supervised learning and tools from chaos theory , 1996 .

[11]  R. Mañé,et al.  On the dimension of the compact invariant sets of certain non-linear maps , 1981 .

[12]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[13]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[15]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[16]  Beng Chin Ooi,et al.  Giving meanings to WWW images , 2000, MM 2000.

[17]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[18]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[19]  A. N. Sharkovskiĭ Dynamic systems and turbulence , 1989 .

[20]  L. Tsimring,et al.  The analysis of observed chaotic data in physical systems , 1993 .