Beyond Keypoints: Novel Techniques for Content-Based Image Matching and Retrieval

Keypoints are a well established tool for image matching and retrieval problems. The paper reports development of novel techniques that (by exploiting advantages of keypoints and trying to correct their certain inadequacies) provide higher accuracy and reliability of content-based image matching. The area of ultimately intended applications is near-duplicate image fragment retrieval, a difficult problem of detecting visually similar fragments embedded into images of unknown and unpredictable contents. Two supplementary approaches are proposed: (1) image warping for non-linearly distorted images to obtain the best match between related fragments and (2) detection of maximum regions that are related by affine transformations. Other relevant results are also briefly mentioned. The reported work is a part of an ongoing project so that further improvements and modifications of the proposed methods can be expected in the near future.

[1]  Mubarak Shah,et al.  Two-frame wide baseline matching , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Hans P. Moravec Rover Visual Obstacle Avoidance , 1981, IJCAI.

[3]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[4]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[5]  Md. Saiful Islam,et al.  Relative scale method to locate an object in cluttered environment , 2008, Image Vis. Comput..

[6]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[7]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Yan Ke,et al.  An efficient parts-based near-duplicate and sub-image retrieval system , 2004, MULTIMEDIA '04.

[9]  Chong-Wah Ngo,et al.  Keyframe Retrieval by Keypoints: Can Point-to-Point Matching Help? , 2006, CIVR.

[10]  Luc Van Gool,et al.  Moment invariants for recognition under changing viewpoint and illumination , 2004, Comput. Vis. Image Underst..

[11]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[12]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Chong-Wah Ngo,et al.  Scale-Rotation Invariant Pattern Entropy for Keypoint-Based Near-Duplicate Detection , 2009, IEEE Transactions on Image Processing.

[14]  Andrzej Sluzek,et al.  Aligned matching: An efficient image matching technique , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  Wei Zhang,et al.  Image Based Localization in Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[16]  Hung-Khoon Tan,et al.  Near-Duplicate Keyframe Identification With Interest Point Matching and Pattern Learning , 2007, IEEE Transactions on Multimedia.

[17]  Mario A. Nascimento,et al.  Content based sub-image retrieval via hierarchical tree matching , 2003, MMDB '03.

[18]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[19]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[20]  Mario A. Nascimento,et al.  Content-based sub-image retrieval using relevance feedback , 2004, MMDB '04.