Integrating Geometric and Photometric Information for Image Retrieval

We describe two image matching techniques that owe their success to a combination of geometric and photometric constraints. In the first, images are matched under similarity transformations by using local intensity invariants and semi-local geometric constraints. In the second, 3D curves and lines are matched between images using epipolar geometry and local photometric constraints. Both techniques are illustrated on real images. We show that these two techniques may be combined and are complementary for the application of image retrieval from an image database. Given a query image, local intensity invariants are used to obtain a set of potential candidate matches from the database. This is very efficient as it is implemented as an indexing algorithm. Curve matching is then used to obtain a more significant ranking score. It is shown that for correctly retrieved images many curves are matched, whilst incorrect candidates obtain very low ranking.

[1]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Ramakant Nevatia,et al.  Detecting changes in aerial views of man-made structures , 2000, Image Vis. Comput..

[3]  M K Brown,et al.  The Extraction of Curved Surface Features with Generic Range Sensors , 1986 .

[4]  Brian V. Funt,et al.  Color Constant Color Indexing , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[6]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[7]  Cordelia Schmid,et al.  Comparing and evaluating interest points , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[9]  Andrew Zisserman,et al.  Robust computation and parametrization of multiple view relations , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[11]  Cordelia Schmid,et al.  The Geometry and Matching of Curves in Multiple Views , 1998, ECCV.

[12]  Gérard G. Medioni,et al.  Segmented shape descriptions from 3-view stereo , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Jan J. Gerbrands,et al.  Method for matching general stereo planar curves , 1995, Image Vis. Comput..

[14]  Kenji Nagao,et al.  Recognizing 3D objects using photometric invariant , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Yehezkel Lamdan,et al.  Geometric Hashing: A General And Efficient Model-based Recognition Scheme , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[16]  Philip H. S. Torr,et al.  Outlier detection and motion segmentation , 1993, Other Conferences.

[17]  Cordelia Schmid,et al.  Appariement d'images par invariants locaux de niveaux de gris. Application à l'indexation d'une base d'objets. (Image matching by local greyvalue invariants. Applied to indexing an object database) , 1996 .

[18]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[20]  Ramakant Nevatia,et al.  Use of Monocular Groupings and Occlusion Analysis in a Hierarchical Stereo System , 1995, Comput. Vis. Image Underst..

[21]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.