Interpolation of Novel Object Views from Sample Views

In this article we address the problem of threedimensional object recognition from two-dimensional views. We use a viewer-centered model of object representation and interpolate novel views from stored sample views. The sample views are represented by graphs which are labeled with Gabor wavelet responses as local descriptors of object points. The positions of the object points in a novel view are linear combinations of the corresponding point positions in the sample views, and the novel feature vectors are linear combinations of the Gabor responses in the sample views. From such an interpolated graph we reconstruct the novel view and analyse its quality for different poses of the novel view in relation to the sample views. Within the covered range of about 30◦ tilt and 40◦ pan viewing angle between the sample views we obtain good interpolation qualities. This leads to a number of about 36 views which is sufficient to represent the upper viewing hemisphere of an arbitrary object. Our results are consistent with current findings of biological and psychological research. In addition, the idea of the proposed algorithm is suitable to be applied in data compression.

[1]  N. Logothetis,et al.  View-dependent object recognition by monkeys , 1994, Current Biology.

[2]  Barbara Zitová,et al.  Two Methods for Comparing Different Views of the Same Object , 1999, BMVC.

[3]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[4]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[6]  I. Rock,et al.  A case of viewer-centered object perception , 1987, Cognitive Psychology.

[7]  Christoph von der Malsburg,et al.  Reconstruction from Graphs Labeled with Responses of Gabor Filters , 1996, ICANN.

[8]  H H Bülthoff,et al.  Psychophysical support for a two-dimensional view interpolation theory of object recognition. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Christoph von der Malsburg,et al.  View Reconstruction by Linear Combination of Sample Views , 2001, BMVC.

[10]  G. Peters Theories of Three-Dimensional Object Perception A Survey , 2000 .

[11]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[12]  Christoph von der Malsburg,et al.  Tracking and learning graphs and pose on image sequences of faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[14]  Norbert Krüger,et al.  Face Recognition and Gender determination , 1995 .

[15]  S. Ullman Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.