Coarse scene geometry estimation from sparse approximations of multi-view omnidirectional images

This paper presents a framework for coarse scene geometry estimation, based on sparse representations of omnidirectional images with geometrical basis functions. We introduce a correlation model that relates sparse components in different views with local geometrical transforms, under epipolar constraints. By combining selected pairs of features represented by sparse components, we estimate the disparity map between images, evaluate coarse depth information, and recover the relative camera pose. The proposed framework allows to estimate the geometry of the scene, hence disparity between images, using only coarse approximations of multi-view images. The experimental results demonstrate that only a few components are sufficient to estimate the disparity map and the camera pose. This is certainly beneficial for predictive multi-view compression schemes, where the scene reconstruction relies on the disparity mapping from low-resolution images in order to progressively decode the higher image resolutions.

[1]  Jangheon Kim,et al.  Robust Anisotropic Disparity Estimation with Perceptual Maximum Variation Modeling , 2006, 2006 International Conference on Image Processing.

[2]  P. Vandergheynst,et al.  Wavelets on the 2-sphere: A group-theoretical approach , 1999 .

[3]  Kostas Daniilidis,et al.  Rotation recovery from spherical images without correspondences , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[5]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[6]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[7]  Aljoscha Smolic,et al.  A Flexible 3D TV System for Different Multi-Baseline Geometries , 2006, 2006 IEEE International Conference on Multimedia and Expo.