Depth estimation from the color drift of a route panorama

Image based modeling methods has been well studied for generating a 3D model from an image sequence. Most of them require redundant and huge spatio-temporal images for estimating a scene depth. It is not good characteristic for taking a higher resolution of texture. A route panorama is a continuous panoramic image along a path. It is suitable for modeling large environments such as a city or town. The panorama captured by a line scan sensor also has advantage for capturing higher resolution easily. In this paper, we propose a method for depth estimation from the panorama. The route panorama has color drifts that correspond to the distances of captured objects. We use these color drifts to estimate the depth of an image. The proposed method detects the color drift by window matching using belief propagation. It also uses a Gaussian pyramid to stabilize the estimation and decrease its computation cost. We confirmed that the proposed method estimated depth maps from a single high-resolution panorama in experiments.

[1]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[3]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[4]  Jiang Yu Zheng,et al.  Spatial resolution analysis of route panorama , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[5]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  N BelhumeurPeter A Bayesian approach to binocular stereopsis , 1996 .

[7]  Jiang Yu Zheng Digital Route Panoramas , 2003, IEEE Multim..

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[10]  Yasushi Yagi,et al.  Superresolution modeling using an omnidirectional image sensor , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Allen R. Hanson,et al.  LAMP: 3D layered, adaptive-resolution, and multi-perspective panorama - a new scene representation , 2004, Comput. Vis. Image Underst..

[12]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[13]  Katsushi Ikeuchi,et al.  Super-resolution omnidirectional camera images using spatio-temporal analysis , 2006 .