Automatic low baseline stereo in urban areas

In this work we propose a new automatic methodology for com- puting accurate digital elevation models (DEMs) in urban environments from low baseline stereo pairs that shall be available in the future from a new kind of earth observation satellite. This setting makes both views of the scene sim- ilarly, thus avoiding occlusions and illumination changes, which are the main disadvantages of the commonly accepted large-baseline configuration. There still remain two crucial technological challenges: (i) precisely estimating DEMs with strong discontinuities and (ii) providing a statistically proven result, au- tomatically. The first one is solved here by a piecewise affine r that is well adapted to man-made landscapes, whereas the application of com- putational Gestalt theory introduces reliability and automation. In fact this theory allows us to reduce the number of parameters to be adjusted, and to control the number of false detections. This leads to the selection of a suitable segmentation into affine regions (whenever possible) by a novel and completely automatic perceptual grouping method. It also allows us to discriminate e.g. vegetation-dominated regions, where such an affine model does not apply and a more classical correlation technique should be preferred. In addition we pro- pose here an extension of the classical "quantized" Gestalt theory to continuous measurements, thus combining its reliability with the precision of variational robust estimation and fine interpolation methods that are necessary in the low baseline case. Such an extension is very general and will be useful for many other applications as well.

[1]  Laura Igual,et al.  Level Lines Selection with Variational Models for Segmentation and Encoding , 2006, Journal of Mathematical Imaging and Vision.

[2]  Bernard Rougé,et al.  Restoration and Zoom of Irregularly Sampled, Blurred, and Noisy Images by Accurate Total Variation Minimization with Local Constraints , 2006, Multiscale Model. Simul..

[3]  Jean-Michel Morel,et al.  From Gestalt Theory to Image Analysis: A Probabilistic Approach , 2007 .

[4]  Laura Igual Muñoz Image segmentation and compression using the tree of shapes of an image. Motion estimation , 2006 .

[5]  J. Morel,et al.  A multiscale algorithm for image segmentation by variational method , 1994 .

[6]  Bernard Rougé,et al.  Measuring and Improving Image Resolution by Adaptation of the Reciprocal Cell , 2004, Journal of Mathematical Imaging and Vision.

[7]  Agnès Desolneux,et al.  Vanishing Point Detection without Any A Priori Information , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  Antonin Chambolle,et al.  Total Variation Minimization and a Class of Binary MRF Models , 2005, EMMCVPR.

[12]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[13]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[14]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[16]  Federico Lecumberry Cálculo de disparidad y segmentación de objetos en secuencias de video , 2005 .

[17]  Javier Preciozzi Dense Urban Elevation Models from Stereo Images by an Affine Region Merging Approach. , 2006 .

[18]  Andrés Almansa,et al.  Variational approach to interpolate and correct biases in stereo correlation , 2005 .

[19]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[20]  Andrés Almansa Sampling, interpolation and detection. Applications in satellite imaging. (Echantillonnage, interpolation et détection. Applications en imagerie satellitaire) , 2002 .

[21]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[22]  Julie Delon,et al.  Le phénomène d'adhérence en stéréoscopie dépend du critère de corrélation , 2001 .

[23]  Ingemar J. Cox,et al.  A maximum-flow formulation of the N-camera stereo correspondence problem , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[24]  Josiane Zerubia,et al.  Building extraction from digital elevation models , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[25]  David W. Jacobs,et al.  In search of illumination invariants , 2001, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[26]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[27]  Federico Lecumberry,et al.  Constrained Anisotropic Diffusion and some Applications , 2006, BMVC.

[28]  L. Moisan,et al.  Maximal meaningful events and applications to image analysis , 2003 .

[29]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[30]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[31]  Josiane Zerubia,et al.  Building Outline Extraction from Digital Elevation Models Using Marked Point Processes , 2007, International Journal of Computer Vision.

[32]  Agnès Desolneux Evénements significatifs et applications à l'analyse d'images , 2000 .

[33]  P. Musé On the definition and recognition of planar shapes in digital images , 2004 .

[34]  Laura Igual,et al.  A Contrast Invariant Approach to Motion Estimation , 2005, Scale-Space.

[35]  Lionel Moisan,et al.  Edge Detection by Helmholtz Principle , 2001, Journal of Mathematical Imaging and Vision.

[36]  Aaron F. Bobick,et al.  Incorporating intensity edges in the recovery of occlusion regions , 1994, Proceedings of 12th International Conference on Pattern Recognition.