Increasing depth lateral resolution based on sensor fusion

Technologies for measuring range data were intensively developed in recent years. The Time-Of-Flight matrix range sensor is one of the most active range acquisition devices, due to its effective suppression of background illumination, relative low cost and high portability. However, the resolution of such 3D range sensor is much lower than that of a modern colour image. This paper presents a solution to the problem of deriving a high-resolution depth image from a low-resolution sensor and a high-resolution colour image. The proposed algorithm is a modification of the Markov Random Fields fusion method that was presented by Diebel and Thrun (2005). Two extensions are suggested to improve the optimisation criteria.

[1]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Kim Steenstrup Pedersen,et al.  The Nonlinear Statistics of High-Contrast Patches in Natural Images , 2003, International Journal of Computer Vision.

[3]  Sebastian Thrun,et al.  An Application of Markov Random Fields to Range Sensing , 2005, NIPS.

[4]  Rudolph Triebel,et al.  Vision based interpolation of 3D laser scans , 2006 .

[5]  Gregory Dudek,et al.  Range synthesis for 3D environment modeling , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[6]  R. Kompe,et al.  Fast Fusion of Range and Video Sensor Data , 2008 .