Local stereo matching under radiometric variations

Stereo matching is an active research area in computer vision for decades. Most of the existing stereo matching algorithms assume that the corresponding pixels have the same intensity or color in both images. But in real world situations, image color values are often affected by various radiometric factors such as exposure and lighting variations. This paper introduces a robust stereo matching algorithm for images captured under varying radiometric conditions. In this paper, histogram equalization and binary singleton expansion are performed as preprocessing step for local stereo matching. For the purpose of eliminating the discrepancy of illumination between reference image and corresponding image in stereo pair, the histogram equalization is first explored to remove the global discrepancy. As the second step, binary singleton expansion is performed to reduce noise and normalize histogram results for window cost computation efficient. Afterwards, local pixel matching on preprocessed stereo images is performed with Sum of Absolute Difference (SAD) on intensity and gradient. Finally, the final disparity map is obtained by left-right consistency checking and filtering with mean shift segments. Experimental results show that the proposed algorithm can reduce illumination differences and improve the matching accuracy of stereo image pairs effectively.

[1]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Sang Uk Lee,et al.  Robust Stereo Matching Using Adaptive Normalized Cross-Correlation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Li Hong,et al.  Segment-based stereo matching using graph cuts , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Rafael Cabeza,et al.  Stereo matching using gradient similarity and locally adaptive support-weight , 2011, Pattern Recognit. Lett..

[5]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Bernt Schiele,et al.  Comprehensive Colour Image Normalization , 1998, ECCV.

[7]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[8]  Emile A. Hendriks,et al.  Improving segment based stereo matching using SURF key points , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  Removing illumination from image pair for stereo matching , 2012, 2012 International Conference on Audio, Language and Image Processing.

[10]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[11]  Patrik Kamencay,et al.  Improved Depth Map Estimation from Stereo Images based on Hybrid Method , 2012 .

[12]  Lifeng Sun,et al.  Binary stereo matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[13]  Sang Uk Lee,et al.  Robust stereo matching under radiometric variations based on cumulative distributions of gradients , 2013, 2013 IEEE International Conference on Image Processing.

[14]  Junbin Gao,et al.  Fast stereo matching with fuzzy correlation , 2016, 2016 IEEE 11th Conference on Industrial Electronics and Applications (ICIEA).

[15]  Sang Uk Lee,et al.  Illumination and camera invariant stereo matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .