Depth reconstruction uncertainty analysis and improvement - The dithering approach

The depth spatial quantization uncertainty is one of the factors which influence the depth reconstruction accuracy caused by a discrete sensor. This paper discusses the quantization uncertainty distribution, introduces a mathematical model of the uncertainty interval range, and analyzes the movements of the sensors in an Intelligent Vision Agent System. Such a system makes use of multiple sensors which control the deployment and autonomous servo of the system. This paper proposes a dithering algorithm which reduces the depth reconstruction uncertainty. The algorithm assures high accuracy from a few images taken by low-resolution sensors. The dither signal is estimated and then generated through an analysis of the iso-disparity planes. The signal allows for control of the camera movement. The proposed approach is validated and compared with a direct triangulation method. The simulation results are reported in terms of depth reconstruction error statistics. The physical experiment shows that the dithering method reduces the depth reconstruction error.

[1]  Shree K. Nayar,et al.  Video super-resolution using controlled subpixel detector shifts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Domenico Prattichizzo,et al.  EGT for multiple view geometry and visual servoing: robotics vision with pinhole and panoramic cameras , 2005, IEEE Robotics & Automation Magazine.

[3]  Robert Alexander Wannamaker,et al.  The Theory of Dithered Quantization , 1997 .

[4]  Christopher C. Yang,et al.  Optimized Sensor Placement for Active Visual Inspection , 2001 .

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  Xiangdong Liu,et al.  Subpixel Edge Location in Binary Images Using Dithering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jake K. Aggarwal,et al.  Quantization error in stereo imaging , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Alan C. Bovik,et al.  FOVEA: a foveated vergent active stereo vision system for dynamic three-dimensional scene recovery , 1998, IEEE Trans. Robotics Autom..

[9]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[10]  Anup Basu,et al.  Optimal non-uniform discretization for stereo reconstruction , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Avinash C. Kak,et al.  Stereo vision , 1994 .

[12]  Wlodek Kulesza,et al.  Planning of a multi stereo visual sensor system for a human activities space , 2007, VISAPP.

[13]  Jiandan Chen,et al.  Planning of a Multi Stereo Visual Sensor System - Depth Accuracy and Variable Baseline Approach , 2007, 2007 3DTV Conference.

[14]  John Vanderkooy,et al.  A theory of nonsubtractive dither , 2000, IEEE Trans. Signal Process..

[15]  M. Wagdy Effect of various dither forms on quantization errors of ideal A/D converters , 1989 .

[16]  Antônio Francisco,et al.  On the Importance of Being Asymmetric in Stereopsis—Or Why We Should Use Skewed Parallel Cameras , 1998, International Journal of Computer Vision.

[17]  Dario Petri,et al.  Effect of additive dither on the resolution of ideal quantizers , 1994 .

[18]  Richard N. Hook,et al.  Dithering, Sampling and Image Reconstruction , 2000 .

[19]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[20]  Brian A. Wandell,et al.  How small should pixel size be? , 2000, Electronic Imaging.

[22]  Nina Amenta,et al.  Laser Scanner Super-resolution , 2006, PBG@SIGGRAPH.

[23]  Dario Petri,et al.  Mean value and variance of noisy quantized data , 1998 .

[24]  Eero P. Simoncelli,et al.  Range estimation by optical differentiation. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.