Impact of Wavelets and Multiwavelets Bases on Stereo Correspondence Estimation Problem

Finding correct corresponding points frommore than one perspective views in stereo vision is subject to number of potential problems, such as occlusion, ambiguity, illuminative variations and radial distortions. A number of algorithms has been proposed to address the problems as well as the solutions, in the context of stereo correspondence estimation. The majority of them can be categorized into three broad classes i.e. local search algorithms (LA) L. Di Stefano (2004); T. S. Huang (1994); Wang et al. (2006), global search algorithms (GA) Y. Boykov & Zabih (2001); Scharstein & Szeliski (1998) and hierarchical iterative search algorithms (HA) A. Bhatti (2008); C. L. Zitnick (2000). The algorithms belonging to the LA class try to establish correspondences over locally defined regions within the image space. Correlations techniques are commonly employed to estimate the similarities between the stereo image pair using pixel intensities, sensitive to illuminative variations. LA perform well in the presence of rich textured areas but have tendency of relatively lower performance in the featureless regions. Furthermore, local search using correlation windows usually lead to poor performance across the boundaries of image regions. On the other hand, algorithms belonging to GA group deals with the stereo correspondence estimation as a global cost-function optimization problem. These algorithms usually do not perform local search but rather try to find a correspondence assignment that minimizes a global objective function. GA group algorithms are generally considered to possess better performance over the rest of the algorithms. Despite of the fact of their overall better performance, these algorithms are not free of shortcomings and are dependent on how well the cost function represents the relationship between the disparity and some of its properties like smoothness, regularity. Moreover, how close that cost function representation is to the real world scenarios. Furthermore, the smoothness parameters makes disparity map smooth everywhere which may lead to poor performance at image discontinuities. Another disadvantage of these algorithms is their computational complexity, which makes them unsuitable for real-time and close-to-realtime applications. Third group of algorithms uses the concept of multi-resolution analysis Mallat (1999) in addressing the problem of stereo correspondence. In multi-resolution analysis, as is obvious from the name, the input signal (image) is divided into different resolutions, i.e. scales and spacesMallat (1999); A. Witkin & Kass (1987), before estimation of the correspondence. This group of algorithms do not explicitly state a global function that is to be minimized, but rather try to establishes correspondences in a hierarchical manner J. R. Bergen H Q‘ingxiong Yang & Nister (2006), similar to iterative optimization algorithms Daubechies (1992). Generally, stereo correspondences established in lower resolutions are propagated to higher resolutions in an 2

[1]  Alain Crouzil,et al.  Fusion of the Stereoscopic and Temporal Matching Results by an Algorithm of Coherence Control and Conflicts Management , 1993, CAIP.

[2]  Luigi di Stefano,et al.  A fast area-based stereo matching algorithm , 2004, Image Vis. Comput..

[3]  Fangmin Shi,et al.  SSD Matching Using Shift-Invariant Wavelet Transform , 2001, BMVC.

[4]  Saeid Nahavandi,et al.  Disparity estimation using TI multi-wavelet transform , 2003 .

[5]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  I. Cohen,et al.  Adaptive time-frequency distributions via the shift-invariant wavelet packet decomposition , 1998, Proceedings of the IEEE-SP International Symposium on Time-Frequency and Time-Scale Analysis (Cat. No.98TH8380).

[7]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[8]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[9]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[10]  Demetri Terzopoulos,et al.  Signal matching through scale space , 1986, International Journal of Computer Vision.

[11]  I. Daubechies,et al.  Two-scale difference equations I: existence and global regularity of solutions , 1991 .

[12]  He-Ping Pan,et al.  General stereo image matching using symmetric complex wavelets , 1996, Optics & Photonics.

[13]  C. Chui Wavelets: A Tutorial in Theory and Applications , 1992 .

[14]  G. Strang,et al.  Orthogonal multiwavelets with vanishing moments , 1994 .

[15]  Michael Unser,et al.  Multiresolution image registration procedure using spline pyramids , 1993, Optics & Photonics.

[16]  Andrew Zisserman,et al.  Computer vision applied to super resolution , 2003, IEEE Signal Process. Mag..

[17]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Stéphane Mallat,et al.  Zero-crossings of a wavelet transform , 1991, IEEE Trans. Inf. Theory.

[19]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[20]  D. Donoho,et al.  Translation-Invariant De-Noising , 1995 .

[21]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[22]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Richard Szeliski,et al.  Stereo Matching with Nonlinear Diffusion , 1998, International Journal of Computer Vision.

[24]  Saeid Nahavandi,et al.  STEREO CORRESPONDENCE ESTIMATION USING MULTIWAVELETS SCALE-SPACE REPRESENTATION-BASED MULTIRESOLUTION ANALYSIS , 2008, Cybern. Syst..

[25]  Julian Magarey,et al.  Multiresolution stereo image matching using complex wavelets , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[26]  A. Gallegos-Hernandez,et al.  2D automated visual inspection system for the remote quality control of SMD assembly , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[27]  S. Mallat A wavelet tour of signal processing , 1998 .

[28]  Ruigang Yang,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation and Occlusion Handling , 2006, CVPR.

[29]  Andreas Siebert A linear shift invariant multiscale transform , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[30]  Jean-Christophe Olivo-Marin,et al.  Automatic registration of images by a wavelet-based multiresolution approach , 1995, Optics + Photonics.

[31]  Gilbert Strang,et al.  Short wavelets and matrix dilation equations , 1995, IEEE Trans. Signal Process..

[32]  Hüseyin Özkaramanli,et al.  M-band multi-wavelets from spline super functions with approximation order , 2002, ICASSP.

[33]  Bülent Bilgehan,et al.  Multi-wavelets from B-spline super-functions with approximation order , 2002, Signal Process..

[34]  Asim Bhatti Stereo Vision and Wavelets/Multiwavelets Analysis: 3D Reconstruction Using Wavelets/Multiwavelets Theory and Stereo Vision , 2009 .

[35]  A. Mehmood,et al.  Digital reconstruction of Buddhist historical sites (6th B.C-2nd A.D) at Taxila, Pakistan (UNESCO, world heritage site) , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[36]  Egon Dorrer,et al.  Automatic image-matching algorithm based on wavelet decomposition , 1994, Other Conferences.

[37]  Cordelia Schmid,et al.  AUTOMATIC LINE MATCHING AND 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE VIEWS , 1999 .

[38]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[39]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[40]  V. Strela Multiwavelets--theory and applications , 1996 .

[41]  Roland Wilson,et al.  A Fourier Approach to 3D Local Feature Estimation from Volume Data , 2001, BMVC.

[42]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[43]  C. Chui,et al.  A study of orthonormal multi-wavelets , 1996 .

[44]  Takeo Kanade,et al.  A Cooperative Algorithm for Stereo Matching and Occlusion Detection , 2000, IEEE Trans. Pattern Anal. Mach. Intell..