Sensor Fusion in Computer Vision

Sensor fusion has been an active area of research in the field of computer vision for over two decades. Early approaches to sensor fusion were focused on the recovery of the three-dimensional scene structure from two short baseline cameras which was considered to be similar to the human vision system. Recently with the availability of sensors of various modalities, computer vision researchers have started looking into these new sensory data for the solution of automated understanding of the scene content. In this paper, an outline of some of the most common sensor fusion techniques is provided. Although no priority is given to one technique over the others, we selected only a handful techniques that are related to sensor fusion in the context of urban city modeling.

[1]  Dimitris N. Metaxas,et al.  Optical Flow Constraints on Deformable Models with Applications to Face Tracking , 2000, International Journal of Computer Vision.

[2]  Wolfgang Förstner,et al.  PHOTOGRAMMETRIC STANDARD METHODS AND DIGITAL IMAGE MATCHING TECHNIQUES FOR HIGH PRECISION SURFACE MEASUREMENTS , 1986 .

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[6]  Avinash C. Kak,et al.  Principles of computerized tomographic imaging , 2001, Classics in applied mathematics.

[7]  Dimitris N. Metaxas,et al.  Physics-Based Modeling of Nonrigid Objects for Vision and Graphics (Dissertation) , 1992 .

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Cary L. Cooper,et al.  Occupational Health Psychology: The Challenge of Workplace Stress , 1991 .

[10]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[13]  Mubarak Shah,et al.  Target tracking in airborne forward looking infrared imagery , 2003, Image Vis. Comput..

[14]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[15]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[16]  Mubarak Shah,et al.  A non-iterative greedy algorithm for multi-frame point correspondence , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  E. Weisstein.  CRC Concise Encyclopedia of Mathematics, Second Edition , 2002 .

[18]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[19]  Dimitris N. Metaxas,et al.  Constrained deformable superquadrics and nonrigid motion tracking , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Takeo Kanade,et al.  A Cooperative Algorithm for Stereo Matching and Occlusion Detection , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Asada Naoki,et al.  Incremental procedure for recovering entire building shape from close range images , 2003 .

[22]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[23]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[24]  David G. Stork,et al.  Pattern Classification , 1973 .

[25]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[26]  Frank Dellaert,et al.  Line-Based Structure from Motion for Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[27]  Mubarak Shah,et al.  A noniterative greedy algorithm for multiframe point correspondence , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jan-Michael Frahm,et al.  Towards Urban 3D Reconstruction from Video , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).