Augmented scene modeling and visualization by optical and acoustic sensor integration

In this paper, underwater scene modeling from multisensor data is addressed. Acoustic and optical devices aboard an underwater vehicle are used to sense the environment in order to produce an output that is readily understandable even by an inexperienced operator. The main idea is to integrate multiple-sensor data by geometrically registering such data to a model. The geometrical structure of this model is a priori known but not ad hoc designed for this purpose. As a result, the vehicle pose is derived and model objects can be superimposed upon actual images, thus generating an augmented-reality representation. Results on a real underwater scene are reported, showing the effectiveness of the proposed approach.

[1]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Ren C. Luo,et al.  Multisensor integration and fusion in intelligent systems , 1989, IEEE Trans. Syst. Man Cybern..

[3]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Dominique Attali,et al.  Computing and Simplifying 2D and 3D Continuous Skeletons , 1997, Comput. Vis. Image Underst..

[5]  Allen R. Hanson,et al.  Building reconstruction from optical and range images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Luc Robert.  Camera Calibration without Feature Extraction , 1996, Comput. Vis. Image Underst..

[7]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  A. Trucco,et al.  Three-dimensional image generation and processing in underwater acoustic vision , 2000, Proceedings of the IEEE.

[9]  Martial Hebert,et al.  A system for semi-automatic modeling of complex environments , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[10]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[12]  Jitendra Malik,et al.  Extracting Objects from Range and Radiance Images , 2001, IEEE Trans. Vis. Comput. Graph..

[13]  Anil K. Jain,et al.  Reconstruction and Boundary Detection of Range and Intensity Images Using Multiscale MRF Representations , 1996, Comput. Vis. Image Underst..

[14]  H. C. Longuet-Higgins,et al.  An algorithm for associating the features of two images , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[15]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ioannis Pitas,et al.  Nonlinear Digital Filters - Principles and Applications , 1990, The Springer International Series in Engineering and Computer Science.

[17]  Martial Hebert,et al.  3-D object modeling and recognition for telerobotic manipulation , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[18]  J. P. Mellor.  Realtime Camera Calibration for Enhanced Reality Visualization , 1995, CVRMed.

[19]  Heinz Huegli,et al.  Augmented reality using range images , 1997, Electronic Imaging.

[20]  Robert B. Fisher,et al.  A Comparison of Four Algorithms for Estimating 3-D Rigid Transformations , 1995, BMVC.

[21]  Guanghua Zhang,et al.  Physical modeling and combination of range and intensity edge data , 1993 .

[22]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[23]  Takeo Kanade,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995, CVRMed.

[24]  Vittorio Murino,et al.  Three-dimensional skeleton extraction by point set contraction , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[25]  Leila De Floriani,et al.  Virtual environment generation by CAD-based methodology for underwater vehicle navigation , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[26]  W. Eric L. Grimson,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  François Goulette,et al.  Automatic CAD modeling of industrial pipes from range images , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[28]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[29]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.