Augmented reality using range images

This paper proposes range imaging as a means to improve object registration in an augmented reality environment. The addressed problem deals with virtual world construction from complex scenes using object models. During reconstruction, the scene view is augmented by superimposing virtual object representations from a model database. The main difficulty consists in the precise registration of a virtual object and its counterpart in the real scene. The presented approach solves this problem by matching geometric shapes obtained from range imaging. This geometric matching snaps the roughly placed object model onto its real world counterpart and permits the user to update the virtual world with the recognized model. We present a virtual world construction system currently under development that allows the registration of objects present in a scene by combined use of user interaction and automatic geometric matching based on range images. Potential applications are teleoperation of complex assembly tasks and world construction for mobile robotics.

[1]  Charles Baur,et al.  3D vision in a virtual reality robotics environment , 1996, Other Conferences.

[2]  Heinz Huegli,et al.  Change detection in range imaging for 3D scene segmentation , 1996, Other Conferences.

[3]  Khoi Nguyen,et al.  Computer-vision-based registration techniques for augmented reality , 1996, Other Conferences.

[4]  Heinz Hügli,et al.  HOW WELL PERFORMS FREE-FORM 3D OBJECT RECOGNITION FROM RANGE IMAGES? , 1996 .

[5]  Paul Milgram,et al.  Telerobotic control using augmented reality , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[6]  Martial Hebert,et al.  Representation for computer vision , 1994 .

[7]  Tanneguy Redarce,et al.  Automatic inspection of industrial parts using 3D optical range sensor , 1995, Other Conferences.

[8]  Alain Tanguy,et al.  Virtual Reality as an Operative Tool During Scoliosis Surgery , 1995, CVRMed.

[9]  Martin Rutishauser,et al.  Merging range images of arbitrarily shaped objects , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[11]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[13]  Bernd Korn,et al.  Correct 3D Matching via a Fuzzy ICP Algorithm for Arbitrary Shaped Objects , 1996, DAGM-Symposium.