ARTISAN: An Integrated Scene Mapping and Object Recognition System

Integration of three-dimensional textured scene mapping and object recognition presents many opportunities for assisted automation. We present Artisan, a software package that synthesizes these elements to form a user-friendly whole. Artisan uses a variety of 3D sensors, including laser range scanners and stereo systems, to acquire both image and range data. Artisan automatically finds the transformations between data taken at multiple sensor viewpoints using matching algorithms. The data from these viewpoints are then merged together to form an integrated textured map of the entire scene. Other user or sensor input can also inserted into the scene. Using object recognition with an expandable library of objects, Artisan can identify and locate simple and complex scene features. With this identity and transformation information, it is able to support many operations, including semi-automatic robotic teleoperation and navigation. After mapping and recognition, the identity, position, and orientation of the objects in the scene can be automatically transferred from the Artisan system into other software, including robotic teleoperation packages. Numerous opportunities for automation exist during the operations stage as a result of this increased world knowledge. This work was performed under contracts DE-AR26-97FT34314 and DE-AC21-92MC29104 for the Department of Energy, Federal Energy Technology Center, Morgantown, West Virginia.

[1]  Andrew E. Johnson,et al.  Recognizing objects by matching oriented points , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Martial Hebert,et al.  Efficient multiple model recognition in cluttered 3-D scenes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[3]  Martial Hebert,et al.  A system for semi-automatic modeling of complex environments , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[4]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[5]  Larry H. Matthies,et al.  A photo-realistic 3-D mapping system for extreme nuclear environments: Chernobyl , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[6]  Andrew E. Johnson,et al.  Surface registration by matching oriented points , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[7]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[8]  Larry H. Matthies,et al.  Virtual reality mapping system for Chernobyl accident site assessment , 1999, Electronic Imaging.

[9]  Andrew E. Johnson,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).