Object location based on sensor fusion of visual and tactual sensing

The paper describes a solution of object orientation findings based upon the sensor fusion problems between visual sensing and tactual sensing. We focus on the induction of the tactual images used for identifying the orientation of an object in a sensor fusion system made up on the geodesic dome. As an object is set up at the center of the geodesic dome, its image is taken by the camera positioned at the center of the facet on the geodesic dome. Also, robot fingers take tactual images on the finger behavior. If an object's image taken by the camera is identified with the image model of the facet on the geodesic dome, the position and orientation of the camera which takes its image are determined from the facet on the geodesic dome. As the tactual image corresponds to the image induced from the facet on the geodesic dome, the orientation of object is confirmed from the tactual image. Computer simulations show the effectiveness of the proposed method.

[1]  Ingemar J. Cox,et al.  Concurrent Programming and Robotics , 1989, Int. J. Robotics Res..

[2]  Mark H. Lee,et al.  A Survey of Robot Tactile Sensing Technology , 1989, Int. J. Robotics Res..

[3]  Kazunori Umeda,et al.  Sensing of contact point between a grasped object and environment by tactile behavior of a parallel two-fingered hand , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[4]  Michael Ian Shamos,et al.  Computational geometry: an introduction , 1985 .

[5]  Tamio Arai,et al.  Fusion of range image and intensity image for 3D shape recognition , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Kazuo Tanie,et al.  Haptic aspect graph representation of 3-D object shapes , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[7]  Takeo Kanade,et al.  Automatic generation of object recognition programs , 1988, Proc. IEEE.

[8]  Konstantinos A. Tarabanis,et al.  A survey of sensor planning in computer vision , 1995, IEEE Trans. Robotics Autom..