Neural sensor fusion for spatial visualization on a mobile robot

An ARTMAP neural network is used to integrate visual information and ultrasonic sensory information on a B14 mobile robot. Training samples for the neural network are acquired without human intervention. Sensory snapshots are retrospectively associated with the distance to the wall, provided by on-board odometry as the robot travels in a straight line. The goal is to produce a more accurate measure of distance than is provided by the raw sensors. The neural network effectively combines sensory sources both within and between modalities. The improved distance percept is used to produce occupancy grid visualizations of the robot's environment. The maps produced point to specific problems of raw sensory information processing and demonstrate the benefits of using a neural network system for sensor fusion.

[1]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[2]  Ben J. A. Kröse,et al.  Neural Network Applications in Sensor Fusion for an Autonomous Mobile Robot , 1995, Reasoning with Uncertainty in Robotics.

[3]  Yoram Koren,et al.  Error eliminating rapid ultrasonic firing for mobile robot obstacle avoidance , 1995, IEEE Trans. Robotics Autom..

[4]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[5]  Robin R. Murphy,et al.  Biological and cognitive foundations of intelligent sensor fusion , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[6]  Ian Horswill.  Visual collision avoidance by segmentation , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[7]  Sebastian Thrun,et al.  Learning Maps for Indoor Mobile Robot Navigation. , 1996 .

[8]  Artur Dubrawski,et al.  Artificial neural network for mobile robot topological localization , 1995, Robotics Auton. Syst..

[9]  Gail A. Carpenter,et al.  ARTMAP-IC and medical diagnosis: Instance counting and inconsistent cases , 1998, Neural Networks.

[10]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[11]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[12]  Ren C. Luo,et al.  Multisensor integration and fusion in intelligent systems , 1989, IEEE Trans. Syst. Man Cybern..

[13]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[14]  Gail A. Carpenter,et al.  Mobile Robot Sensor Fusion with Fuzzy ARTMAP , 1998 .

[15]  Shin'ichi Yuta,et al.  Exploring unknown environment and map construction using ultrasonic sensing of normal direction of walls , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[16]  Mongi A. Abidi,et al.  Data fusion in robotics and machine intelligence , 1992 .