A virtual Environment Interface to Compare Autonomous Perceptual Systems

This paper describes the on-going development of a novel interface approach to understanding complex systems. We present a description of an interface, referred to as a Homunculus, which allows an experimenter to explore complex systems through immersive virtual reality technology. We describe an initial application under development where the Encephalon, a biologically motivated neural architecture, is used to control a robotics system. Encephalon modules are represented in the Homunculus as 3¬D icons. Information flow between modules of the neural network is represented as graphical animations. Virtual tools will be available to view, manipulate, model, diagnose, analyze, and navigate through the software and multi¬dimensional data. We discuss many important research questions revealed by this work.

[1]  Nadine Miner,et al.  An interactive virtual reality simulation system for robot control and operator training , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[2]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[3]  K. Asakawa,et al.  Mobile robot control by a structured hierarchical neural network , 1990, IEEE Control Systems Magazine.

[4]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[5]  James Gettys,et al.  The X window system , 1990 .

[6]  T. P. Caudell,et al.  Adaptive resonance theory networks in the Encephalon autonomous vision system , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[7]  V. Braitenberg.  Vehicles, Experiments in Synthetic Psychology , 1984 .

[8]  Konstantinos Konstantinides,et al.  The Khoros software development environment for image and signal processing , 1994, IEEE Trans. Image Process..

[9]  Klaus Schulten,et al.  Implementation of self-organizing neural networks for visuo-motor control of an industrial robot , 1993, IEEE Trans. Neural Networks.

[10]  T. P. Caudell,et al.  An efficient neural network architecture for recognition of spatial pattern invariants , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[11]  Abhijit S. Pandya,et al.  A recurrent neural network controller and learning algorithm for the on-line learning control of autonomous underwater vehicles , 1994, Neural Networks.

[12]  Masahiro ISHII,et al.  A 3D interface device with force feedback: a virtual work space for pick-and-place tasks , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[13]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[14]  Allen M. Waxman,et al.  Mobile robot visual mapping and localization: A view-based neurocomputational architecture that emulates hippocampal place learning , 1994, Neural Networks.

[15]  Susumu Tachi,et al.  Evaluation Experiments of a Teleexistence Manipulation System , 1994, Presence: Teleoperators & Virtual Environments.

[16]  Thomas P. Caudell,et al.  A neural architecture for pattern sequence verification through inferencing , 1993, IEEE Trans. Neural Networks.

[17]  Naohiro Fukumura,et al.  Learning goal-directed sensory-based navigation of a mobile robot , 1994, Neural Networks.

[18]  W. Uttal.  An integrated computational model of an autonomous, visually guided undersea vehicle , 1994, Proceedings of 1994 3rd IEEE International Workshop on Robot and Human Communication.

[19]  H.M. Abdel-Wahab,et al.  XTV: a framework for sharing X Window clients in remote synchronous collaboration , 1991, Proceedings of TRICOMM `91: IEEE Conference on Communications Software: Communications for Distributed Applications and Systems.

[20]  Stephen Grossberg,et al.  Invariant recognition of cluttered scenes by a self-organizing ART architecture: CORT-X boundary segmentation , 1989, Neural Networks.

[21]  W. Penfield.  The Cerebral Cortex of Man , 1950 .

[22]  Michael Anderson,et al.  NIRS: Large scale ART-1 neural architectures for engineering design retrieval , 1994, Neural Networks.

[23]  Carla S. Williams,et al.  An integrated data flow visual language and software development environment , 1991, J. Vis. Lang. Comput..

[24]  Michitaka Hirose,et al.  A virtual reality application for software visualization , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[25]  Stephen Grossberg,et al.  A what-and-where neural network for invariant image preprocessing , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[26]  Allen M. Waxman,et al.  Visual learning, adaptive expectations, and behavioral conditioning of the mobile robot MAVIN , 1991, Neural Networks.

[27]  Elizabeth M. Wenzel,et al.  Localization in Virtual Acoustic Displays , 1992, Presence: Teleoperators & Virtual Environments.

[28]  Allen M. Waxman,et al.  Adaptive 3-D Object Recognition from Multiple Views , 1992, IEEE Trans. Pattern Anal. Mach. Intell..