Self-organizing neural networks for behavior modeling in games

This paper proposes self-organizing neural networks for modeling behavior of non-player characters (NPC) in first person shooting games. Specifically, two classes of self-organizing neural models, namely Self-Generating Neural Networks (SGNN) and Fusion Architecture for Learning and Cognition (FALCON) are used to learn non-player characters' behavior rules according to recorded patterns. Behavior learning abilities of these two models are investigated by learning specific sample Bots in the Unreal Tournament game in a supervised manner. Our empirical experiments demonstrate that both SGNN and FALCON are able to recognize important behavior patterns and learn the necessary knowledge to operate in the Unreal environment. Comparing with SGNN, FALCON is more effective in behavior learning, in terms of lower complexity and higher fighting competency.

[1]  Ah-Hwee Tan,et al.  Cascade ARTMAP: integrating neural computation and symbolic knowledge processing , 1997, IEEE Trans. Neural Networks.

[2]  H. Inoue,et al.  Self-organizing neural grove and its applications , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[3]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[4]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[5]  Mitsuo Kawato,et al.  A tennis serve and upswing learning robot based on bi-directional theory , 1998, Neural Networks.

[6]  Ah-Hwee Tan,et al.  Self-Organizing Neural Architectures and Cooperative Learning in a Multiagent Environment , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Ah-Hwee Tan,et al.  Creating Human-like Autonomous Players in Real-time First Person Shooter Computer Games , 2009 .

[8]  Ah-Hwee Tan,et al.  FALCON: a fusion architecture for learning, cognition, and navigation , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[9]  Yasuo Kuniyoshi,et al.  Qualitative Recognition of Ongoing Human Action Sequences , 1993, IJCAI.

[10]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[11]  Sorin Moga,et al.  From Perception-Action loops to imitation processes , 1998 .

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Larry R. Medsker,et al.  Hybrid Intelligent Systems , 1995, Springer US.

[14]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[15]  Ah-Hwee Tan,et al.  Direct Code Access in Self-Organizing Neural Networks for Reinforcement Learning , 2007, IJCAI.

[16]  Stephen Grossberg,et al.  Art 2: Self-Organization Of Stable Category Recognition Codes For Analog Input Patterns , 1988, Other Conferences.

[17]  Itsuki Noda,et al.  Hierarchical hidden Markov modeling for team-play in multiple agents , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[18]  Stephen Grossberg,et al.  Intelligence Through Interaction: Towards a Unified Theory for Learning , 2007, ISNN.

[19]  Christian Bauckhage,et al.  Bayesian Imitation of Human Behavior in Interactive Computer Games , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[20]  Huan Liu,et al.  Self-generating neural networks , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[21]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[22]  Ah-Hwee Tan,et al.  Integrating Temporal Difference Methods and Self-Organizing Neural Networks for Reinforcement Learning With Delayed Evaluative Feedback , 2008, IEEE Transactions on Neural Networks.

[23]  Thavida Maneewarn,et al.  Self-organizing approach for robot's behavior imitation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  H. Inoue,et al.  Effective online pruning method for ensemble self-generating neural networks , 2004, The 2004 47th Midwest Symposium on Circuits and Systems, 2004. MWSCAS '04..

[25]  Seung-Cheol Lee,et al.  Extracting Temporal Behavior Patterns of Mobile User , 2008, 2008 Fourth International Conference on Networked Computing and Advanced Information Management.

[26]  A. Jennings,et al.  Self-generating vs. self-organizing, what's different? , 1993, IEEE International Conference on Neural Networks.