Unsupervised Hybrid Learning Model ( UHLM ) as Combination of Supervised and Unsupervised Models

In this paper novel paradigm of Unsupervised Hybrid Learning Model is proposed based on usage of unsupervised learning model as teacher for supervised learning model. This approach is result of generalization of hybrid neural model MLP-ART2, proposed by authors in [7, 8, 9]. Also we propose novel architecture of Reinforcement Learning based on our paradigm and Multilayer Perceptron (MLP). In this architecture MLP is working in two modes: attraction of output vector to target and repulsion from target with respect to award. We propose also model MLP-ART-RL based on combination of model MLP-ART2 and Reinforcement Learning.

[1]  J. Elman.  Distributed Representations, Simple Recurrent Networks, And Grammatical Structure , 1991 .

[2]  Sungyoung Lee,et al.  Usage of Hybrid Neural Network Model MLP-ART for Navigation of Mobile Robot , 2009, ICIC.

[3]  Young-Koo Lee,et al.  Hybrid Neural Network Model Based on Multi-layer Perceptron and Adaptive Resonance Theory , 2006, ISNN.

[4]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[5]  M. Funabashi,et al.  Fuzzy and Neural Hybrid Expert Systems: Synergetic AI , 1995, IEEE Expert.

[6]  Min Tan,et al.  Neural Networks for Mobile Robot Navigation: A Survey , 2006, ISNN.

[7]  Jeffrey L. Elman,et al.  Distributed Representations, Simple Recurrent Networks, and Grammatical Structure , 1991, Mach. Learn..

[8]  Danica Janglova,et al.  Neural Networks in Mobile Robot Motion , 2004, ArXiv.

[9]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[10]  Satoshi Suzuki,et al.  A modular network scheme for unsupervised 3D object recognition , 2000, Neurocomputing.

[11]  Ah-Hwee Tan,et al.  FALCON: a fusion architecture for learning, cognition, and navigation , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[14]  Chih-Ming Chen,et al.  A self-organizing HCMAC neural-network classifier , 2003, IEEE Trans. Neural Networks.

[15]  Sungyoung Lee,et al.  An Approach for Invariant Clustering and Recognition in Dynamic Environment , 2007 .

[16]  Shie-Jue Lee,et al.  An ART-based construction of RBF networks , 2002, IEEE Trans. Neural Networks.

[17]  A.V. Gavrilov.  Hybrid neural network based on models of multilayer perceptron and adaptive resonance theory , 2005, Proceedings. The 9th Russian-Korean International Symposium on Science and Technology, 2005. KORUS 2005..

[18]  R. S. Baxter,et al.  Supervised adaptive resonance networks , 1991, ANNA '91.

[19]  Paul J. Werbos,et al.  Stable adaptive control using new critic designs , 1998, Other Conferences.

[20]  Jung-Hua Wang,et al.  Two-stage clustering via neural networks , 2003, IEEE Trans. Neural Networks.

[21]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[22]  Kang-Hyun Jo,et al.  Hybrid neural-based control system for mobile robot , 2004, Proceedings. The 8th Russian-Korean International Symposium on Science and Technology, 2004. KORUS 2004..

[23]  Gerald Sommer,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1994 .

[24]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[25]  Jian-Huang Lai,et al.  Face recognition using holistic Fourier invariant features , 2001, Pattern Recognit..

[26]  Liu Ning,et al.  Translation, Rotation and Scale-Invariant Object Recognition , 2001 .

[27]  Aude Billard,et al.  DRAMA, a Connectionist Architecture for Control and Learning in Autonomous Robots , 1999, Adapt. Behav..

[28]  N. Amosov,et al.  Transport Robot With Network Control System , 1975, IJCAI.

[29]  Sungyoung Lee,et al.  An Architecture of Hybrid Neural Network Based Navigation System for Mobile Robot , 2007, Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007).

[30]  Vassilios Petridis,et al.  Fuzzy lattice neural network (FLNN): a hybrid model for learning , 1998, IEEE Trans. Neural Networks.

[31]  Alexander N Gorban,et al.  The general approximation theorem , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).