A Neural Network Model for Learning Data Stream with Multiple Class Labels

In this paper, we extend the sequential multitask learning model called Resource Allocating Network for Multi-Task Pattern Recognition (RAN-MTPR) proposed by Nishikawa et al. such that it can learn a training sample with multiple class labels which are originated from different lassification tasks. Here, we assume that no task information is given for training samples. Therefore, the extended RAN-MTPR has to allocate multiple class labels to appropriate tasks under unsupervised settings. This is carried out based on the prediction errors in the output sections, and the most probable task is selected from the output section with a minimum error. Through the computer simulations using the ORL face dataset, we show that the extended RAN-MTPR works well as a multitask learning model.

[1]  C A Nelson,et al.  Learning to Learn , 2017, Encyclopedia of Machine Learning and Data Mining.

[2]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[3]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[4]  Seiichi Ozawa,et al.  Radial Basis Function Network for Multitask Pattern Recognition , 2011, Neural Processing Letters.

[5]  Rich Caruana,et al.  Multitask pattern recognition for autonomous robots , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[6]  Jonathan Baxter,et al.  A Bayesian/Information Theoretic Model of Learning to Learn via Multiple Task Sampling , 1997, Machine Learning.

[7]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[8]  Yoshua Bengio,et al.  Bias learning, knowledge sharing , 2003, IEEE Trans. Neural Networks.

[9]  Nikola Kasabov,et al.  Evolving Connectionist Systems: Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines , 2002, IEEE Transactions on Neural Networks.

[10]  D. Silver,et al.  Selective Functional Transfer : Inductive Bias from Related Tasks , 2001 .

[11]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[12]  Shigeo Abe,et al.  Incremental learning of feature space and classifier for face recognition , 2005, Neural Networks.

[13]  Robert E. Mercer,et al.  The Task Rehearsal Method of Life-Long Learning: Overcoming Impoverished Data , 2002, Canadian Conference on AI.

[14]  Shigeo Abe,et al.  Reducing computations in incremental learning for feedforward neural network with long-term memory , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[15]  Shaoning Pang,et al.  Incremental Learning of Chunk Data for Online Pattern Classification Systems , 2008, IEEE Transactions on Neural Networks.

[16]  Shiliang Sun,et al.  A Multitask Learning Approach to Face Recognition Based on Neural Networks , 2008, IDEAL.