Incremental knowledge acquisition and self learning from text

Incremental learning is a core necessity in developments towards intelligent machines. Artificial learning as implemented in contemporary neural network algorithms does not fully encompass an incremental, autonomous learning capacity. In this paper we present a self learning algorithm capable of incrementally acquiring knowledge across learning periods. A dynamic unsupervised learning algorithm, the GSOM algorithm, forms the basis of the presented incrementally knowledge acquiring self learning (IKASL) algorithm, to which we have introduced a layer of aggregation for continuous learning, knowledge acquisition and retention. We also present a novel application of the IKASL algorithm for continuous learning of hidden patterns from semantics of text.

[1]  Fred Henrik Hamker,et al.  Life-long learning Cell Structures--continuously learning without catastrophic interference , 2001, Neural Networks.

[2]  Marti A. Hearst.  Untangling Text Data Mining , 1999, ACL.

[3]  Ronald R. Yager.  Element selection from a fuzzy subset using the fuzzy integral , 1993, IEEE Trans. Syst. Man Cybern..

[4]  Keon Myung Lee,et al.  Identification of λ-fuzzy measure by genetic algorithms , 1995, Fuzzy Sets Syst..

[5]  Shen Furao,et al.  An incremental network for on-line unsupervised classification and topology learning , 2006, Neural Networks.

[6]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[7]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[8]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[9]  Teuvo Kohonen,et al.  In: Self-organising Maps , 1995 .

[10]  C. Gilbert,et al.  The Neural Basis of Perceptual Learning , 2001, Neuron.

[11]  Yi Lu Murphey,et al.  Incremental Learning for Text Document Classification , 2007, 2007 International Joint Conference on Neural Networks.

[12]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[13]  E I Knudsen,et al.  Computational maps in the brain. , 1987, Annual review of neuroscience.

[14]  Gerard Salton,et al.  A vector space model for automatic indexing , 1975, CACM.

[15]  Vasant Honavar,et al.  Learn++: an incremental learning algorithm for supervised neural networks , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[16]  Terrence J. Sejnowski,et al.  Self-Organizing Map Formation: Foundations of Neural Computation , 2001 .

[17]  Hujun Yin,et al.  Learning Nonlinear Principal Manifolds by Self-Organising Maps , 2008 .

[18]  Bala Srinivasan,et al.  Dynamic self-organizing maps with controlled growth for knowledge discovery , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Pragya Agarwal,et al.  Self-Organising Maps , 2008 .

[20]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[21]  A. Ennaji,et al.  An incremental growing neural gas learns topologies , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[22]  Daniel Sánchez,et al.  Text Knowledge Mining: An Alternative to Text Data Mining , 2008, 2008 IEEE International Conference on Data Mining Workshops.

[23]  C. L. Brewer.  Psychology: Science, Behavior and Life. , 1990 .