Incremental learning algorithms and applications

Incremental learning refers to learning from streaming data, which arrive over time, with limited memory resources and, ideally, without sacrificing model accuracy. This setting fits different application scenarios where lifelong learning is relevant, e.g. due to changing environments , and it offers an elegant scheme for big data processing by means of its sequential treatment. In this contribution, we formalise the concept of incremental learning, we discuss particular challenges which arise in this setting, and we give an overview about popular approaches, its theoretical foundations, and applications which emerged in the last years.

[1]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[2]  Maurice Milgram,et al.  Combining online and offline learning for tracking a talking face in video , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[3]  Jerzy Stefanowski,et al.  Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Kevin Leyton-Brown,et al.  Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms , 2012, KDD.

[5]  Prateek Jain,et al.  Online and Stochastic Gradient Methods for Non-decomposable Loss Functions , 2014, NIPS.

[6]  M. Giese,et al.  Norm-based face encoding by single neurons in the monkey inferotemporal cortex , 2006, Nature.

[7]  Johan A. K. Suykens,et al.  Incremental kernel spectral clustering for online learning of non-stationary data , 2014, Neurocomputing.

[8]  Shaogang Gong,et al.  Incremental Activity Modeling in Multiple Disjoint Cameras , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  R. French.  Dynamically constraining connectionist networks to produce distributed, orthogonal representations to reduce catastrophic interference , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[10]  Sebastian Thrun,et al.  Toward robotic cars , 2010, CACM.

[11]  Sebastiano Impedovo,et al.  A novel prototype generation technique for handwriting digit recognition , 2014, Pattern Recognit..

[12]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[13]  Frank-Michael Schleif,et al.  Sparse conformal prediction for dissimilarity data , 2014, Annals of Mathematics and Artificial Intelligence.

[14]  Eduardo Vinicius Kuhn,et al.  Analysis of the TDLMS algorithm operating in a nonstationary environment , 2015, Digit. Signal Process..

[15]  Nasser L. Azad,et al.  A robust safety-oriented autonomous cruise control scheme for electric vehicles based on model predictive control and online sequential extreme learning machine with a hyper-level fault tolerance-based supervisor , 2015, Neurocomputing.

[16]  Bogdan M. Wilamowski,et al.  Efficient incremental construction of RBF networks using quasi-gradient method , 2015, Neurocomputing.

[17]  Chaomin Luo,et al.  L3-SVM: a lifelong learning method for SVM , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[18]  Shaoning Pang,et al.  Adaptive incremental principal component analysis in nonstationary online learning environments , 2009, 2009 International Joint Conference on Neural Networks.

[19]  Jianping Fan,et al.  Cost-sensitive learning of hierarchical tree classifiers for large-scale image classification and novel category detection , 2015, Pattern Recognit..

[20]  R. Desimone,et al.  Clustering of perirhinal neurons with similar properties following visual experience in adult monkeys , 2000, Nature Neuroscience.

[21]  François Poulet,et al.  Parallel incremental SVM for classifying million images with very high-dimensional signatures into thousand classes , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[22]  Olivier Chapelle,et al.  Training a Support Vector Machine in the Primal , 2007, Neural Computation.

[23]  Yimin Wen,et al.  Incremental Learning of Support Vector Machines by Classifier Combining , 2007, PAKDD.

[24]  Gregory D. Hager,et al.  An incremental approach to learning generalizable robot tasks from human demonstration , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Ambuj Tewari,et al.  Online learning via sequential complexities , 2010, J. Mach. Learn. Res..

[26]  Gianmarco De Francisci Morales,et al.  SAMOA: scalable advanced massive online analysis , 2015, J. Mach. Learn. Res..

[27]  Zhongfei Zhang,et al.  An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Olivier Sigaud,et al.  On-line regression algorithms for learning mechanical models of robots: A survey , 2011, Robotics Auton. Syst..

[29]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[30]  M. Hasselmo,et al.  The effect of learning on the face selective responses of neurons in the cortex in the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.

[31]  Gang Yin,et al.  Online fault diagnosis method based on Incremental Support Vector Data Description and Extreme Learning Machine with incremental output structure , 2014, Neurocomputing.

[32]  Martial Mermillod,et al.  The stability-plasticity dilemma: investigating the continuum from catastrophic forgetting to age-limited learning effects , 2013, Front. Psychol..

[33]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[34]  Haibo He,et al.  Imbalanced evolving self-organizing learning , 2014, Neurocomputing.

[35]  Zhiqiong Wang,et al.  Elastic extreme learning machine for big data classification , 2015, Neurocomputing.

[36]  Zhixun Su,et al.  Robust visual tracking via incremental low-rank features learning , 2014, Neurocomputing.

[37]  Kaizhu Huang,et al.  DE2: Dynamic ensemble of ensembles for learning nonstationary data , 2015, Neurocomputing.

[38]  Hao Wang,et al.  Learning concept-drifting data streams with random ensemble decision trees , 2015, Neurocomputing.

[39]  Congxu Zhu,et al.  Online Regularized and Kernelized Extreme Learning Machines with Forgetting Mechanism , 2014 .

[40]  Kai Ma,et al.  Compound Exemplar Based Object Detection by Incremental Random Forest , 2014, 2014 22nd International Conference on Pattern Recognition.

[41]  Huanhuan Chen,et al.  Efficient Probabilistic Classification Vector Machine With Incremental Basis Function Selection , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Gregory Ditzler,et al.  Learning in Nonstationary Environments: A Survey , 2015, IEEE Computational Intelligence Magazine.

[43]  Moamar Sayed Mouchaweh,et al.  Dynamic supervised classification method for online monitoring in non-stationary environments , 2014, Neurocomputing.

[44]  Min Liu,et al.  An incremental extreme learning machine for online sequential learning problems , 2014, Neurocomputing.

[45]  Nicolò Cesa-Bianchi,et al.  Splitting with confidence in decision trees with application to stream mining , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[46]  Mark D. Reid,et al.  Fast rates in statistical and online learning , 2015, J. Mach. Learn. Res..

[47]  Norman M Weinberger,et al.  The nucleus basalis and memory codes: Auditory cortical plasticity and the induction of specific, associative behavioral memory , 2003, Neurobiology of Learning and Memory.

[48]  Ehud Rivlin,et al.  Online action recognition using covariance of shape and motion , 2014, Comput. Vis. Image Underst..

[49]  Chee Peng Lim,et al.  An incremental meta-cognitive-based scaffolding fuzzy neural network , 2016, Neurocomputing.

[50]  Ernestina Menasalvas Ruiz,et al.  Mining Recurring Concepts in a Dynamic Feature Space , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[51]  André da Motta Salles Barreto,et al.  On-line Reinforcement Learning Using Incremental Kernel-Based Stochastic Factorization , 2012, NIPS.

[52]  Guo-Zheng Li,et al.  Incremental partial least squares analysis of big streaming data , 2014, Pattern Recognit..

[53]  Claudio Gentile,et al.  On higher-order perceptron algorithms , 2007, NIPS.

[54]  Zongben Xu,et al.  Universal Approximation of Extreme Learning Machine With Adaptive Growth of Hidden Nodes , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[55]  Stefan Schaal,et al.  Locally Weighted Projection Regression : An O(n) Algorithm for Incremental Real Time Learning in High Dimensional Space , 2000 .

[56]  Bin Gu,et al.  Incremental learning for ν-Support Vector Regression , 2015, Neural Networks.

[57]  Michael M Merzenich,et al.  Perceptual Learning Directs Auditory Cortical Map Reorganization through Top-Down Influences , 2006, The Journal of Neuroscience.

[58]  Cesare Alippi,et al.  Just in time classifiers: Managing the slow drift case , 2009, 2009 International Joint Conference on Neural Networks.

[59]  Noel E. Sharkey,et al.  An Analysis of Catastrophic Interference , 1995, Connect. Sci..

[60]  Masashi Sugiyama,et al.  Computationally Efficient Class-Prior Estimation under Class Balance Change Using Energy Distance , 2016, IEICE Trans. Inf. Syst..

[61]  Stefan Kramer,et al.  Pruning Incremental Linear Model Trees with Approximate Lookahead , 2014, IEEE Transactions on Knowledge and Data Engineering.

[62]  Paolo Napoletano,et al.  An interactive tool for manual, semi-automatic and automatic video annotation , 2015, Comput. Vis. Image Underst..

[63]  Yee Whye Teh,et al.  Mondrian Forests: Efficient Online Random Forests , 2014, NIPS.

[64]  Shen Furao,et al.  Using self-organizing incremental neural network (SOINN) For radial basis function networks , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[65]  Martin V. Butz,et al.  Computational Complexity of the XCS Classifier System , 2005 .

[66]  Vladimir Vovk,et al.  A tutorial on conformal prediction , 2007, J. Mach. Learn. Res..

[67]  Bala Srinivasan,et al.  Adaptive mobile activity recognition system with evolving data streams , 2015, Neurocomputing.

[68]  Robi Polikar,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011, IEEE Transactions on Neural Networks.

[69]  Stéphan Clémençon,et al.  Efficient eigen-updating for spectral graph clustering , 2013, Neurocomputing.

[70]  Fernando Gomide,et al.  Evolving Intelligent Systems: Methods, Algorithms and Applications , 2013 .

[71]  Dimitrios Gunopulos,et al.  Incremental support vector machine construction , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[72]  Francesc J. Ferri,et al.  Incremental Generalized Discriminative Common Vectors for Image Classification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[73]  Pierre-Yves Oudeyer,et al.  Incremental local online Gaussian Mixture Regression for imitation learning of multiple tasks , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[74]  Alexander Gepperth,et al.  A Bio-Inspired Incremental Learning Architecture for Applied Perceptual Problems , 2016, Cognitive Computation.

[75]  Shaoning Pang,et al.  A federated network online network traffics analysis engine for cybersecurity , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[76]  Barbara Hammer,et al.  Topographic Mapping of Large Dissimilarity Data Sets , 2010, Neural Computation.

[77]  Mário A. T. Figueiredo,et al.  Incremental filter and wrapper approaches for feature discretization , 2014, Neurocomputing.

[78]  Michael Biehl,et al.  Adaptive Relevance Matrices in Learning Vector Quantization , 2009, Neural Computation.

[79]  Benoît Frénay,et al.  Feature ranking in changing environments where new features are introduced , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[80]  Argyris Kalogeratos,et al.  Dip-means: an incremental clustering method for estimating the number of clusters , 2012, NIPS.

[81]  Jun Zhou,et al.  An incremental structured part model for object recognition , 2015, Neurocomputing.

[82]  Alexey Tsymbal,et al.  The problem of concept drift: definitions and related work , 2004 .

[83]  Michael Biehl,et al.  Dynamics and Generalization Ability of LVQ Algorithms , 2007, J. Mach. Learn. Res..

[84]  Jonathan P. How,et al.  Human aware UAS path planning in urban environments using nonstationary MDPs , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[85]  André van Schaik,et al.  Online and adaptive pseudoinverse solutions for ELM weights , 2015, Neurocomputing.

[86]  Masashi Sugiyama,et al.  Importance-weighted covariance estimation for robust common spatial pattern , 2014, Pattern Recognit. Lett..

[87]  Roshani Ade,et al.  Incremental Learning From Unbalanced Data with Concept Class, Concept Drift and Missing Features : A Review , 2014 .

[88]  Zhigang Luo,et al.  Online Nonnegative Matrix Factorization With Robust Stochastic Approximation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[89]  Juan Ramón Rico-Juan,et al.  Adaptive training set reduction for nearest neighbor classification , 2014, Neurocomputing.

[90]  Pierre Beauseroy,et al.  Dynamic Feature Subspaces Selection for Decision in a Nonstationary Environment , 2015, Int. J. Pattern Recognit. Artif. Intell..

[91]  François Brémond,et al.  Hierarchical and incremental event learning approach based on concept formation models , 2013, Neurocomputing.

[92]  Sanjoy Dasgupta,et al.  Incremental Clustering: The Case for Extra Clusters , 2014, NIPS.

[93]  Li Zhang,et al.  Locally Linear Embedding algorithm based on OMP for incremental learning , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[94]  Aryan Mokhtari,et al.  Global convergence of online limited memory BFGS , 2014, J. Mach. Learn. Res..

[95]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[96]  Masashi Sugiyama,et al.  Learning under nonstationarity: covariate shift and class‐balance change , 2013 .

[97]  Stéphane Lecoeuche,et al.  Application of an incremental SVM algorithm for on-line human recognition from video surveillance using texture and color features , 2014, Neurocomputing.

[98]  Chuancai Liu,et al.  Two dimensional hashing for visual tracking , 2015, Comput. Vis. Image Underst..

[99]  Hamid Beigy,et al.  An adaptive regression tree for non-stationary data streams , 2013, SAC '13.

[100]  Bogdan J. Matuszewski,et al.  Recursive non-rigid structure from motion with online learned shape prior , 2013, Comput. Vis. Image Underst..

[101]  R. French.  Catastrophic forgetting in connectionist networks , 1999, Trends in Cognitive Sciences.

[102]  Yoshua Bengio,et al.  An Empirical Investigation of Catastrophic Forgeting in Gradient-Based Neural Networks , 2013, ICLR.

[103]  T. Palmeri,et al.  Not just the norm: Exemplar-based models also predict face aftereffects , 2014, Psychonomic Bulletin & Review.

[104]  Kuk-Jin Yoon,et al.  Robust Online Multi-object Tracking Based on Tracklet Confidence and Online Discriminative Appearance Learning , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[105]  M. Hasselmo.  The role of acetylcholine in learning and memory , 2006, Current Opinion in Neurobiology.

[106]  Mohamed Limam,et al.  An ensemble method for concept drift in nonstationary environment , 2013 .

[107]  Lei Liu,et al.  Describing and learning of related parts based on latent structural model in big data , 2016, Neurocomputing.

[108]  Qin Qin,et al.  Robust visual tracking based on incremental discriminative projective non-negative matrix factorization , 2015, Neurocomputing.

[109]  Amit K. Roy-Chowdhury,et al.  Incremental Activity Modeling and Recognition in Streaming Videos , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[110]  Xizhao Wang,et al.  Architecture selection for networks trained with extreme learning machine using localized generalization error model , 2013, Neurocomputing.

[111]  Robert Sabourin,et al.  Adaptive appearance model tracking for still-to-video face recognition , 2016, Pattern Recognit..

[112]  Koby Crammer,et al.  Second-order non-stationary online learning for regression , 2013, J. Mach. Learn. Res..

[113]  Felipe Maia Galvão França,et al.  Multilingual part-of-speech tagging with weightless neural networks , 2015, Neural Networks.

[114]  Philippe Gaussier,et al.  How can a robot evaluate its own behavior? A neural model for self-assessment , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[115]  Lei Huang,et al.  Online semi-supervised annotation via proxy-based local consistency propagation , 2015, Neurocomputing.

[116]  Xiong Xiao,et al.  A Load-Balancing Self-Organizing Incremental Neural Network , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[117]  Matteo Saveriano,et al.  Incremental kinesthetic teaching of end-effector and null-space motion primitives , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[118]  Stephen Grossberg,et al.  Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world , 2013, Neural Networks.

[119]  Vasant Honavar,et al.  Learn++: an incremental learning algorithm for supervised neural networks , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[120]  Joshua D. Knowles,et al.  Hellinger Distance Trees for Imbalanced Streams , 2014, 2014 22nd International Conference on Pattern Recognition.

[121]  Heiko Wersing,et al.  Combining offline and online classifiers for life-long learning , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[122]  Plamen P. Angelov,et al.  PANFIS: A Novel Incremental Learning Machine , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[123]  José del Campo-Ávila,et al.  Online and Non-Parametric Drift Detection Methods Based on Hoeffding’s Bounds , 2015, IEEE Transactions on Knowledge and Data Engineering.

[124]  Stefan Rüping,et al.  Incremental Learning with Support Vector Machines , 2001, ICDM.

[125]  Bogdan M. Wilamowski,et al.  A Hybrid Constructive Algorithm for Single-Layer Feedforward Networks Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[126]  Thomas Villmann,et al.  Limited Rank Matrix Learning, discriminative dimension reduction and visualization , 2012, Neural Networks.

[127]  Ming Cong,et al.  Robotic cognitive behavior control based on biology-inspired Episodic memory , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[128]  Jan Peters,et al.  Local Gaussian process regression for real-time model-based robot control , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[129]  Hong Sun,et al.  Improved incremental Regularized Extreme Learning Machine Algorithm and its application in two-motor decoupling control , 2015, Neurocomputing.

[130]  Minho Lee,et al.  Incremental two-dimensional kernel principal component analysis , 2014, Neurocomputing.

[131]  Rua-Huan Tsaih,et al.  Network-traffic anomaly detection with incremental majority learning , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[132]  Daniel L. Silver,et al.  Machine Lifelong Learning: Challenges and Benefits for Artificial General Intelligence , 2011, AGI.

[133]  Dirk Wollherr,et al.  IBuILD: Incremental bag of Binary words for appearance based loop closure detection , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[134]  Qin Qin,et al.  Moving object detection based on incremental learning low rank representation and spatial constraint , 2015, Neurocomputing.

[135]  Gregory Ditzler,et al.  Incremental Learning of Concept Drift from Streaming Imbalanced Data , 2013, IEEE Transactions on Knowledge and Data Engineering.

[136]  Francisco Escolano,et al.  Entropy-Based Incremental Variational Bayes Learning of Gaussian Mixtures , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[137]  Maria do Carmo Nicoletti,et al.  Ensemble of complete P-partite graph classifiers for non-stationary environments , 2013, 2013 IEEE Congress on Evolutionary Computation.

[138]  Hailin Zhang,et al.  Merging model-based two-dimensional principal component analysis , 2015, Neurocomputing.

[139]  Rebecca Willett,et al.  From minimax value to low-regret algorithms for online Markov decision processes , 2014, 2014 American Control Conference.

[140]  Constantine Kotropoulos,et al.  Online PLSA: Batch Updating Techniques Including Out-of-Vocabulary Words , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[141]  Amit K. Roy-Chowdhury,et al.  Incremental learning of human activity models from videos , 2016, Comput. Vis. Image Underst..

[142]  Amir Hussain,et al.  An online generalized eigenvalue version of Laplacian Eigenmaps for visual big data , 2016, Neurocomputing.

[143]  Simon Fong,et al.  A Very Fast Decision Tree Algorithm for Real-Time Data Mining of Imperfect Data Streams in a Distributed Wireless Sensor Network , 2012, Int. J. Distributed Sens. Networks.

[144]  Nitesh V. Chawla,et al.  Learning in non-stationary environments with class imbalance , 2012, KDD.

[145]  T. Watkin,et al.  THE STATISTICAL-MECHANICS OF LEARNING A RULE , 1993 .

[146]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[147]  Zhijun Zhang,et al.  Adaptive incremental learning of image semantics with application to social robot , 2016, Neurocomputing.

[148]  Marc Toussaint,et al.  Special Issue on Autonomous Learning , 2015, KI - Künstliche Intelligenz.

[149]  Rebecca Willett,et al.  Online Convex Optimization in Dynamic Environments , 2015, IEEE Journal of Selected Topics in Signal Processing.

[150]  Haibo He,et al.  Learning and modeling big data , 2014, ESANN.

[151]  L’oubli catastrophique it,et al.  Avoiding catastrophic forgetting by coupling two reverberating neural networks , 2004 .

[152]  Cong Wang,et al.  Learning From Adaptive Neural Dynamic Surface Control of Strict-Feedback Systems , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[153]  Vincent Lemaire,et al.  Incremental decision tree based on order statistics , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[154]  Laura Balzano,et al.  Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[155]  Robert M. French,et al.  Semi-distributed Representations and Catastrophic Forgetting in Connectionist Networks , 1992 .

[156]  Heiko Wersing,et al.  Interactive online learning for obstacle classification on a mobile robot , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[157]  Karsten Berns,et al.  Special Issue on Intelligent Autonomous Systems , 2015 .

[158]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[159]  R. O’Reilly.  The Division of Labor Between the Neocortex and Hippocampus , 2010 .

[160]  Jürgen Schmidhuber,et al.  Explore to see, learn to perceive, get the actions for free: SKILLABILITY , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[161]  Wei Xu,et al.  Inexact and incremental bilinear Lanczos components algorithms for high dimensionality reduction and image reconstruction , 2015, Pattern Recognit..

[162]  Robi Polikar,et al.  Guest Editorial Learning in Nonstationary and Evolving Environments , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[163]  E. Rosch.  Cognitive reference points , 1975, Cognitive Psychology.

[164]  Johan A. K. Suykens,et al.  Incremental multi-class semi-supervised clustering regularized by Kalman filtering , 2015, Neural Networks.

[165]  Anthony V. Robins,et al.  Catastrophic Forgetting, Rehearsal and Pseudorehearsal , 1995, Connect. Sci..

[166]  Olivier Simonin,et al.  Assistance and Service Robotics in a Human Environment , 2017, Robotics Auton. Syst..

[167]  Giorgio Metta,et al.  Real-time model learning using Incremental Sparse Spectrum Gaussian Process Regression. , 2013, Neural networks : the official journal of the International Neural Network Society.

[168]  Stefan Schaal,et al.  Incremental Local Gaussian Regression , 2014, NIPS.

[169]  Seiichi Ozawa,et al.  A fast Incremental Kernel Principal Component Analysis for data streams , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).