The recent development of microcomputers enables the execution of complex software in small embedded systems. Artificial intelligence is one form of software to be embedded into such devices. However, almost all embedded systems still have restricted storage space. One of the authors has already proposed an incremental learning method for regression, which works under a fixed storage space; however, this method cannot support the multivalued functions that usually appear in real-world problems. One way to support the multivalued function is to use the model regression method with a kernel density estimator. However, this method assumes that all sample points are recorded as kernel centroids, which is not suitable for small embedded systems. In this paper, we propose a minimum modal regression method that reduces the number of kernels using a projection method. The conditions required to maintain accuracy are derived through theoretical analysis. The experimental results show that our method reduces the number of kernels while maintaining a specified level of accuracy.
[1]
Koichiro Yamauchi,et al.
An importance weighted projection method for incremental learning under unstationary environments
,
2013,
The 2013 International Joint Conference on Neural Networks (IJCNN).
[2]
G. Tutz,et al.
Modelling beyond regression functions: an application of multimodal regression to speed–flow data
,
2006
.
[3]
Barbara Caputo,et al.
The projectron: a bounded kernel-based Perceptron
,
2008,
ICML '08.
[4]
Si Wu,et al.
A kernel-based Perceptron with dynamic memory
,
2012,
Neural Networks.
[5]
Masashi Sugiyama,et al.
Modal Regression via Direct Log-Density Derivative Estimation
,
2016,
ICONIP.
[6]
E. Parzen.
On Estimation of a Probability Density Function and Mode
,
1962
.
[7]
Koichiro Yamauchi,et al.
Incremental learning on a budget and its application to quick maximum power point tracking of photovoltaic systems
,
2012,
The 6th International Conference on Soft Computing and Intelligent Systems, and The 13th International Symposium on Advanced Intelligence Systems.