Lightweight Modal Regression for Stand Alone Embedded Systems

Although the CPU power of recent embedded systems has increased, their storage space is still limited. To overcome this limitation, most embedded devices are connected to a cloud server so they can outsource heavy calculations. However, some applications must handle private data, meaning internet connections are undesirable based on security concerns. Therefore, small devices that handle private data should be able to work without internet connections. This paper presents a limited modal regression model that restricts the number of internal units to a certain fixed number. Modal regression can be used for multivalued function approximation with limited sensory inputs. In this study, a kernel density estimator (KDE) with a fixed number of kernels called “limited KDE” was constructed. We will demonstrate how to implement the limited KDE and how to construct a lightweight algorithm for modal regression using a system-on-chip field-programmable gate array device.

[1]  G. Tutz,et al.  Modelling beyond regression functions: an application of multimodal regression to speed–flow data , 2006 .

[2]  Koichiro Yamauchi A Quick Maximum Power Point Tracking Method Using an Embedded Learning Algorithm for Photovoltaics on Roads , 2018 .

[3]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[4]  Koichiro Yamauchi,et al.  Swap Kernel Regression , 2019, ICANN.

[5]  Runze Li,et al.  Local modal regression , 2012, Journal of nonparametric statistics.

[6]  Stefan Duffner,et al.  Routine Modeling with Time Series Metric Learning , 2019, ICANN.

[7]  Masashi Sugiyama,et al.  Modal Regression via Direct Log-Density Derivative Estimation , 2016, ICONIP.

[8]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[9]  Haibo He,et al.  SOMKE: Kernel Density Estimation Over Data Streams by Sequences of Self-Organizing Maps , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[10]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[11]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[12]  Sang Lyul Min,et al.  LRFU: A Spectrum of Policies that Subsumes the Least Recently Used and Least Frequently Used Policies , 2001, IEEE Trans. Computers.

[13]  Koichiro Yamauchi,et al.  Minimum Modal Regression , 2018, ICPRAM.

[14]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.