Self-Learning Pipeline for Low-Energy Resource-Constrained Devices

The trend of bringing machine learning (ML) to the Internet of Things (IoT) field devices is becoming ever more relevant, also reducing the overall energy need of the applications. ML models are usually trained in the cloud and then deployed on edge devices. Most IoT devices generate large amounts of unlabeled data, which are expensive and challenging to annotate. This paper introduces the self-learning autonomous edge learning and inferencing pipeline (AEP), deployable in a resource-constrained embedded system, which can be used for unsupervised local training and classification. AEP uses two complementary approaches: pseudo-label generation with a confidence measure using k-means clustering and periodic training of one of the supported classifiers, namely decision tree (DT) and k-nearest neighbor (k-NN), exploiting the pseudo-labels. We tested the proposed system on two IoT datasets. The AEP, running on the STM NUCLEO-H743ZI2 microcontroller, achieves comparable accuracy levels as same-type models trained on actual labels. The paper makes an in-depth performance analysis of the system, particularly addressing the limited memory footprint of embedded devices and the need to support remote training robustness.

[1]  Devottam Gaurav,et al.  Smart home health monitoring system for predicting type 2 diabetes and hypertension , 2020, J. King Saud Univ. Comput. Inf. Sci..

[2]  R. Alshahrani,et al.  Delay Analysis in IoT Sensor Networks † , 2021, Sensors.

[3]  Mikhail Zymbler,et al.  Internet of Things is a revolutionary approach for future technology enhancement: a review , 2019, Journal of Big Data.

[4]  Kevin I-Kai Wang,et al.  Deep-Learning-Enhanced Human Activity Recognition for Internet of Healthcare Things , 2020, IEEE Internet of Things Journal.

[5]  Johan Lukkien,et al.  Multi-task Self-Supervised Learning for Human Activity Detection , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[6]  Steven Euijong Whang,et al.  A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective , 2018, IEEE Transactions on Knowledge and Data Engineering.

[7]  Hai Jin,et al.  Computation Offloading Toward Edge Computing , 2019, Proceedings of the IEEE.

[8]  Bin Gao,et al.  Structural Health Monitoring Framework Based on Internet of Things: A Survey , 2017, IEEE Internet of Things Journal.

[9]  Riccardo Berta,et al.  Atmosphere, an Open Source Measurement-Oriented Data Framework for IoT , 2021, IEEE Transactions on Industrial Informatics.

[10]  F. Bellotti,et al.  Exploring Unsupervised Learning on STM32 F4 Microcontroller , 2020, ApplePies.

[11]  Jorge Cabral,et al.  Machine Learning in Resource-Scarce Embedded Systems, FPGAs, and End-Devices: A Survey , 2019, Electronics.

[12]  Raneem Qaddoura,et al.  A Multi-Stage Classification Approach for IoT Intrusion Detection Based on Clustering with Oversampling , 2021, Applied Sciences.

[13]  Jong Hyuk Park,et al.  Semi-supervised learning based distributed attack detection framework for IoT , 2018, Appl. Soft Comput..

[14]  Jingtong Hu,et al.  Enabling On-Device CNN Training by Self-Supervised Instance Filtering and Error Map Pruning , 2020, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[15]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[16]  Flora D. Salim,et al.  Federated Self-Supervised Learning of Multisensor Representations for Embedded Intelligence , 2020, IEEE Internet of Things Journal.

[17]  Holger H. Hoos,et al.  A survey on semi-supervised learning , 2019, Machine Learning.

[18]  S. Mercy Shalinie,et al.  Learning-Driven Detection and Mitigation of DDoS Attack in IoT via SDN-Cloud Architecture , 2020, IEEE Internet of Things Journal.

[19]  Fillia Makedon,et al.  A Survey on Contrastive Self-supervised Learning , 2020, Technologies.

[20]  Riccardo Berta,et al.  Machine Learning on Mainstream Microcontrollers † , 2020, Sensors.

[21]  Xianbin Wang,et al.  Live Data Analytics With Collaborative Edge and Cloud Processing in Wireless IoT Networks , 2017, IEEE Access.