A Novel Human Activity Recognition and Prediction in Smart Home Based on Interaction

Smart Homes are generally considered the final solution for living problem, especially for the health care of the elderly and disabled, power saving, etc. Human activity recognition in smart homes is the key to achieving home automation, which enables the smart services to automatically run according to the human mind. Recent research has made a lot of progress in this field; however, most of them can only recognize default activities, which is probably not needed by smart homes services. In addition, low scalability makes such research infeasible to be used outside the laboratory. In this study, we unwrap this issue and propose a novel framework to not only recognize human activity but also predict it. The framework contains three stages: recognition after the activity, recognition in progress, and activity prediction in advance. Furthermore, using passive RFID tags, the hardware cost of our framework is sufficiently low to popularize the framework. In addition, the experimental result demonstrates that our framework can realize good performance in both activity recognition and prediction with high scalability.

[1]  Araceli Sanchis,et al.  Activity Recognition Using Hybrid Generative/Discriminative Models on Home Environments Using Binary Sensors , 2013, Sensors.

[2]  Genevieve Dion,et al.  On implementing an unconventional infant vital signs monitor with passive RFID tags , 2017, 2017 IEEE International Conference on RFID (RFID).

[3]  Yuto Lim,et al.  Activity Recognition Using RFID Phase Profiling in Smart Library , 2019, IEICE Trans. Inf. Syst..

[4]  Robert Bergevin,et al.  Semantic human activity recognition: A literature review , 2015, Pattern Recognit..

[5]  Simon Haykin,et al.  Smart Home: Cognitive Interactive People-Centric Internet of Things , 2017, IEEE Communications Magazine.

[6]  Jiannong Cao,et al.  Efficient Range Queries for Large-Scale Sensor-Augmented RFID Systems , 2019, IEEE/ACM Transactions on Networking.

[7]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[8]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[9]  Din J. Wasem,et al.  Mining of Massive Datasets , 2014 .

[10]  Karthikeyan Sundaresan,et al.  RIO: A Pervasive RFID-based Touch Gesture Interface , 2017, MobiCom.

[11]  Jian Lu,et al.  An unsupervised approach to activity recognition and segmentation based on object-use fingerprints , 2010, Data Knowl. Eng..

[12]  Ennio Gambi,et al.  A Depth-Based Fall Detection System Using a Kinect® Sensor , 2014, Sensors.

[13]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[14]  Filippo Furfaro,et al.  Cleaning trajectory data of RFID-monitored objects through conditioning under integrity constraints , 2014, EDBT.

[15]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[16]  Jiannong Cao,et al.  Fast RFID Sensory Data Collection: Trade-off Between Computation and Communication Costs , 2019, IEEE/ACM Transactions on Networking.

[17]  Filippo Furfaro,et al.  Exploiting Integrity Constraints for Cleaning Trajectories of RFID-Monitored Objects , 2016, ACM Trans. Database Syst..

[18]  Filippo Furfaro,et al.  Offline cleaning of RFID trajectory data , 2014, SSDBM '14.

[19]  Zhiyang Li,et al.  A Low Overhead Progressive Transmission for Visual Descriptor Based on Image Saliency , 2015, J. Multiple Valued Log. Soft Comput..

[20]  Ivan Marsic,et al.  Activity recognition for medical teamwork based on passive RFID , 2016, 2016 IEEE International Conference on RFID (RFID).

[21]  Tao Gu,et al.  Object relevance weight pattern mining for activity recognition and segmentation , 2010, Pervasive Mob. Comput..

[22]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[23]  Yuto Lim,et al.  RF-Switch: A Novel Wireless Controller in Smart Home , 2018, 2018 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW).

[24]  Jie Wu,et al.  Fast Identification of Blocked RFID Tags , 2018, IEEE Transactions on Mobile Computing.

[25]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[26]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[27]  Matthai Philipose.  Large-Scale Human Activity Recognition Using Ultra-Dense Sensing , 2005 .

[28]  Kent Larson,et al.  The Design of a Portable Kit of Wireless Sensors for Naturalistic Data Collection , 2006, Pervasive.

[29]  Zhiyang Li,et al.  MVSS: Mobile Visual Search Based on Saliency , 2013, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing.

[30]  Kaishun Wu,et al.  GRfid: A Device-Free RFID-Based Gesture Recognition System , 2017, IEEE Transactions on Mobile Computing.

[31]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[32]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[33]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.