Smart home resident identification based on behavioral patterns using ambient sensors

In this paper, a novel approach is presented to identify the smart home residents. The different behavioral patterns of smart home’s inhabitants are exploited to distinguish the residents. The variation of a specific individual behavior in smart homes is a significant challenge. We introduce different features that are useful to handle this problem. Moreover, we introduce an innovative strategy which considers the Bag of Sensor Events and Bayesian networks. In the Bag of Sensor Events approach, the frequency of each sensor event occurrence is considered, regardless of the order of sensor events. The efficiency of the Bag of sensor Events approach is compared to the Sequence of Sensor Events. Our experiments confirm that the Bag of Sensor Events approach outperformed the previous approaches. When the smart homes residents are people who repeat their daily activities frequently, applying the Bag of Sensor Events on Activity Based Window Frame features, which considers the performed daily activities, would identify them more accurately. In contrast, in cases where residents perform their activities in different ways, considering the Time Based Window Frame leads to higher accuracy in distinguishing residents. In this approach, the features are created by considering the constant time intervals. The F-measure of our proposed approach on the Twor2009, Tulum2009, and Tulum2010 datasets is 96%, 100%, and 99%, respectively, which improves the results of the previous researches which consider behavioral patterns to identify smart home residents.

[1]  Hamid K. Aghajan,et al.  Extracting patterns of behavior from a network of binary sensors , 2015, J. Ambient Intell. Humaniz. Comput..

[2]  Dario Maio,et al.  On the use of the Kinect sensor for human identification in smart environments , 2014, J. Ambient Intell. Smart Environ..

[3]  Girish. R. Talmale,et al.  Medicine Reminder and Monitoring System for Secure Health Using IOT , 2016 .

[4]  Jie Yang,et al.  User Verification Leveraging Gait Recognition for Smartphone Enabled Mobile Healthcare Systems , 2015, IEEE Transactions on Mobile Computing.

[5]  Gustavo López,et al.  Human aspects of ubiquitous computing: a study addressing willingness to use it and privacy issues , 2016, J. Ambient Intell. Humaniz. Comput..

[6]  A. Mcgregor,et al.  Body-Worn Sensor Design: What Do Patients and Clinicians Want? , 2011, Annals of Biomedical Engineering.

[7]  Omprakash Gnawali,et al.  SonicDoor: A Person Identification System Based on Modeling of Shape, Behavior, and Walking Patterns , 2018, ACM Trans. Sens. Networks.

[8]  Jinsul Kim,et al.  Designing the Smart Foot Mat and Its Applications: as a User Identification Sensor for Smart Home Scenarios , 2015 .

[9]  Liang Dong,et al.  Implementing indoor positioning system via ZigBee devices , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[10]  Omprakash Gnawali,et al.  Nonintrusive ultrasonic-based occupant identification for energy efficient smart building applications , 2018, Applied Energy.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[13]  Nir Friedman,et al.  Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning , 2009 .

[14]  Minh-Son Nguyen,et al.  Resident Identification in Smart Home by Voice Biometrics , 2018, FDSE.

[15]  Özlem Durmaz Incel,et al.  ARAS human activity datasets in multiple homes with multiple residents , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[16]  Kamin Whitehouse,et al.  Using Height Sensors for Biometric Identification in Multi-resident Homes , 2010, Pervasive.

[17]  Diane J. Cook,et al.  Attributing events to individuals in multi-inhabitant environments , 2008 .

[18]  Nazar Abbas Saqib,et al.  Identification of Remote IoT Users Using Sensor Data Analytics , 2019 .

[19]  Minglu Li,et al.  FingerPass: Finger Gesture-based Continuous User Authentication for Smart Homes Using Commodity WiFi , 2019, MobiHoc.

[20]  Ghassem Mokhtari,et al.  Non-wearable human identification sensors for smart home environment: a review , 2018 .

[21]  Diane J. Cook,et al.  Resident and Caregiver: Handling Multiple People in a Smart Care Facility , 2008, AAAI Fall Symposium: AI in Eldercare: New Solutions to Old Problems.

[22]  I. T. Jolliffe,et al.  Choosing a Subset of Principal Components or Variables , 1986 .

[23]  Hossein Amirkhani,et al.  Smart home user identification using bag of events approach , 2017, 2017 7th International Conference on Computer and Knowledge Engineering (ICCKE).

[24]  Omar Elloumi,et al.  Internet-of-Things (IoT) , 2018, IEEE Commun. Stand. Mag..

[25]  Simon Haykin,et al.  Smart Home: Cognitive Interactive People-Centric Internet of Things , 2017, IEEE Communications Magazine.

[26]  Manuel Esteve,et al.  Fall detection system for elderly people using IoT and ensemble machine learning algorithm , 2019, Personal and Ubiquitous Computing.

[27]  Hongbo Liu,et al.  Smart User Authentication through Actuation of Daily Activities Leveraging WiFi-enabled IoT , 2017, MobiHoc.

[28]  Eshtiak Ahmed,et al.  A road to independent living with smart homes for people with disabilities , 2016, 2016 5th International Conference on Informatics, Electronics and Vision (ICIEV).

[29]  Diane J. Cook,et al.  CASAS: A Smart Home in a Box , 2013, Computer.

[30]  Marcus Oppitz,et al.  Inventing the Cloud Century , 2018 .

[31]  Li-Chen Fu,et al.  Context-aware activity prediction using human behavior pattern in real smart home environments , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[32]  João Gama,et al.  Discretization from data streams: applications to histograms and data mining , 2006, SAC.

[33]  Lawrence B. Holder,et al.  Discovering Activities to Recognize and Track in a Smart Environment , 2011, IEEE Transactions on Knowledge and Data Engineering.

[34]  Ziyan Wu,et al.  From the Lab to the Real World: Re-identification in an Airport Camera Network , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Saandeep Depatla,et al.  Occupancy Estimation Using Only WiFi Power Measurements , 2015, IEEE Journal on Selected Areas in Communications.

[36]  Jeffrey M. Voas,et al.  Verified Time , 2017, Computer.

[37]  Yang Liu,et al.  Collaborative Security , 2015, ACM Comput. Surv..

[38]  Lei Wang,et al.  Wearable biometric authentication based on human body communication , 2015, 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[39]  Kamin Whitehouse,et al.  Forma Track , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[40]  Jian Lu,et al.  Toward a Wearable RFID System for Real-Time Activity Recognition Using Radio Patterns , 2017, IEEE Trans. Mob. Comput..

[41]  Mohammed Feham,et al.  Multioccupant Activity Recognition in Pervasive Smart Home Environments , 2015, ACM Comput. Surv..

[42]  Ancy M,et al.  Medicine Reminder and Monitoring System for Secure Health using Iot , 2019, International Research Journal of Multidisciplinary Technovation.

[43]  Soon Ju Kang,et al.  Real-Time User Identification and Behavior Prediction Based on Foot-Pad Recognition , 2019, Sensors.

[44]  Diane J. Cook,et al.  Using a Hidden Markov Model for Resident Identification , 2010, 2010 Sixth International Conference on Intelligent Environments.

[45]  Tayeb Lemlouma,et al.  Adaptive monitoring system for e-health smart homes , 2018, Pervasive Mob. Comput..

[46]  Chris D. Nugent,et al.  From Activity Recognition to Intention Recognition for Assisted Living Within Smart Homes , 2017, IEEE Transactions on Human-Machine Systems.

[47]  Diane J. Cook,et al.  Behaviometrics for Identifying Smart Home Residents , 2013 .

[48]  Ghassem Mokhtari,et al.  Non-Wearable UWB Sensor for Human Identification in Smart Home , 2017, IEEE Sensors Journal.

[49]  Larry S. Davis,et al.  Person identification using automatic height and stride estimation , 2002, Object recognition supported by user interaction for service robots.

[50]  Jin Zhang,et al.  WiFi-ID: Human Identification Using WiFi Signal , 2016, 2016 International Conference on Distributed Computing in Sensor Systems (DCOSS).

[51]  Frédéric Lassabe,et al.  Indoor Wi-Fi positioning: techniques and systems , 2009, Ann. des Télécommunications.

[52]  Jian-Huang Lai,et al.  Person Re-Identification by Camera Correlation Aware Feature Augmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Ghassem Mokhtari,et al.  BLUESOUND: A New Resident Identification Sensor—Using Ultrasound Array and BLE Technology for Smart Home Platform , 2017, IEEE Sensors Journal.

[54]  Susan Elias,et al.  Probabilistic ontology based activity recognition in smart homes using Markov Logic Network , 2017, Knowl. Based Syst..

[55]  Salil S. Kanhere,et al.  Smart user identification using cardiopulmonary activity , 2019, Pervasive Mob. Comput..

[56]  Jung-Yoon Kim,et al.  Unobtrusive Monitoring to Detect Depression for Elderly With Chronic Illnesses , 2017, IEEE Sensors Journal.

[57]  Paul Lukowicz,et al.  Smart-surface: Large scale textile pressure sensors arrays for activity recognition , 2016, Pervasive Mob. Comput..

[58]  Yi-Ting Chiang,et al.  Strategies for Inference Mechanism of Conditional Random Fields for Multiple-Resident Activity Recognition in a Smart Home , 2010, IEA/AIE.

[59]  Omprakash Gnawali,et al.  Nonintrusive Occupant Identification by Sensing Body Shape and Movement , 2016, BuildSys@SenSys.

[60]  Diane J Cook,et al.  Assessing the Quality of Activities in a Smart Environment , 2009, Methods of Information in Medicine.

[61]  Mohammad Rahmati,et al.  Exploiting Experts’ Knowledge for Structure Learning of Bayesian Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Kyung-Yong Chung,et al.  Depression Index Service Using Knowledge Based Crowdsourcing in Smart Health , 2016, Wireless Personal Communications.

[63]  Nir Kshetri,et al.  Human Tagging , 2017, Computer.

[64]  Andrea Zanella,et al.  Internet of Things for Smart Cities , 2014, IEEE Internet of Things Journal.

[65]  Raimo Sepponen,et al.  Robust System for Indoor Localisation and Identification for the Health Care Environment , 2011, Wirel. Pers. Commun..

[66]  Zahir Tari,et al.  A context-aware approach for long-term behavioural change detection and abnormality prediction in ambient assisted living , 2015, Pattern Recognit..

[67]  Luca Benini,et al.  Human body heat for powering wearable devices: From thermal energy to application , 2017 .