SonicDoor: A Person Identification System Based on Modeling of Shape, Behavior, and Walking Patterns

Non-intrusive occupant identification enables numerous applications in Smart Buildings such as personalization of climate and lighting. Current techniques do not scale beyond 20 people, whereas commercial buildings have 100 or more people. This article proposes a new method to identify occupants by sensing their body shape, movement, and walking patterns as they walk through a SonicDoor, a door instrumented with three ultrasonic sensors. The proposed method infers contextual information, such as paths and historical walks through different doors of the building. Each SonicDoor is instrumented with ultrasonic ping sensors, one on top sensing height and two on the sides of the door sensing width of the person walking through the door. SonicDoor detects a walking event and analyzes it to infer whether the Walker is using a phone, holding a handbag, or wearing a backpack. It extracts a set of features from the walking event and corrects them using a set of transformation functions to mitigate the bias. We deployed five SonicDoors in a real building for two months and collected data consisting of over 9,000 walking events spanning over 170 people. The proposed method identifies 100 occupants with an accuracy of 90.2%, which makes it suitable for commercial buildings.

[1]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Fu Li-Chen,et al.  Inhabitants Tracking System in a Cluttered Home Environment Via Floor Load Sensors , 2008, IEEE Transactions on Automation Science and Engineering.

[3]  Chasity DeLoney Person Identification and Gender Recognition from Footstep Sound using Modulation Analysis , 2008 .

[4]  Omprakash Gnawali,et al.  Sonicdoor: scaling person identification with ultrasonic sensors by novel modeling of shape, behavior and walking patterns , 2017, BuildSys@SenSys.

[5]  Omprakash Gnawali,et al.  Nonintrusive Occupant Identification by Sensing Body Shape and Movement , 2016, BuildSys@SenSys.

[6]  Daniele Puccinelli,et al.  Welcome and committees2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS) , 2014 .

[7]  James A. McHugh,et al.  Automated fingerprint recognition using structural matching , 1990, Pattern Recognit..

[8]  Kamin Whitehouse,et al.  Using Height Sensors for Biometric Identification in Multi-resident Homes , 2010, Pervasive.

[9]  Hae Young Noh,et al.  Indoor Person Identification through Footstep Induced Structural Vibration , 2015, HotMobile.

[10]  Feng Zhao,et al.  Information processing in sensor networks (IPSN'04) , 2004, SIGBED.

[11]  Ricardo J. G. B. Campello,et al.  Density-Based Clustering Based on Hierarchical Density Estimates , 2013, PAKDD.

[12]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[13]  Jin Zhang,et al.  Human identification using WiFi signal , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[14]  Kamin Whitehouse,et al.  Doorjamb: unobtrusive room-level tracking of people in homes using doorway sensors , 2012, SenSys '12.

[15]  Yu Yao,et al.  An RF doormat for tracking people's room locations , 2013, UbiComp.

[16]  Mahadev Satyanarayanan,et al.  OpenFace: A general-purpose face recognition library with mobile applications , 2016 .

[17]  Kalyan Pathapati Subbu,et al.  A location aware personalized smart control system , 2014, IPSN 2014.

[18]  Pei Zhang,et al.  Securitas: user identification through RGB-NIR camera pair on mobile devices , 2013, SPSM '13.

[19]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[20]  Li-Chen Fu,et al.  Inhabitants Tracking System in a Cluttered Home Environment Via Floor Load Sensors , 2008, IEEE Trans Autom. Sci. Eng..

[21]  Gregory D. Abowd,et al.  The smart floor: a mechanism for natural user identification and tracking , 2000, CHI Extended Abstracts.

[22]  Timothy F. Cootes,et al.  An Automatic Face Identification System Using Flexible Appearance Models , 1994, BMVC.

[23]  Xin Pan,et al.  ARIEL: automatic wi-fi based room fingerprinting for indoor localization , 2012, UbiComp.

[24]  Carla Schlatter Ellis,et al.  Using Ground Reaction Forces from Gait Analysis: Body Mass as a Weak Biometric , 2007, Pervasive.

[25]  Katrin Baumgartner,et al.  Human Factors In Computing Systems , 2016 .

[26]  Björn Schuller,et al.  Acoustic Gait-based Person Identification using Hidden Markov Models , 2014, MAPTRAITS '14.

[27]  Lionel Torres,et al.  Person Identification Technique Using Human Iris Recognition , 2002 .

[28]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[29]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .