Smart Home Monitoring System via Footstep-Induced Vibrations

Instead of using traditional intrusive surveillance technologies such as cameras or body sensors, we propose a smart home system sensing the footstep-induced vibrations to feature the same functions which can be used for the assisted-living purpose. Based on distributed sensing and processing units, we adopt a distributed computing approach to preprocess the time-series data, recognize footstep signals, and extract vibration features locally. Through communications over the sensor networks, our system is capable to estimate the occupancy via counting the number of occupants. Besides, based on the multicomponent seismometer sensing system, we propose a novel indoor footstep localization method called angle constrained time difference of arrivals relying on both angle and arrival information of the recorded waveforms. According to separated pedestrian locations, different trajectories of multiple people can be tracked. From the location-tracking history, the resident's daily activities and social interactions can be inferred. In our experiments, the proposed system obtains promising results. Specifically, the location error is 0.14 m with a 0.11 m standard deviation. And the multipeople identification accuracy is above 87.83%.

[1]  Fangyu Li,et al.  Automatic Event Detection on Noisy Microseismograms , 2014 .

[2]  Ji Wan,et al.  Sparse Online Learning of Image Similarity , 2017, ACM Trans. Intell. Syst. Technol..

[3]  Li-Chen Fu,et al.  Design and Realization of a Framework for Human–System Interaction in Smart Homes , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Jung Wook Park,et al.  Estimation of Indoor Physical Activity Level Based on Footstep Vibration Signal Measured by MEMS Accelerometer in Smart Home Environments , 2009, MELT.

[5]  Yongdong Zhang,et al.  Adaptive weighted imbalance learning with application to abnormal activity recognition , 2016, Neurocomputing.

[6]  Igor Bisio,et al.  Speaker Count application for smartphone platforms , 2010, IEEE 5th International Symposium on Wireless Pervasive Computing 2010.

[7]  Bin Li,et al.  An enhanced fall detection system for elderly person monitoring using consumer home networks , 2014, IEEE Transactions on Consumer Electronics.

[8]  Xiangyang Li,et al.  Indoor Person Identification and Fall Detection through Non-intrusive Floor Seismic Sensing , 2019, 2019 IEEE International Conference on Smart Computing (SMARTCOMP).

[9]  Narendra Kumar Dhar,et al.  On an Integrated Approach to Networked Climate Control of a Smart Home , 2018, IEEE Systems Journal.

[10]  Petre Anghelescu,et al.  Human footstep detection using seismic sensors , 2015, 2015 7th International Conference on Electronics, Computers and Artificial Intelligence (ECAI).

[11]  Jun Li,et al.  Crowd++: unsupervised speaker count with smartphones , 2013, UbiComp.

[12]  Jose Clemente,et al.  Smart Seismic Sensing for Indoor Fall Detection, Location, and Notification , 2020, IEEE Journal of Biomedical and Health Informatics.

[13]  Donald E. Brown,et al.  Health-status monitoring through analysis of behavioral patterns , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  B.Y. Smolenski,et al.  A Speaker Count System for Telephone Conversations , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[15]  Raveendran Paramesran,et al.  Measure of image sharpness using eigenvalues , 2007, Inf. Sci..

[16]  Hae Young Noh,et al.  Indoor Person Identification through Footstep Induced Structural Vibration , 2015, HotMobile.

[17]  Jeffrey D. Poston,et al.  ILoViT: Indoor Localization via Vibration Tracking , 2018 .

[18]  Hae Young Noh,et al.  Occupant traffic estimation through structural vibration sensing , 2016, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[19]  Shuangquan Wang,et al.  Unobtrusive Sensing Incremental Social Contexts Using Fuzzy Class Incremental Learning , 2015, 2015 IEEE International Conference on Data Mining.

[20]  Hongjian Sun,et al.  User-Centric Multiobjective Approach to Privacy Preservation and Energy Cost Minimization in Smart Home , 2018, IEEE Systems Journal.

[21]  Soumyajit Mandal,et al.  An “Internet of Ears” for crowd-aware smart buildings based on sparse sensor networks , 2017, 2017 IEEE SENSORS.

[22]  Jin Wang,et al.  Multimodel Framework for Indoor Localization Under Mobile Edge Computing Environment , 2019, IEEE Internet of Things Journal.

[23]  Feng Zhou,et al.  A Case-Driven Ambient Intelligence System for Elderly in-Home Assistance Applications , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Fei Yu,et al.  A Real-Time Dynamic Pricing Algorithm for Smart Grid With Unstable Energy Providers and Malicious Users , 2016, IEEE Internet of Things Journal.

[25]  Yuansheng Luo,et al.  A Decision Function Based Smart Charging and Discharging Strategy for Electric Vehicle in Smart Grid , 2018, Mobile Networks and Applications.

[26]  Hae Young Noh,et al.  FootprintID , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[27]  Peng Luo,et al.  Multi-camera transfer GAN for person re-identification , 2019, J. Vis. Commun. Image Represent..

[28]  Lu Wang,et al.  FLoc: Device-free passive indoor localization in complex environments , 2017, 2017 IEEE International Conference on Communications (ICC).

[29]  Hae Young Noh,et al.  Characterizing wave propagation to improve indoor step-level person localization using floor vibration , 2016, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[30]  Mamun Bin Ibne Reaz,et al.  A Review of Smart Homes—Past, Present, and Future , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Dafang Zhang,et al.  Energy-Aware Routing for SWIPT in Multi-Hop Energy-Constrained Wireless Network , 2018, IEEE Access.

[32]  Wen-Zhan Song,et al.  Automatic arrival identification system for real-time microseismic event location , 2017 .

[33]  J. Sabatier,et al.  Vibration and sound signatures of human footsteps in buildings. , 2006, The Journal of the Acoustical Society of America.

[34]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[35]  Alberto Cerpa,et al.  Occupancy based demand response HVAC control strategy , 2010, BuildSys '10.

[36]  Maureen Schmitter-Edgecombe,et al.  Automated Cognitive Health Assessment Using Smart Home Monitoring of Complex Tasks , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[37]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[38]  Diane J. Cook,et al.  DETECTION OF SOCIAL INTERACTION IN SMART SPACES , 2010, Cybern. Syst..

[39]  Hae Young Noh,et al.  Structural sensing system with networked dynamic sensing configuration , 2015, IPSN '15.

[40]  Faheem Zafari,et al.  Microlocation for Internet-of-Things-Equipped Smart Buildings , 2015, IEEE Internet of Things Journal.

[41]  Hae Young Noh,et al.  Multiple Pedestrian Tracking through Ambient Structural Vibration Sensing: Poster Abstract , 2016, SenSys.

[42]  Wen-Zhan Song,et al.  Dynamic Time-frequency Feature Extraction for Brain Activity Recognition , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[43]  Bin Fu,et al.  An improved FPT algorithm for Almost Forest Deletion problem , 2018, Inf. Process. Lett..

[44]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[45]  Shiming He,et al.  Interference-Aware Multisource Transmission in Multiradio and Multichannel Wireless Network , 2019, IEEE Systems Journal.