SensePresence: Infrastructure-Less Occupancy Detection for Opportunistic Sensing Applications

Predicting the occupancy related information in an environment has been investigated to satisfy the myriad requirements of various evolving pervasive, ubiquitous, opportunistic and participatory sensing applications. Infrastructure and ambient sensors based techniques have been leveraged largely to determine the occupancy of an environment incurring a significant deployment and retrofitting costs. In this paper, we advocate an infrastructure-less zero-configuration multimodal smartphone sensor-based techniques to detect fine-grained occupancy information. We propose to exploit opportunistically smartphones' acoustic sensors in presence of human conversation and motion sensors in absence of any conversational data. We develop a novel speaker estimation algorithm based on unsupervised clustering of overlapped and non-overlapped conversational data to determine the number of occupants in a crowded environment. We also design a hybrid approach combining acoustic sensing opportunistically with locomotive model to further improve the occupancy detection accuracy. We evaluate our algorithms in different contexts, conversational, silence and mixed in presence of 10 domestic users. Our experimental results on real-life data traces collected from 10 occupants in natural setting show that using this hybrid approach we can achieve approximately 0.76 error count distance for occupancy detection accuracy on average.

[1]  Daben Liu,et al.  Fast speaker change detection for broadcast news transcription and indexing , 1999, EUROSPEECH.

[2]  Prashant J. Shenoy,et al.  Non-Intrusive Occupancy Monitoring using Smart Meters , 2013, BuildSys@SenSys.

[3]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[4]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[5]  Hideki Kawahara,et al.  YIN, a fundamental frequency estimator for speech and music. , 2002, The Journal of the Acoustical Society of America.

[6]  Paul Fearnhead,et al.  Exact and efficient Bayesian inference for multiple changepoint problems , 2006, Stat. Comput..

[7]  Chuohao Yeo,et al.  Modeling Dominance in Group Conversations Using Nonverbal Activity Cues , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[8]  Lie Lu,et al.  Real-time unsupervised speaker change detection , 2002, Object recognition supported by user interaction for service robots.

[9]  Inseok Hwang,et al.  SocioPhone: everyday face-to-face interaction monitoring platform using multi-phone sensor fusion , 2013, MobiSys '13.

[10]  Jie Liu,et al.  SpeakerSense: Energy Efficient Unobtrusive Speaker Identification on Mobile Phones , 2011, Pervasive.

[11]  Hervé Bourlard,et al.  Robust speaker change detection , 2004, IEEE Signal Processing Letters.

[13]  B.Y. Smolenski,et al.  Blind Speaker Clustering , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[14]  Kevin P. Murphy,et al.  Modeling changing dependency structure in multivariate time series , 2007, ICML '07.

[15]  Wilhelm Kleiminger,et al.  Opportunistic Sensing for Efficient Energy Usage in Private Households , 2011 .

[16]  Robert F. Orlikoff,et al.  Clinical Speech and Voice Measurement: Laboratory Exercises , 1993 .

[17]  Thomas Weng,et al.  Duty-cycling buildings aggressively: The next frontier in HVAC control , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[18]  Luís A. Castro,et al.  Collaborative opportunistic sensing with mobile phones , 2014, UbiComp Adjunct.

[19]  Andrzej Banaszuk,et al.  Model-based Real-Time Estimation of Building Occupancy During Emergency Egress , 2010 .

[20]  Wei Pan,et al.  SoundSense: scalable sound sensing for people-centric applications on mobile phones , 2009, MobiSys '09.

[21]  Alex Pentland,et al.  Sensing and modeling human networks using the sociometer , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[22]  Jun Li,et al.  Crowd++: unsupervised speaker count with smartphones , 2013, UbiComp.

[23]  Paul Strauss,et al.  Clinical Measurement Of Speech And Voice , 2016 .

[24]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[25]  Archan Misra,et al.  GruMon: fast and accurate group monitoring for heterogeneous urban spaces , 2014, SenSys.

[26]  Rhys Goldstein,et al.  Real-time occupancy detection using decision trees with multiple sensor types , 2011, SpringSim.