Markov-optimal sensing policy for user state estimation in mobile devices

Mobile device based human-centric sensing and user state recognition provide rich contextual information for various mobile applications and services. However, continuously capturing this contextual information consumes significant amount of energy and drains mobile device battery quickly. In this paper, we propose a computationally efficient algorithm to obtain the optimal sensor sampling policy under the assumption that the user state transition is Markovian. This Markov-optimal policy minimizes user state estimation error while satisfying a given energy consumption budget. We first compare the Markov-optimal policy with uniform periodic sensing for Markovian user state transitions and show that the improvements obtained depend upon the underlying state transition probabilities. We then apply the algorithm to two different sets of real experimental traces pertaining to user motion change and inter-user contacts and show that the Markov-optimal policy leads to an approximately 20% improvement over the naive uniform sensing policy.

[1]  Deborah Estrin,et al.  A framework for data quality and feedback in participatory sensing , 2007, SenSys '07.

[2]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[3]  Albrecht Schmidt,et al.  Advanced Interaction in Context , 1999, HUC.

[4]  Wei Wang,et al.  Adaptive contact probing mechanisms for delay tolerant applications , 2007, MobiCom '07.

[5]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[6]  Jens Zander,et al.  Energy-efficient detection of intermittent interference in wireless sensor networks , 2010, Int. J. Sens. Networks.

[7]  Eugene A. Feinberg,et al.  Markov Decision Models with Weighted Discounted Criteria , 1994, Math. Oper. Res..

[8]  Eugene A. Feinberg,et al.  Constrained Markov Decision Models with Weighted Discounted Rewards , 1995, Math. Oper. Res..

[9]  Patrick P. Tsang,et al.  DEAMON: Energy-efficient Sensor Monitoring , 2009, 2009 6th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[10]  Emiliano Miluzzo,et al.  CenceMe - Injecting Sensing Presence into Social Networking Applications , 2007, EuroSSC.

[11]  Keith W. Ross,et al.  Optimal priority assignment with hard constraint , 1986 .

[12]  Andreas Krause,et al.  SenSay: a context-aware mobile phone , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[13]  S. Feldstein,et al.  Markovian Model of Time Patterns of Speech , 1964, Science.

[14]  Bhaskar Krishnamachari,et al.  Findings from an empirical study of fine-grained human social contacts , 2009, 2009 Sixth International Conference on Wireless On-Demand Network Systems and Services.

[15]  B. P. Murphy,et al.  Handbook of Methods of Applied Statistics , 1968 .

[16]  John S. Edwards,et al.  Linear Programming and Finite Markovian Control Problems , 1983 .

[17]  Bhaskar Krishnamachari,et al.  The Tradeoff between Energy Efficiency and User State Estimation Accuracy in Mobile Sensing , 2009, MobiCASE.

[18]  M. Bartlett.  The frequency goodness of fit test for probability chains , 1951, Mathematical Proceedings of the Cambridge Philosophical Society.

[19]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[20]  Aurel A. Lazar,et al.  Optimal flow control of a class of queueing networks in equilibrium , 1983 .

[21]  Tajana Simunic,et al.  Poster abstract: Energy management in wireless healthcare systems , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[22]  M. Hansen,et al.  Participatory Sensing , 2019, Internet of Things.

[23]  Jun Yang,et al.  Constraint chaining: on energy-efficient continuous monitoring in sensor networks , 2006, SIGMOD Conference.

[24]  Andreas Krause,et al.  Trading off prediction accuracy and power consumption for context-aware wearable computing , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[25]  Pan Hui,et al.  Pocket Switched Networks: Real-world mobility and its consequences for opportunistic forwarding , 2005 .

[26]  Youngki Lee,et al.  SeeMon: scalable and energy-efficient context monitoring framework for sensor-rich mobile environments , 2008, MobiSys '08.

[27]  Mani B. Srivastava,et al.  Energy efficient sampling for event detection in wireless sensor networks , 2009, ISLPED.

[28]  Romit Roy Choudhury,et al.  Micro-Blog: sharing and querying content through mobile phones and social participation , 2008, MobiSys '08.

[29]  E. Altman.  Constrained Markov Decision Processes , 1999 .

[30]  Romit Roy Choudhury,et al.  Energy-Efficient Localization via Personal Mobility Profiling , 2009, MobiCASE.

[31]  Yi Wang,et al.  A framework of energy efficient mobile sensing for automatic user state recognition , 2009, MobiSys '09.

[32]  Gaetano Borriello,et al.  Mobile Context Inference Using Low-Cost Sensors , 2005, LoCA.

[33]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[34]  Priti Aghera.  Energy Management in Wireless Healthcare Systems Using Dynamic Task Assignment , 2010 .