Tracking Human Motions in Photographing

Due to the portability of smart phones, more and more people tend to take photos with smart phones. However, energy-saving continues to be a thorny problem, since photographing is a rather power hungry function. To extend the battery life of phones while taking photos, we propose a context-aware energy-saving scheme called “SenSave.” SenSave senses the user’s activities during photographing and adopts suitable energy-saving strategies accordingly. SenSave works based on the observation that a lot of energy during photographing is wasted in preparations before shooting. By leveraging the low power-consuming embedded sensors, such as accelerometer and gyroscope, we can recognize the user’s activities and reduce unnecessary energy consumption. Besides, by maintaining an activity state machine, SenSave can determine the user’s activity progressively and improve the recognition accuracy. Experiment results show that SenSave can recognize the user’s activities with an average accuracy of 95.5% and reduce the energy consumption during photographing by 30.0%, when compared to the approach by frequently turning ON/OFF the camera or screen. Additionally, we enhance “SenSave” by introducing an extended Markov chain to predict the next activity state and adopt the energy-saving strategy in advance. Then, we can reduce the energy consumption during photographing by 36.1%.

[1]  Youngki Lee,et al.  PowerForecaster: Predicting Smartphone Power Impact of Continuous Sensing Applications at Pre-installation Time , 2015, SenSys.

[2]  Wazir Zada Khan,et al.  Mobile Phone Sensing Systems: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[3]  Qiang Li,et al.  Collaborative Recognition of Queuing Behavior on Mobile Phones , 2016, IEEE Transactions on Mobile Computing.

[4]  Fanglin Chen,et al.  Unobtrusive sleep monitoring using smartphones , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[5]  Guoliang Xing,et al.  iSleep: unobtrusive sleep quality monitoring using smartphones , 2013, SenSys '13.

[6]  Lin Zhong,et al.  Self-constructive high-rate system energy modeling for battery-powered mobile systems , 2011, MobiSys '11.

[7]  Samarjit Chakraborty,et al.  Power management using game state detection on android smartphones , 2013, MobiSys '13.

[8]  Guohong Cao,et al.  Energy-aware video streaming on smartphones , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[9]  Murat Demirbas,et al.  LineKing: Coffee Shop Wait-Time Monitoring Using Smartphones , 2015, IEEE Transactions on Mobile Computing.

[10]  Zhiquan Wang,et al.  Recognition of human activities using SVM multi-class classifier , 2010, Pattern Recognit. Lett..

[11]  Xinyu Zhang,et al.  Ubiquitous keyboard for small mobile devices: harnessing multipath fading for fine-grained keystroke localization , 2014, MobiSys.

[12]  Yiran Chen,et al.  How is energy consumed in smartphone display applications? , 2013, HotMobile '13.

[13]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[14]  Chen Wang,et al.  Fine-grained sleep monitoring: Hearing your breathing with smartphones , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[15]  Minglu Li,et al.  Sensing Human-Screen Interaction for Energy-Efficient Frame Rate Adaptation on Smartphones , 2015, IEEE Transactions on Mobile Computing.

[16]  Yunhao Liu,et al.  Sherlock: Micro-Environment Sensing for Smartphones , 2014, IEEE Transactions on Parallel and Distributed Systems.

[17]  Alex X. Liu,et al.  Secure unlocking of mobile touch screen devices by simple gestures: you can see it but you can not do it , 2013, MobiCom.

[18]  Minglu Li,et al.  E3: energy-efficient engine for frame rate adaptation on smartphones , 2013, SenSys '13.

[19]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[20]  Gernot Heiser,et al.  An Analysis of Power Consumption in a Smartphone , 2010, USENIX Annual Technical Conference.

[21]  Inseok Hwang,et al.  E-Gesture: a collaborative architecture for energy-efficient gesture recognition with hand-worn sensor and mobile devices , 2011, SenSys.

[22]  Yafeng Yin,et al.  A Context Aware Energy-Saving Scheme for Smart Camera Phones Based on Activity Sensing , 2015, 2015 IEEE 12th International Conference on Mobile Ad Hoc and Sensor Systems.

[23]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[24]  Srikanth V. Krishnamurthy,et al.  Mobility-Assisted Energy-Aware User Contact Detection in Mobile Social Networks , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[25]  Arun Venkataramani,et al.  Energy consumption in mobile phones: a measurement study and implications for network applications , 2009, IMC '09.

[26]  Vigneshwaran Subbaraju,et al.  Energy-Efficient Continuous Activity Recognition on Mobile Phones: An Activity-Adaptive Approach , 2012, 2012 16th International Symposium on Wearable Computers.

[27]  Ramesh Govindan,et al.  Energy-delay tradeoffs in smartphone applications , 2010, MobiSys '10.

[28]  Qun Li,et al.  CamK: A camera-based keyboard for small mobile devices , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[29]  Paramvir Bahl,et al.  Energy characterization and optimization of image sensing toward continuous mobile vision , 2013, MobiSys '13.

[30]  Samsu Sempena,et al.  Human action recognition using Dynamic Time Warping , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[31]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[32]  Yoshihiro Kawahara,et al.  Compressed sensing method for human activity sensing using mobile phone accelerometers , 2012, 2012 Ninth International Conference on Networked Sensing (INSS).

[33]  Suman Nath,et al.  ACE: Exploiting Correlation for Energy-Efficient and Continuous Context Sensing , 2012, IEEE Transactions on Mobile Computing.

[34]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[35]  Yunxin Liu,et al.  Optimizing Smartphone Power Consumption through Dynamic Resolution Scaling , 2015, MobiCom.

[36]  Christian Poellabauer,et al.  Workload-Aware Dual-Speed Dynamic Voltage Scaling , 2006, 12th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA'06).

[37]  Lin Sun,et al.  Activity Recognition on an Accelerometer Embedded Mobile Phone with Varying Positions and Orientations , 2010, UIC.

[38]  Xiang-Yang Li,et al.  SilentSense: silent user identification via touch and movement behavioral biometrics , 2013, MobiCom.

[39]  Mohan M. Trivedi,et al.  Driving style recognition using a smartphone as a sensor platform , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[40]  Jie Yang,et al.  User Verification Leveraging Gait Recognition for Smartphone Enabled Mobile Healthcare Systems , 2015, IEEE Transactions on Mobile Computing.

[41]  Frank Bellosa,et al.  Event-Driven Energy Accounting for Dynamic Thermal Management , 2002 .

[42]  Fengyuan Xu,et al.  V-edge: Fast Self-constructive Power Modeling of Smartphones Based on Battery Voltage Dynamics , 2013, NSDI.

[43]  Qiang Zheng,et al.  Energy-Aware Web Browsing on Smartphones , 2015, IEEE Transactions on Parallel and Distributed Systems.