Reduce the Number of Sensors: Sensing Acoustic Emissions to Estimate Appliance Energy Usage

As a consequence of rising energy prices, manifold solutions to create user awareness for the unnecessary operation of electric appliances have emerged, e.g., real-time consumption displays or timer-based switchable wall outlets. A common attribute of these solutions is the need to buy and install additional hardware, although their acquisition costs often diminish the attainable savings. Furthermore these solutions only permit to retrieve accumulated figures of the energy consumption. Especially in households or office spaces with multiple persons, however, attributing electricity consumption to individuals provides enormous potential to determine possible savings. We therefore propose a system that allows to identify the energy demand incurred by a user's action based on audio recordings using smartphones. More precisely, we capture the user's ambient sounds and applying suitable filtering steps in order to determine the user's current activity. Our results indicate that our system is capable of detecting 16 typical household activities at an accuracy of 92%. By annotating the detectable household activities with information about typical energy consumptions, extracted from 950 real-world power consumption traces, a good estimate of the energy intensity of the users' lifestyles can be made. Our novel personalized energy monitoring system shows people their personal energy consumption, while maintaining their user comfort and relinquishing the need for additional hardware.

[1]  Lei Yang,et al.  Accurate online power estimation and automatic battery behavior based power model generation for smartphones , 2010, 2010 IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[2]  Kent Larson,et al.  Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[3]  Hirozumi Yamaguchi,et al.  An efficient localization algorithm focusing on stop-and-go behavior of mobile nodes , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[4]  Jie Liu,et al.  SpeakerSense: Energy Efficient Unobtrusive Speaker Identification on Mobile Phones , 2011, Pervasive.

[5]  Max Mühlhäuser,et al.  NoiseMap - Real-time participatory noise maps , 2011 .

[6]  Klara Nahrstedt,et al.  Jyotish: A novel framework for constructing predictive model of people movement from joint Wifi/Bluetooth trace , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[7]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[8]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[9]  Gerhard Tröster,et al.  AmbientSense: A real-time ambient sound recognition system for smartphones , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[10]  Diane J. Cook,et al.  The user side of sustainability: Modeling behavior and energy usage in the home , 2013, Pervasive Mob. Comput..

[11]  Qiang Li,et al.  MusicalHeart: a hearty way of listening to music , 2012, SenSys '12.

[12]  Cecilia Mascolo,et al.  NextPlace: A Spatio-temporal Prediction Framework for Pervasive Systems , 2011, Pervasive.

[13]  Klara Nahrstedt,et al.  Zero-knowledge real-time indoor tracking via outdoor wireless directional antennas , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[14]  Sethuraman Panchanathan,et al.  Analysis of low resolution accelerometer data for continuous human activity recognition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Ning Liu,et al.  Bathroom Activity Monitoring Based on Sound , 2005, Pervasive.

[16]  Qiang Li,et al.  Auditeur: a mobile-cloud service platform for acoustic event detection on smartphones , 2013, MobiSys '13.

[17]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[18]  Rahim Tafazolli,et al.  uDirect: A novel approach for pervasive observation of user direction with mobile phones , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[19]  Phil D. Green,et al.  Robust automatic speech recognition with missing and unreliable acoustic data , 2001, Speech Commun..

[20]  Indranil Gupta,et al.  Joint bluetooth/wifi scanning framework for characterizing and leveraging people movement in university campus , 2010, MSWIM '10.

[21]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  Tuomas Virtanen,et al.  Acoustic event detection in real life recordings , 2010, 2010 18th European Signal Processing Conference.

[23]  Eric C. Larson,et al.  Accurate and privacy preserving cough sensing using a low-cost microphone , 2011, UbiComp '11.

[24]  Romit Roy Choudhury,et al.  SurroundSense: mobile phone localization via ambience fingerprinting , 2009, MobiCom '09.

[25]  Jian Lu,et al.  FTrack: Infrastructure-free floor localization via mobile phone sensing , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[26]  Adam Dunkels,et al.  Software-based on-line energy estimation for sensor nodes , 2007, EmNets '07.

[27]  Vesa T. Peltonen,et al.  Audio-based context recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[28]  Ralf Steinmetz,et al.  On the accuracy of appliance identification based on distributed load metering data , 2012, 2012 Sustainable Internet and ICT for Sustainability (SustainIT).

[29]  Israel Cohen,et al.  Noise spectrum estimation in adverse environments: improved minima controlled recursive averaging , 2003, IEEE Trans. Speech Audio Process..