Enabling Dynamic Sensor Configuration and Cooperation in Opportunistic Activity Recognition Systems

Opportunistic activity recognition as research discipline is characterized by the fact that human activities (and more generally the context) shall be recognized with sensors that are initially unknown to the system. In contrast to “traditional” applications—where sensors, their modalities, locations, and working characteristics have to be defined at design time—opportunistic systems do not rely on an initially defined and fixed sensing infrastructure. Sensors have to be utilized upon their spontaneous availability and activity recognition capabilities and dynamic sensor ensembles have to be configured at runtime with respect to maximized recognition accuracy and minimized energy consumption. This requirement contains two research challenges that this paper tackles: (i) estimating the accuracy of an ensemble without being able to compare the output in the form of recognized activity classes to a (labeled) ground truth and (ii) optimizing the accuracy/energy trade-off by applying exact and heuristic methods adapted for cooperative sensor ensembles.

[1]  Alexander Kraskov,et al.  Published under the scientific responsability of the EUROPEAN PHYSICAL SOCIETY Incorporating , 2002 .

[2]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[3]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[4]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[5]  Ricardo Chavarriaga,et al.  Dynamic Quantification of Activity Recognition Capabilities in Opportunistic Systems , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[6]  Paul Lukowicz,et al.  OPPORTUNITY: Towards opportunistic activity and context recognition systems , 2009, 2009 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks & Workshops.

[7]  E. L. Lawler,et al.  Branch-and-Bound Methods: A Survey , 1966, Oper. Res..

[8]  Ricardo Chavarriaga,et al.  Ensemble creation and reconfiguration for activity recognition: An information theoretic approach , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[9]  Jennifer Healey,et al.  A Long-Term Evaluation of Sensing Modalities for Activity Recognition , 2007, UbiComp.

[10]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[11]  Gregory D. Abowd,et al.  The context toolkit: aiding the development of context-enabled applications , 1999, CHI '99.

[12]  Alois Ferscha,et al.  Real-Time Transfer and Evaluation of Activity Recognition Capabilities in an Opportunistic System , 2011 .

[13]  Alois Ferscha,et al.  Dynamic Adaptation of Opportunistic Sensor Configurations for Continuous and Accurate Activity Recognition , 2012 .

[14]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[15]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Günther R. Raidl,et al.  The Core Concept for the Multidimensional Knapsack Problem , 2006, EvoCOP.

[17]  Paul Lukowicz,et al.  The OPPORTUNITY Framework and Data Processing Ecosystem for Opportunistic Activity and Context Recognition , 2012 .

[18]  Ya-lun Chou,et al.  Statistical analysis, with business and economic applications , 1975 .

[19]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[20]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[21]  Alois Ferscha,et al.  Goal Oriented Opportunistic Recognition of High-Level Composed Activities Using Dynamically Configured Hidden Markov Models , 2012, ANT/MobiWIS.

[22]  Alois Ferscha,et al.  Sensor Abstractions for Opportunistic Activity and Context Recognition Systems , 2010, EuroSSC.

[23]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[24]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[25]  Paul Lukowicz,et al.  Performance metrics for activity recognition , 2011, TIST.

[26]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[27]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[28]  Jean-Philippe Thiran,et al.  Information theoretic combination of pattern classifiers , 2010, Pattern Recognit..

[29]  Michael Bögl,et al.  Metaheuristic Search Concepts: A Tutorial with Applications to Production and Logistics , 2010 .

[30]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .