Titan: An Enabling Framework for Activity-Aware "Pervasive Apps" in Opportunistic Personal Area Networks

Upcoming ambient intelligence environments will boast ever larger number of sensor nodes readily available on body, in objects, and in the user's surroundings. We envision "Pervasive Apps", user-centric activity-aware pervasive computing applications. They use available sensors for activity recognition. They are downloadable from application repositories, much like current Apps for mobile phones. A key challenge is to provide Pervasive Apps in open-ended environments where resource availability cannot be predicted. We therefore introduce Titan, a service-oriented framework supporting design, development, deployment, and execution of activity-aware Pervasive Apps. With Titan, mobile devices inquire surrounding nodes about available services. Internet-based application repositories compose applications based on available services as a service graph. The mobile device maps the service graph to Titan Nodes. The execution of the service graph is distributed and can be remapped at run time upon changing resource availability. The framework is geared to streaming data processing and machine learning, which is key for activity recognition. We demonstrate Titan in a pervasive gaming application involving smart dice and a sensorized wristband. We comparatively present the implementation cost and performance and discuss how novel machine learning methodologies may enhance the flexibility of the mapping of service graphs to opportunistically available nodes.

[1]  Mohamed Eltoweissy,et al.  Service-oriented sensor-actuator networks: Promises, challenges, and the road ahead , 2007, Comput. Commun..

[2]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3]  Jörg Hähner,et al.  TinyCubus: a flexible and adaptive framework sensor networks , 2005, Proceeedings of the Second European Workshop on Wireless Sensor Networks, 2005..

[4]  Deborah Estrin,et al.  The Tenet architecture for tiered sensor networks , 2006, SenSys '06.

[5]  Pan Hui,et al.  Haggle: A networking architecture designed around mobile users , 2006 .

[6]  Gerhard Tröster,et al.  Context Cells: Towards Lifelong Learning in Activity Recognition Systems , 2009, EuroSSC.

[7]  Paul Lukowicz,et al.  Implementation and evaluation of a low-power sound-based user activity recognition system , 2004, Eighth International Symposium on Wearable Computers.

[8]  Paul Lukowicz,et al.  Dealing with sensor displacement in motion-based onbody activity recognition systems , 2008, UbiComp.

[9]  Paul Lukowicz,et al.  A systematic approach to the design of distributed wearable systems , 2004, IEEE Transactions on Computers.

[10]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[11]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[12]  Gernot Bahle,et al.  Can magnetic field sensors replace gyroscopes in wearable sensing applications? , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[13]  Luca Benini,et al.  Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection , 2008, EWSN.

[14]  Paul Lukowicz,et al.  Which Way Am I Facing: Inferring Horizontal Device Orientation from an Accelerometer Signal , 2009, 2009 International Symposium on Wearable Computers.

[15]  Jani Mäntyjärvi,et al.  User Independent Gesture Interaction for Small Handheld Devices , 2006, Int. J. Pattern Recognit. Artif. Intell..

[16]  Mirco Musolesi,et al.  Urban sensing systems: opportunistic or participatory? , 2008, HotMobile '08.

[17]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[18]  Fabio Bellifemine,et al.  SPINE2: developing BSN applications on heterogeneous sensor nodes , 2009, 2009 IEEE International Symposium on Industrial Embedded Systems.

[19]  Paul Lukowicz,et al.  A Framework for Opportunistic Activity and Context Recognition , 2010 .

[20]  Paul Lukowicz,et al.  Symbolic Object Localization Through Active Sampling of Acceleration and Sound Signatures , 2007, UbiComp.

[21]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[22]  Eemil Lagerspetz,et al.  BeTelGeuse: A Platform for Gathering and Processing Situational Data , 2009, IEEE Pervasive Computing.

[23]  Viktor K. Prasanna,et al.  DART: The Data‐Driven ATaG Runtime , 2007 .

[24]  Paul Lukowicz,et al.  OPPORTUNITY: Towards opportunistic activity and context recognition systems , 2009, 2009 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks & Workshops.

[25]  Alexander Gluhak,et al.  The SENSEI Real World Internet Architecture , 2010, Future Internet Assembly.

[26]  Umakishore Ramachandran,et al.  Dynamic data fusion for future sensor networks , 2006, TOSN.

[27]  Alberto Calatroni,et al.  A methodology to use unknown new sensors for activity recognition by leveraging sporadic interactions with primitive sensors and behavioral assumptions , 2010 .

[28]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[29]  Mirco Musolesi,et al.  The Rise of People-Centric Sensing , 2008, IEEE Internet Comput..

[30]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[31]  Saurabh Ganeriwal,et al.  Timing-sync protocol for sensor networks , 2003, SenSys '03.

[32]  Gerhard Tröster,et al.  Titan: A Tiny Task Network for Dynamically Reconfigurable Heterogeneous Sensor Networks , 2007, KiVS.

[33]  J. Elson,et al.  Fine-grained network time synchronization using reference broadcasts , 2002, OSDI '02.

[34]  Emiliano Miluzzo,et al.  People-centric urban sensing , 2006, WICON '06.

[35]  Daniel P. Siewiorek,et al.  Activity-Based Computing , 2008, IEEE Pervasive Computing.

[36]  Paul Lukowicz,et al.  Rapid Prototyping of Activity Recognition Applications , 2008, IEEE Pervasive Computing.

[37]  Viktor K. Prasanna,et al.  The Abstract Task Graph: a methodology for architecture-independent programming of networked sensor systems , 2005, EESR '05.

[38]  Jeffrey M. Hausdorff,et al.  Online detection of freezing of gait in Parkinson's disease patients: a performance characterization , 2009, BODYNETS.

[39]  David E. Culler,et al.  System architecture directions for networked sensors , 2000, SIGP.

[40]  Paul J. M. Havinga,et al.  Architectures for Wireless Sensor Networks , 2005, 2005 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[41]  Mani B. Srivastava,et al.  A dynamic operating system for sensor nodes , 2005, MobiSys '05.

[42]  Paul J. M. Havinga,et al.  Modeling Service-Oriented Context Processing in Dynamic Body Area Networks , 2009, IEEE Journal on Selected Areas in Communications.

[43]  David E. Culler,et al.  Active sensor networks , 2005, NSDI.

[44]  David E. Culler,et al.  The dynamic behavior of a data dissemination protocol for network programming at scale , 2004, SenSys '04.

[45]  Philip Levis,et al.  Maté: a tiny virtual machine for sensor networks , 2002, ASPLOS X.

[46]  Paul Lukowicz,et al.  Distributed Modular Toolbox for Multi-modal Context Recognition , 2006, ARCS.

[47]  Umakishore Ramachandran,et al.  DFuse: a framework for distributed data fusion , 2003, SenSys '03.

[48]  Paul Lukowicz,et al.  Wearable Activity Tracking in Car Manufacturing , 2008, IEEE Pervasive Computing.

[49]  Luca Benini,et al.  Wireless sensor networks: Enabling technology for ambient intelligence , 2006, Microelectron. J..

[50]  A. Arora,et al.  Weave : An Architecture for Tailoring Urban Sensing Applications across Multiple Sensor Fabrics , 2008 .

[51]  Mohan Kumar,et al.  Opportunities in Opportunistic Computing , 2010, Computer.

[52]  L. Benini,et al.  Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[53]  Luca Benini,et al.  Benefits of Dynamically Reconfigurable Activity Recognition in Distributed Sensing Environments , 2011 .

[54]  D. E. Goldberg,et al.  Genetic Algorithms in Search, Optimization & Machine Learning , 1989 .

[55]  Gregory J. Pottie,et al.  Wireless integrated network sensors , 2000, Commun. ACM.

[56]  Gerhard Tröster,et al.  Unsupervised Classifier Self-Calibration through Repeated Context Occurences: Is there Robustness against Sensor Displacement to Gain? , 2009, 2009 International Symposium on Wearable Computers.

[57]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Gerhard Tröster,et al.  Modeling and simulation of sensor orientation errors in garments , 2009, BODYNETS.

[59]  Gerhard Tröster,et al.  Service discovery and composition in body area networks , 2008, BODYNETS.

[60]  D. De Rossi,et al.  Characterization of a Novel Data Glove Based on Textile Integrated Sensors , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  Paul Lukowicz,et al.  Where am I: Recognizing On-body Positions of Wearable Sensors , 2005, LoCA.