A lightweight framework for transparent cross platform communication of controller data in ambient assisted living environments

Elderly support ambient assisted living environments are focal in healthcare computing. Critical to their implementation is transparent integration of diverse hardware and its ubiquitous communication with multiple software components. Modern controllers (Wii family, Microsoft Kinect, Neurosky Mindwave) are especially useful in elderly smart homes, being used, for healthcare monitoring and exercise gaming interventions. Presented herein is a novel Controller Application Communication (CAC) framework for cross device, application independent transmission of controller data to multiple software components. For the first time, a framework supports multiple modern controllers concurrently communicating with multiple, device naive, requesting applications, utilizing standard, real time, internet communication technologies, as opposed to current practices which focus merely on one device. The framework consists of uniform schemas for encapsulating controllers' data and of services necessary for communicating these data to the requesting software components. The framework's architecture is based on distributed computing principles, delegating server duties to use-site gateways for reducing main server load. This framework was utilized in the USEFIL project for simultaneous use of multiple controllers and sensors by different software components of the platform. The framework's design principles align with the Internet of Things (IoT) paradigm. Future work, enriching this framework, aims to facilitate a more diverse controller set, adhering to an IoT architecture implementation, as well as, allowing on-demand online data streaming, thereby enabling interested parties to test algorithms with data from ecologically valid environments.

[1]  Weiqin Chen,et al.  Gesture-Based Applications for Elderly People , 2013, HCI.

[2]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[3]  Kathrin Maria Gerling,et al.  Designing and evaluating digital games for frail elderly persons , 2011, Advances in Computer Entertainment Technology.

[4]  Wei-Min Hsieh,et al.  Combination of the Kinect with Virtual Reality in Balance Training for the Elderly , 2013 .

[5]  Winfried Schlee,et al.  Novelty interventions to enhance broad cognitive abilities and prevent dementia: synergistic approaches for the facilitation of positive plastic change. , 2013, Progress in brain research.

[6]  Panagiotis D. Bamidis,et al.  Evaluating affective usability experiences of an exergaming platform for seniors , 2011, 2011 10th International Workshop on Biomedical Engineering.

[7]  Mignon Park,et al.  An effective method for detecting facial features and face in human-robot interaction , 2006, Inf. Sci..

[8]  Bo Yan,et al.  Design and implementation of a sensor-based wireless camera system for continuous monitoring in assistive environments , 2010, Personal and Ubiquitous Computing.

[9]  Juan A. Botía Blaya,et al.  Validating ambient intelligence based ubiquitous computing systems by means of artificial societies , 2013, Inf. Sci..

[10]  Yoshitsugu Yasui,et al.  A brainwave signal measurement and data processing technique for daily life applications. , 2009, Journal of physiological anthropology.

[11]  Mark Weiser,et al.  The computer for the 21st Century , 1991, IEEE Pervasive Computing.

[12]  Jeffrey Nichols,et al.  An infrastructure for extending applications' user experiences across multiple personal devices , 2008, UIST '08.

[13]  Len Bass,et al.  User interface software , 1993 .

[14]  Kevin Kelly,et al.  SODA: Service Oriented Device Architecture , 2006, IEEE Pervasive Computing.

[15]  Jean Vanderdonckt,et al.  A model-based approach for distributed user interfaces , 2011, EICS '11.

[16]  B. Peek,et al.  Managed Library for Nintendo's Wiimote , 2007 .

[17]  Manfred Tscheligi,et al.  Interactive TV for the Home: An Ethnographic Study on Users' Requirements and Experiences , 2008, Int. J. Hum. Comput. Interact..

[18]  Yusuf Pisan,et al.  Improving lives: using Microsoft Kinect to predict the loss of balance for elderly users under cognitive load , 2013, IE.

[19]  João Barroso,et al.  Symbiosis: An Innovative Human-Computer Interaction Environment for Alzheimer's Support , 2013, HCI.

[20]  Regan L. Mandryk,et al.  Full-body motion-based game interaction for older adults , 2012, CHI.

[21]  Fotis Liarokapis,et al.  Assessing NeuroSky's Usability to Detect Attention Levels in an Assessment Exercise , 2009, HCI.

[22]  Fabio Paternò,et al.  A logical framework for multi-device user interfaces , 2012, EICS '12.

[23]  Ruben Verborgh,et al.  SAMuS: Service-Oriented Architecture for Multisensor Surveillance in Smart Homes , 2014, TheScientificWorldJournal.

[24]  Amilcar Meneses Viveros,et al.  Kinect©, as Interaction Device with a Tiled Display , 2013, HCI.

[25]  Alexander Artikis,et al.  Supporting tele-health and AI-based clinical decision making with sensor data fusion and semantic interpretation: The USEFIL case study , 2012 .

[26]  Rita Francese,et al.  Wiimote and Kinect: gestural user interfaces add a natural third dimension to HCI , 2012, AVI.

[27]  Peter Langendörfer,et al.  Telemedicine system for game-based rehabilitation of stroke patients in the FP7-“StrokeBack” project , 2014, 2014 European Conference on Networks and Communications (EuCNC).

[28]  Vinh-Tiep Nguyen,et al.  Multimodal Smart Interactive Presentation System , 2013, HCI.

[29]  Magda Tsolaki,et al.  A Game-Like Interface for Training Seniors’ Dynamic Balance and Coordination , 2010 .

[30]  Raqibul Hasan,et al.  Smart-TV Based Integrated E-health Monitoring System with Agent Technology , 2012, 2012 26th International Conference on Advanced Information Networking and Applications Workshops.

[31]  Giovanni Acampora,et al.  A proposal of ubiquitous fuzzy computing for Ambient Intelligence , 2008, Inf. Sci..

[32]  Tayeb Lemlouma,et al.  Smart Media Services through TV Sets for Elderly and Dependent Persons , 2012, MobiHealth.

[33]  Antonio Egidio Nardi,et al.  The Nintendo Wii as a tool for neurocognitive rehabilitation, training and health promotion , 2014, Comput. Hum. Behav..

[34]  H. Hashimoto,et al.  Human motion tracking of mobile robot with Kinect 3D sensor , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[35]  Juan Fasola,et al.  A socially assistive robot exercise coach for the elderly , 2013, J. Hum. Robot Interact..

[36]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[37]  D. Sharma,et al.  Senior health monitoring using Kinect , 2012, 2012 Fourth International Conference on Communications and Electronics (ICCE).

[38]  Gerhard Tröster,et al.  Unobtrusive physiological monitoring in an airplane seat , 2009, Personal and Ubiquitous Computing.

[39]  Moira C. Norrie,et al.  Information Concepts for Cross-device Applications , 2013, DUI@EICS.

[40]  Moira C. Norrie,et al.  XDKinect: development framework for cross-device interaction using kinect , 2014, EICS.

[41]  Magda Tsolaki,et al.  A Web services-based exergaming platform for senior citizens: The long lasting memories project approach to e-health care , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Vwen Yen Lee,et al.  Fall Detection System Based on Kinect Sensor Using Novel Detection and Posture Recognition Algorithm , 2013, ICOST.

[43]  Ma Wenyao,et al.  Wearable Assistive System Design for Fall Prevention , .

[44]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[45]  Panagiotis D. Bamidis,et al.  Leveraging Web Technologies to Expose Multiple Contemporary Controller Input in Smart TV Rich Internet Applications Utilized in Elderly Assisted Living Environments , 2014, HCI.

[46]  Jean Vanderdonckt,et al.  A toolkit for peer-to-peer distributed user interfaces: concepts, implementation, and applications , 2009, EICS '09.

[47]  Chek Tien Tan,et al.  Assessing the Kinect's Capabilities to Perform a Time-Based Clinical Test for Fall Risk Assessment in Older People , 2014, ICEC.

[48]  Panagiotis Bamidis,et al.  The effects of a computer-based cognitive and physical training program in a healthy and mildly cognitive impaired aging sample , 2014, Aging & mental health.

[49]  Young-Guk Ha,et al.  A robotic service framework supporting automated integration of ubiquitous sensors and devices , 2007, Inf. Sci..

[50]  Meredith Ringel Morris,et al.  Kinected browser: depth camera interaction for the web , 2012, ITS '12.

[51]  Erik Grönvall,et al.  Turning training into play: Embodied gaming, seniors, physical training and motivation , 2011 .

[52]  Franz Werner,et al.  Tablets for Seniors – An Evaluation of a Current Model (iPad) , 2012 .

[53]  Paul Müller,et al.  Ambient Intelligence in Assisted Living: Enable Elderly People to Handle Future Interfaces , 2007, HCI.

[54]  Thomas Grechenig,et al.  Chances for serious games in rehabilitation of stroke patients on the example of utilizing the Wii Fit Balance Board , 2013, 2013 IEEE 2nd International Conference on Serious Games and Applications for Health (SeGAH).

[55]  Jan Stegenga,et al.  Exergaming for balance training of elderly: state of the art and future developments , 2013, Journal of NeuroEngineering and Rehabilitation.

[56]  Arcot Sowmya,et al.  Single-Handed Driving System with Kinect , 2013, HCI.

[57]  Jurij F. Tasic,et al.  MindGym - IPTV for Elderly People , 2014, MindCare.

[58]  Albert Ali Salah,et al.  A Robotic Fitness Coach for the Elderly , 2013, AmI.

[59]  Johannes Schöning,et al.  Informing intelligent user interfaces by inferring affective states from body postures in ubiquitous computing environments , 2013, IUI '13.

[60]  Wenjun Wu,et al.  A Real-time Personalized Gesture Interaction System Using Wii Remote and Kinect for Tiled-Display Environment , 2013, SEKE.

[61]  Eva Onaindia,et al.  Context-Aware Multi-Agent Planning in intelligent environments , 2013, Inf. Sci..

[62]  Hsien-Tsung Chang,et al.  A Dynamic Fitting Room Based on Microsoft Kinect and Augmented Reality Technologies , 2013, HCI.

[63]  Meredith Ringel Morris,et al.  Web on the wall: insights from a multimodal interaction elicitation study , 2012, ITS.

[64]  Stavros J. Perantonis,et al.  Clothes change detection using the Kinect sensor , 2014, 2014 International Conference on Signal Processing and Multimedia Applications (SIGMAP).

[65]  Yasunari Fujimoto,et al.  Attendant robot for elderly service using sensor network system , 2013, 2013 IEEE International Symposium on Industrial Electronics.

[66]  Kelvin Lim,et al.  Nintendo Wii Balance Board is sensitive to effects of visual tasks on standing sway in healthy elderly adults. , 2012, Gait & posture.

[67]  Judith Kelner,et al.  An open-source tool for distributed viewing of kinect data on the web , 2011 .

[68]  David Ott,et al.  Web on the Wall Reloaded: Implementation, Replication and Refinement of User-Defined Interaction Sets , 2014, ITS '14.

[69]  Panagiotis D. Bamidis,et al.  Affective Computing on Elderly Physical and Cognitive Training within Live Social Networks , 2012, SETN.

[70]  M. J. Fernández-Iglesias,et al.  An Adaptive System for the Smart Home , 2013 .