Towards an avatar mentor framework to support physical and psychosocial treatments

The clinical care of patients with chronic life-limiting conditions and terminal illness has improved. However, intense treatment regimens make patients feel isolated, particularly among young children and adolescents who require psychosocial care. Failure to address this issue can leave patients feeling depressed and isolated. Social networking and digital entertainment have helped to address some of these issues, particularly for house bound and long stay patients in a hospital. It has allowed patients to remain in contact with family and friends, express how they feel and find information about their condition. Nevertheless, these kinds of solutions are too general to support the specific psychosocial needs of patients. This paper builds on these technologies and explores the idea of improving communications between medical practitioners and patients using avatars (digital characters that have controllable expressions, animations and speech) in computer games to guide and encourage patients to comply with treatments, provide support, and elicit information about their well-being. We have successfully developed several prototype systems to evaluate the applicability of our approach.

[1]  G. Riva The Key to Unlocking the Virtual Body: Virtual Reality in the Treatment of Obesity and Eating Disorders , 2011, Journal of diabetes science and technology.

[2]  Andrea Gaggioli,et al.  An Open-Source Virtual Reality Platform for Clinical and Research Applications , 2007, HCI.

[3]  P. Fergus,et al.  3D Java web-based games development and deployment , 2009, 2009 International Conference on Multimedia Computing and Systems.

[4]  E. Daviskas,et al.  Effects of exercise on respiratory flow and sputum properties in patients with cystic fibrosis. , 2011, Chest.

[5]  André-Marie Pez,et al.  Statistical Gesture Models for 3D Motion Capture from a Library of Gestures with Variants , 2009, Gesture Workshop.

[6]  Giuseppe Riva,et al.  The use of VR in the treatment of Eating Disorders , 2004, Cybertherapy.

[7]  Andrea Gaggioli,et al.  Cybertherapy in Practice: The VEPSY Updated project , 2004, Cybertherapy.

[8]  Hsi-Peng Lu,et al.  Why people use social networking sites: An empirical study integrating network externalities and motivation theory , 2011, Comput. Hum. Behav..

[9]  Mark C K Yang,et al.  Controlled evaluation of the STARBRIGHT CD-ROM program for children and adolescents with Cystic Fibrosis. , 2004, Journal of pediatric psychology.

[10]  Octavian Postolache,et al.  Enabling telecare assessment with pervasive sensing and Android OS smartphone , 2011, 2011 IEEE International Symposium on Medical Measurements and Applications.

[11]  Abdennour El Rhalibi,et al.  Networking Middleware and Online-Deployment Mechanisms for Java-Based Games , 2009, Trans. Edutainment.

[12]  A. Kennedy,et al.  Managing ‘difficult emotions’ and family life: exploring insights and social support within online self-management training , 2011, Chronic illness.

[13]  Achim Rettinger,et al.  Deductive and Inductive Stream Reasoning for Semantic Social Media Analytics , 2010, IEEE Intelligent Systems.

[14]  Tony P. Pridmore,et al.  Development and Evaluation of a Mixed Reality System for Stroke Rehabilitation , 2011 .

[15]  M. Cabana,et al.  Infection control knowledge, attitudes, and practices among cystic fibrosis patients and their families , 2012, Pediatric pulmonology.

[16]  E. Gullone,et al.  The Impact of Teasing on Children’s Body Image , 2007 .

[17]  Dieter Fensel,et al.  It's a Streaming World! Reasoning upon Rapidly Changing Information , 2009, IEEE Intelligent Systems.

[18]  Michel C. A. Klein XML, RDF, and Relatives , 2001, IEEE Intell. Syst..

[19]  Gregory L. Rosston,et al.  Household demand for broadband internet service , 2010, Commun. ACM.

[20]  W. Bardwell,et al.  Implementing touch‐screen technology to enhance recognition of distress , 2009, Psycho-oncology.

[21]  L. Stark,et al.  Developmental and psychosocial issues in cystic fibrosis. , 2010, Child and adolescent psychiatric clinics of North America.

[22]  Huosheng Hu,et al.  An interactive Internet-based system for tracking upper limb motion in home-based rehabilitation , 2007, Medical & Biological Engineering & Computing.

[23]  Mark John Taylor,et al.  Towards a Whole Body Sensing Platform for Healthcare Applications , 2011, Whole Body Interaction.

[24]  Martin Levesley,et al.  Home based computer-assisted upper limb exercise for young children with cerebral palsy: a feasibility study investigating impact on motor control and functional outcome. , 2011, Journal of rehabilitation medicine.

[25]  Janne Paavilainen,et al.  Social interaction in games , 2011, Int. J. Arts Technol..

[26]  Edward L. Melanson,et al.  Accuracy Of Fitbit Activity Monitor To Predict Energy Expenditure With And Without Classification Of Activities: 725 , 2011 .

[27]  Emer P. Doheny,et al.  SHIMMER™: An extensible platform for physiological signal capture , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[28]  J. Frost,et al.  PatientsLikeMe the case for a data-centered patient community and how ALS patients use the community to inform treatment decisions and manage pulmonary health , 2009, Chronic respiratory disease.

[29]  Paul Fergus,et al.  A framework for physical health improvement using Wireless Sensor Networks and gaming , 2009, 2009 3rd International Conference on Pervasive Computing Technologies for Healthcare.

[30]  W. Davies,et al.  Practitioner perceptions of peer relationships in adolescents with chronic pain , 2011, Journal of child health care : for professionals working with children in the hospital and community.

[31]  Robert Savage,et al.  SOPRANO - An Ambient Assisted Living System for Supporting Older People at Home , 2009, ICOST.

[32]  Giuseppe Riva,et al.  Virtual-reality-based multidimensional therapy for the treatment of body image disturbances in binge eating disorders: a preliminary controlled study , 2002, IEEE Transactions on Information Technology in Biomedicine.

[33]  Bill N. Schilit Mobile Computing: Looking to the Future , 2011, Computer.

[34]  D. House,et al.  Chronic respiratory disease: in military inductees and parents of schoolchildren. , 1973, Archives of environmental health.

[35]  Abdennour El Rhalibi,et al.  Homura and Net-Homura: The creation and web-based deployment of cross-platform 3D games , 2009, 2009 International Conference on Ultra Modern Telecommunications & Workshops.

[36]  Josien C van den Noort,et al.  Evaluation of clinical spasticity assessment in cerebral palsy using inertial sensors. , 2009, Gait & posture.

[37]  Paul Fergus,et al.  Managing Distributed Networked Appliances in Home Networks , 2008, Proceedings of the IEEE.

[38]  Willa H. Drummond,et al.  Health Information Technology and the Medical Home , 2011, Pediatrics.

[39]  Kentaro Toyama,et al.  On turbocharged, heat-seeking, robotic fishing poles , 2011, Commun. ACM.

[40]  Derek Cassidy,et al.  Mixed-Reality Simulation of Minimally Invasive Surgeries , 2007, IEEE MultiMedia.

[41]  G. King,et al.  Contrasting Internet and Face-to-Face Focus Groups for Children with Chronic Health Conditions: Outcomes and Participant Experiences , 2010 .

[42]  Sandra L. Calvert,et al.  The promise of exergames as tools to measure physical health , 2011, Entertain. Comput..

[43]  Adrian David Cheok,et al.  Transactions on Edutainment II , 2009, Trans. Edutainment.

[44]  C. Hermann Psychological interventions for chronic pediatric pain: state of the art, current developments and open questions. , 2011, Pain management.

[45]  P. Sly,et al.  Novel spacer device does not improve adherence in childhood asthma , 2007, Pediatric pulmonology.

[46]  R. Petrella,et al.  Remote Monitoring Technologies for the Prevention of Metabolic Syndrome: The Diabetes and Technology for Increased Activity (DaTA) Study , 2011, Journal of diabetes science and technology.

[47]  A. Morton,et al.  Australian association for exercise and sports science position statement on exercise and asthma. , 2011, Journal of science and medicine in sport.

[48]  Sandra L. Calvert,et al.  College students' social networking experiences on Facebook , 2009 .

[49]  Hyung-Kyu Kwon,et al.  EEG Asymmetry Analysis of the Left and Right Brain Activities During Simple versus Complex Arithmetic Learning , 2009 .

[50]  Koray Balci Xface: MPEG-4 based open source toolkit for 3D Facial Animation , 2004, AVI.

[51]  S. Freud,et al.  Jokes and Their Relation to the Unconscious , 1905 .

[52]  L. von Essen,et al.  Aspects of quality of life, anxiety, and depression among persons diagnosed with cancer during adolescence: a long-term follow-up study. , 2010, European journal of cancer.

[53]  Abdennour El Rhalibi,et al.  Charisma: High-performance Web-based MPEG-compliant animation framework , 2010, CIE.

[54]  J. M. Smith The doctor will see you ALWAYS , 2011, IEEE Spectrum.

[55]  Chin-Teng Lin,et al.  An Intelligent Telecardiology System Using a Wearable and Wireless ECG to Detect Atrial Fibrillation , 2010, IEEE Transactions on Information Technology in Biomedicine.

[56]  Miriam J. Metzger,et al.  Using Web 2.0 Technologies to Enhance Evidence-Based Medical Information , 2011, Journal of health communication.

[57]  Yu Wu,et al.  UEGM: uncertain emotion generator under multi‐stimulus , 2011, Comput. Animat. Virtual Worlds.

[58]  Robert Laganière,et al.  Robust object pose estimation from feature-based stereo , 2006, IEEE Transactions on Instrumentation and Measurement.

[59]  Gengdai Liu,et al.  Human motion generation with multifactor models , 2011, Comput. Animat. Virtual Worlds.

[60]  R. Chellappa,et al.  Markerless Motion Capture using Multiple Cameras , 2005, Computer Vision for Interactive and Intelligent Environment (CVIIE'05).

[61]  S Hagelberg,et al.  Effect of joint injections in children with juvenile idiopathic arthritis: evaluation by 3D‐gait analysis , 2004, Acta paediatrica.

[62]  Ivan Bratko,et al.  Prolog Programming for Artificial Intelligence , 1986 .

[63]  M. Korsten,et al.  SmartPill technology provides safe and effective assessment of gastrointestinal function in persons with spinal cord injury , 2011, Spinal Cord.

[64]  Susan A. Flocke,et al.  Defining and Measuring the Patient-Centered Medical Home , 2010, Journal of General Internal Medicine.

[65]  Paul Fergus,et al.  Remote physiotherapy treatments using wireless body sensor networks , 2009, IWCMC.

[66]  Julian R. Kücklich,et al.  Precarious Playbour: Modders and the Digital Games Industry , 2005 .

[67]  Patrick E. McSharry,et al.  Advanced Methods And Tools for ECG Data Analysis , 2006 .

[68]  Abdennour El Rhalibi,et al.  The Application of MPEG-4 Compliant Animation to a Modern Games Engine and Animation Framework , 2010, MIG.

[69]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Christopher Carter An extensible test bed architecture and topological analysis for the scalability of hybrid-P2P massively multiplayer online games , 2012 .

[71]  Huiru Zheng,et al.  Position-sensing technologies for movement analysis in stroke rehabilitation , 2005, Medical and Biological Engineering and Computing.

[72]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[73]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Lisa Saiman,et al.  Cell phone intervention to improve adherence: Cystic fibrosis care team, patient, and parent perspectives , 2010, Pediatric pulmonology.

[75]  Huosheng Hu,et al.  Use of multiple wearable inertial sensors in upper limb motion tracking. , 2008, Medical engineering & physics.

[76]  Paul Fergus,et al.  Next Generation Body Area Networks and Smart Environments for Healthcare , 2011 .

[77]  Dan J Stein,et al.  Social anxiety disorder , 2008, The Lancet.

[78]  J. Masuda,et al.  Support needs and preferences of young adolescents with asthma and allergies: "just no one really seems to understand". , 2012, Journal of pediatric nursing.

[79]  M. Elkins,et al.  The role of exercise in maintaining health in cystic fibrosis , 2011, Current opinion in pulmonary medicine.

[80]  Cornie Scheffer,et al.  Repeatability of an off-the-shelf, full body inertial motion capture system during clinical gait analysis , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[81]  A. Rokach,et al.  Experience of adults and children in hospitals , 2011 .

[82]  Miriam Furst,et al.  A computer-based method for the assessment of body-image distortions in anorexia-nervosa patients , 2001, IEEE Transactions on Information Technology in Biomedicine.

[83]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[84]  J. L. Walle,et al.  Medicine & Science in sports & Exercise , 2010 .

[85]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[86]  Catherine Pelachaud,et al.  From Greta's mind to her face: modelling the dynamics of affective states in a conversational embodied agent , 2003, Int. J. Hum. Comput. Stud..

[87]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[88]  Sonia Livingstone,et al.  Taking risky opportunities in youthful content creation: teenagers' use of social networking sites for intimacy, privacy and self-expression , 2008, New Media Soc..

[89]  S. Devadason,et al.  Funhaler spacer: improving adherence without compromising delivery , 2003, Archives of disease in childhood.

[90]  G. Hripcsak,et al.  Internet-based home asthma telemonitoring: can patients handle the technology? , 2000, Chest.

[91]  Simon Cooper,et al.  DISE : a game technology-based digital interactive storytelling framework , 2011 .

[92]  Emil Jovanov,et al.  Guest Editorial Introduction to the Special Section on M-Health: Beyond Seamless Mobility and Global Wireless Health-Care Connectivity , 2004, IEEE Transactions on Information Technology in Biomedicine.

[93]  D. Allen Disability and Maternal and Child Health , 2011 .

[94]  Hans-Peter Seidel,et al.  Scaled Motion Dynamics for Markerless Motion Capture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[95]  Marc Schröder,et al.  The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and Teaching , 2003, Int. J. Speech Technol..

[96]  Daniele Braga,et al.  C-SPARQL: a Continuous Query Language for RDF Data Streams , 2010, Int. J. Semantic Comput..

[97]  William H. Shrank,et al.  Variations in structure and content of online social networks for patients with diabetes. , 2011, Archives of internal medicine.

[98]  P. L. D. Toit,et al.  Social anxiety disorder. , 1999 .