Mymemory: A mobile memory assistant for people with traumatic brain injury

Abstract Traumatic Brain Injury (TBI) is a major cause of disability in young people in New Zealand, and has long-term effects on memory and other cognitive functions. This article introduces MyMemory, a mobile augmented memory system that aims to assist TBI survivors in coping with their memory impairments. We here present an exploration of design requirements for mobile memory aids for people with TBI, the MyMemory conceptual design and high-level details of the prototype implementation. We report on the results of our A-B-A-B study with six TBI survivors and three caregivers. The participants with TBI all reported improvements when using MyMemory with regards to their well-being, memory function and autobiographical memory. The caregivers confirmed these observations of TBI participants, however, the results regarding possible reductions of caregiver burden are mixed.

[1]  B. Dritschel,et al.  Theory driven rehabilitation of executive functioning: Improving planning skills in people with traumatic brain injury through the use of an autobiographical episodic memory cueing procedure , 2006, Neuropsychologia.

[2]  Sally Stapleton,et al.  A mobile phone as a memory aid for individuals with traumatic brain injury: A preliminary investigation , 2007, Brain injury.

[3]  Steve Hodges,et al.  The use of a wearable camera improves autobiographical memory in patients with Alzheimer's disease , 2015, Memory.

[4]  J. H. Eggen,et al.  The cue is key: Design for real-life remembering , 2014 .

[5]  J. Fitzgerald,et al.  Latent constructs of the Autobiographical Memory Questionnaire: A recollection-belief model of autobiographical experience , 2013, Memory.

[6]  Alan F. Smeaton,et al.  LifeLogging: Personal Big Data , 2014, Found. Trends Inf. Retr..

[7]  R. Knight,et al.  Autobiographical memory in long-term survivors of severe traumatic brain injury , 2009, Journal of clinical and experimental neuropsychology.

[8]  E. Svoboda,et al.  Compensating for anterograde amnesia: A new training method that capitalizes on emerging smartphone technologies , 2009, Journal of the International Neuropsychological Society.

[9]  A. Mihailidis,et al.  Assistive technology for cognitive rehabilitation: State of the art , 2004 .

[10]  Steve Hodges,et al.  SenseCam: A wearable camera that stimulates and rehabilitates autobiographical memory , 2011, Memory.

[11]  B. Masel,et al.  Traumatic brain injury: a disease process, not an event. , 2010, Journal of neurotrauma.

[12]  Alan F. Smeaton,et al.  Experiences of Aiding Autobiographical Memory Using the SenseCam , 2012, Hum. Comput. Interact..

[13]  Elise van den Hoven,et al.  Informing augmented memory system design through autobiographical memory theory , 2008, Personal and Ubiquitous Computing.

[14]  M. Novak,et al.  Application of a multidimensional caregiver burden inventory. , 1989, The Gerontologist.

[15]  Annika Hinze,et al.  Trails of experiences: navigating personal memories , 2009, CHINZ '09.

[16]  B. Dritschel,et al.  Everyday planning difficulties following traumatic brain injury: a role for autobiographical memory. , 1998, Brain injury.

[17]  Anind K. Dey,et al.  Providing good memory cues for people with episodic memory impairment , 2007, Assets '07.

[18]  R. M. Hardy,et al.  Measuring awareness in people with mild to moderate Alzheimer's disease: Development of the Memory Awareness Rating Scale–adjusted , 2006, Neuropsychological rehabilitation.

[19]  Kenny L. Hicks,et al.  Working memory training remains a work in progress , 2012 .

[20]  Alice Theadom,et al.  Epidemiology of ischaemic stroke and traumatic brain injury. , 2010, Best practice & research. Clinical anaesthesiology.

[21]  Alexander Toet,et al.  Social Touch in Human–Computer Interaction , 2015, Front. Digit. Humanit..

[22]  Lonnie A. Nelson,et al.  Effects of interactive metronome therapy on cognitive functioning after blast-related brain injury: a randomized controlled pilot trial. , 2013, Neuropsychology.

[23]  S. Koch,et al.  Health-Enabling and Ambient Assistive Technologies: Past, Present, Future , 2016, Yearbook of Medical Informatics.

[24]  Yang Hao,et al.  Wireless body sensor networks for health-monitoring applications , 2008, Physiological measurement.

[25]  Andrea Lockerd Thomaz,et al.  Touched by a robot: An investigation of subjective responses to robot-initiated touch , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[26]  Shanthi Ameratunga,et al.  Incidence of traumatic brain injury in New Zealand: a population-based study , 2013, The Lancet Neurology.

[27]  E. Woodberry,et al.  Smartphone technology: Gentle reminders of everyday tasks for those with prospective memory difficulties post-brain injury , 2015, Brain injury.

[28]  Athanasios V. Vasilakos,et al.  A Survey on Ambient Intelligence in Healthcare , 2013, Proceedings of the IEEE.

[29]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[30]  Chris Speed,et al.  An internet of old things as an augmented memory system , 2013, Personal and Ubiquitous Computing.

[31]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[32]  Anind K. Dey,et al.  Lifelogging memory appliance for people with episodic memory impairment , 2008, UbiComp.

[33]  Kai Kunze,et al.  Haven't we met before?: a realistic memory assistance system to remind you of the person in front of you , 2014, AH.

[34]  Jenay M. Beer,et al.  The domesticated robot: Design guidelines for assisting older adults to age in place , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[35]  Abdellatif Kobbane,et al.  A Flexible Wireless Body Sensor Network System for Health Monitoring , 2013, 2013 Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[36]  Steve Hodges,et al.  SenseCam improves memory for recent events and quality of life in a patient with memory retrieval difficulties , 2011, Memory.

[37]  Diane J. Cook,et al.  Keeping the Resident in the Loop: Adapting the Smart Home to the User , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[38]  Walter Bender,et al.  Next-Generation Personal Memory Aids , 2004 .

[39]  Richard Banks,et al.  Memory Dialogue: Exploring Artefact-Based Memory Sharing , 2017, CHI Extended Abstracts.

[40]  E. Mordoch,et al.  Use of social commitment robots in the care of elderly people with dementia: a literature review. , 2013, Maturitas.

[41]  Steven J. Miller,et al.  Using sensor networks to detect urinary tract infections in older adults , 2011, 2011 IEEE 13th International Conference on e-Health Networking, Applications and Services.

[42]  Mirco Musolesi,et al.  Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis , 2015, UbiComp.

[43]  P. J. Soh,et al.  Development of a health monitoring vest for the elderly , 2016, 2016 IEEE MTT-S International Conference on Numerical Electromagnetic and Multiphysics Modeling and Optimization (NEMO).

[44]  J. Borg,et al.  Prognosis for mild traumatic brain injury: results of the WHO Collaborating Centre Task Force on Mild Traumatic Brain Injury. , 2004, Journal of rehabilitation medicine.

[45]  G. De Leo,et al.  Supporting Autobiographical Memory in Patients with Alzheimer's Disease Using Smart Phones , 2011, Applied neuropsychology.

[46]  Estefanía Martín,et al.  Accessible smartphones for blind users: A case study for a wayfinding system , 2014, Expert Syst. Appl..

[47]  William D. Smart,et al.  Robots for humanity: using assistive robotics to empower people with disabilities , 2013, IEEE Robotics & Automation Magazine.

[48]  Martha E. Pollack,et al.  Autominder: an intelligent cognitive orthotic system for people with memory impairment , 2003, Robotics Auton. Syst..

[49]  Misha Pavel,et al.  Detection of Movement in Bed Using Unobtrusive Load Cell Sensors , 2010, IEEE Transactions on Information Technology in Biomedicine.

[50]  Charles P. Thompson,et al.  Autobiographical Memory: Remembering What and Remembering When , 1996 .

[51]  R. Corsini.  The Dictionary of Psychology , 1999 .

[52]  Chelsea Dobbins,et al.  The Big Data Obstacle of Lifelogging , 2014, 2014 28th International Conference on Advanced Information Networking and Applications Workshops.

[53]  Traumatic Brain Injury in New Zealand: A Silent Epidemic? , 2013 .

[54]  F. Jessen,et al.  Validity of the five-item WHO Well-Being Index (WHO-5) in an elderly population , 2009, European Archives of Psychiatry and Clinical Neuroscience.

[55]  W. Wagenaar.  My memory: A study of autobiographical memory over six years , 1986, Cognitive Psychology.

[56]  Daniela Petrelli,et al.  Family memories in the home: contrasting physical and digital mementos , 2010, Personal and Ubiquitous Computing.

[57]  A. Hinze,et al.  Augmented Reality Game for People with Traumatic Brain Injury: Concept and Prototypical Exploration , 2017, ICCAE '17.

[58]  Paulo Novais,et al.  Sensor-driven agenda for intelligent home care of the elderly , 2012, Expert Syst. Appl..

[59]  Oscar Mayora-Ibarra,et al.  Mobile phones as medical devices in mental disorder treatment: an overview , 2014, Personal and Ubiquitous Computing.

[60]  Maria Ebling,et al.  Can Cognitive Assistants Disappear? , 2016, IEEE Pervasive Comput..

[61]  Thanos G. Stavropoulos,et al.  Dem@Home: Ambient Intelligence for Clinical Support of People Living with Dementia , 2016, SEMPER@ESWC.

[62]  Oscar Mayora-Ibarra,et al.  Smartphone-Based Recognition of States and State Changes in Bipolar Disorder Patients , 2015, IEEE Journal of Biomedical and Health Informatics.

[63]  J. Broekens,et al.  Assistive social robots in elderly care: a review , 2009 .

[64]  Kazuyoshi Wada,et al.  Development and preliminary evaluation of a caregiver's manual for robot therapy using the therapeutic seal robot Paro , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[65]  V. Feigin,et al.  Trends in Head Injury Incidence in New Zealand: A Hospital-Based Study from 1997/1998 to 2003/2004 , 2008, Neuroepidemiology.

[66]  Abigail Sellen,et al.  Beyond total capture , 2010, Commun. ACM.

[67]  V. Feigin,et al.  Cost of traumatic brain injury in New Zealand , 2014, Neurology.

[68]  Wendy A. Rogers,et al.  Understanding the Potential for Robot Assistance for Older Adults in the Home Environment , 2011 .