CogWatch: Cognitive Rehabilitation for Apraxia and Action Disorganization Syndrome Patients

Neurological patients with symptoms of Apraxia and Action Disorganisation Syndrome commit cognitive errors during everyday goal-oriented tasks which premorbidly they used to perform automatically. CogWatch is a new cognitive rehabilitation system under development which uses instrumented objects, ambient and wearable sensors to monitor patients behavior and intervene with visual, auditory and haptic feedback to facilitate completion of Activities of Daily Living. Here, we present the CogWatch architecture and its technologies.

[1]  Martin Pielot,et al.  Tacticycle: a tactile display for supporting tourists on a bicycle trip , 2009, Mobile HCI.

[2]  J. V. Van Erp,et al.  Presenting directions with a vibrotactile torso display , 2005, Ergonomics.

[3]  Julius O. Smith,et al.  Using Haptics to Assist Performers in Making Gestures to a Musical Instrument , 2009, NIME.

[4]  Rongrong Wang,et al.  Design and evaluation of a wearable remote social touch device , 2010, ICMI-MLMI '10.

[5]  Ann Heylighen,et al.  Challenging Architects to Include Haptics in Design: Sensory Paradox between Content and Representation , 2011 .

[6]  R.I.A. Mercuri,et al.  Technology as Experience , 2005, IEEE Transactions on Professional Communication.

[7]  Yvonne Rogers,et al.  Enhancing Navigation Information with Tactile Output Embedded into the Steering Wheel , 2009, Pervasive.

[8]  Roberto Bresin,et al.  Improving Running Mechanics by Use of Interactive Sonification , 2010 .

[9]  John D. Lee,et al.  Attention grounding: a new approach to in-vehicle information system implementation , 2007 .

[10]  Mircea Badescu,et al.  Rotary haptic knob for vehicular instrument controls , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[11]  Claude Cadoz,et al.  Haptics in computer music : a paradigm shift , 2004, ArXiv.

[12]  Ann Heylighen,et al.  A lens into the haptic world , 2009 .

[13]  Ian Oakley,et al.  Determining the Feasibility of Forearm Mounted Vibrotactile Displays , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[14]  Charlotte Magnusson,et al.  Soundcrumbs – Hansel and Gretel in the 21st century , 2009 .

[15]  Ståle Stenslie.  Virtual Touch: A study of the use and experience of touch in artistic, multimodal and computer-based environments , 2011 .

[16]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[17]  Jakob Tholander,et al.  MoBoogie: creative expression through whole body musical interaction , 2011, CHI.

[18]  Karon E. MacLean,et al.  An initial usability assessment for symbolic haptic rendering of music parameters , 2005, ICMI '05.

[19]  Jarmo Laaksolahti,et al.  The lega: a device for leaving and finding tactile traces , 2011, Tangible and Embedded Interaction.

[20]  Leonardo Bonanni,et al.  TapTap: a haptic wearable for asynchronous distributed touch therapy , 2006, CHI Extended Abstracts.

[21]  Jan O. Borchers,et al.  Tactile motion instructions for physical activities , 2009, CHI.

[22]  Gaetano Borriello,et al.  Landmark-based pedestrian navigation from collections of geotagged photos , 2008, MUM '08.

[23]  Ian Oakley,et al.  Haptics for tangible interaction: a vibro-tactile prototype , 2011, Tangible and Embedded Interaction.

[24]  Eyal de Lara,et al.  Timbremap: enabling the visually-impaired to use maps on touch-enabled devices , 2010, Mobile HCI.

[25]  C. Spence,et al.  Multisensory warning signals for event perception and safe driving , 2008 .

[26]  C. Cadoz,et al.  Le geste canal de communication homme/machine: la communication "instrumentale" , 1994 .

[27]  K.E. MaClean,et al.  Smart tangible displays in the everyday world: a haptic door knob , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[28]  Rongrong Wang,et al.  Touch & talk: contextualizing remote touch for affective interaction , 2010, TEI '10.

[29]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[30]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[31]  Jakob Tholander,et al.  Design qualities for whole body interaction: learning from golf, skateboarding and BodyBugging , 2010, NordiCHI.

[32]  M. Hafez,et al.  A novel haptic interface for musical keyboards , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[33]  Justin Spinney,et al.  A Place of Sense: A Kinaesthetic Ethnography of Cyclists on Mont Ventoux , 2006 .

[34]  Claude Cadoz,et al.  GENESIS: A Friendly Musician-Oriented Environment for Mass-Interaction Physical Modeling , 2002, ICMC.

[35]  Marcelo M. Wanderley,et al.  A run-time programmable simulator to enable multi-modal interaction with rigid-body systems , 2009, Interact. Comput..

[36]  Hiroshi Ishii,et al.  ComTouch: design of a vibrotactile communication device , 2002, DIS '02.

[37]  Luis Eduardo Boza.  The Place of Research: The Research of Place , 2011 .

[38]  Jean-Loup Florens,et al.  Ergotic Sounds: A New Way to Improve Playability, Believability and Presence of Virtual Musical Instruments , 2007 .

[39]  Per-Olof Hedvall,et al.  Enhancing Multisensory Environments with Design Artifacts for Tangible Interaction , 2012 .

[40]  Claude Cadoz,et al.  Cordis-anima: A modeling and simulation system for sound and image synthesis , 1993 .

[41]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[42]  Claude Cadoz,et al.  Enaction and Enactive Interfaces : A Handbook of terms , 2007 .

[43]  Karon E. MacLean,et al.  Designing haptic icons to support collaborative turn-taking , 2008, Int. J. Hum. Comput. Stud..

[44]  B. J. Fogg,et al.  HandJive: a device for interpersonal haptic entertainment , 1998, CHI.

[45]  Annie Luciani,et al.  From action to sound: a challenging perspective for haptics , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[46]  Claude Cadoz,et al.  ERGOS: Multi-degrees of Freedom and Versatile Force-Feedback Panoply , 2004 .

[47]  M. Sile O'Modhrain,et al.  Embodied cognition as a motivating perspective for haptic interaction design: A position paper , 2011, 2011 IEEE World Haptics Conference.

[48]  Charlotte Magnusson,et al.  Scanning angles for directional pointing , 2010, Mobile HCI.

[49]  Jonathan W. Bender,et al.  Properties and Applications of Commercial Magnetorheological Fluids , 1998, Smart Structures.

[50]  Alexandra Millonig,et al.  Developing Landmark-Based Pedestrian-Navigation Systems , 2007, IEEE Transactions on Intelligent Transportation Systems.

[51]  Per-Olof Hedvall,et al.  Ideation and ability: when actions speak louder than words , 2012, PDC '12.

[52]  Charith Lasantha Fernando,et al.  Huggy pajama: a parent and child hugging communication system , 2009, IDC.

[53]  Marcelo M. Wanderley,et al.  A haptic simulator for gestural interaction with the bowed string , 2010 .