Virtual reality art-making for stroke rehabilitation: Field study and technology probe

Abstract How can we better understand the process of therapeutic art-making for stroke rehabilitation, and what are design opportunities for virtual reality art-making for people with stroke-related impairments? We investigated this question in a two-part study with 14 amateur artists with disabilities resulting from stroke: a three-week field study and a technology probe consisting of experiential virtual reality interviews. We uncovered what participants made, the aesthetics of the materials and the process of making. The field study revealed inspirations around identity, situatedness of choices for tools in the social and physical environment, and a breadth of application techniques (e.g., dripping paint or use of tape) that varied in need for fine motor control. The experiential virtual reality interviews highlighted the need for control, the affordances of the medium, and the challenges in viewing and reflecting on work. Emergent art reflected qualities of the 3D paint and free-form gesture. Virtual reality and traditional art-making contrasted in the speed and finality of application, opportunities for iteration and reflection, and in the need for dexterity. We discuss strengths, weaknesses and implications for design of virtual reality art-making for those with stroke-related impairments.

[1]  C. Anderson,et al.  Predictors of Depression after Stroke: A Systematic Review of Observational Studies , 2005, Stroke.

[2]  Joseph J. LaViola,et al.  CavePainting: a fully immersive 3D artistic medium and interactive experience , 2001, I3D '01.

[3]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[4]  Katie Thomson,et al.  Commercial Gaming Devices for Stroke Upper Limb Rehabilitation: A Systematic Review , 2014, International journal of stroke : official journal of the International Stroke Society.

[5]  Keith S. Karn,et al.  Testing for power usability , 1997, CHI Extended Abstracts.

[6]  S. Patten,et al.  Hopelessness Ratings in Relapsing-Remitting and Secondary Progressive Multiple Sclerosis , 2002, International journal of psychiatry in medicine.

[7]  Paul Dourish,et al.  Where the action is , 2001 .

[8]  Denise Reid,et al.  Stroke survivors' perceptions of a leisure-based virtual reality program , 2004 .

[9]  Mauro Teófilo,et al.  Bringing basic accessibility features to virtual reality context , 2016, 2016 IEEE Virtual Reality (VR).

[10]  Anne Marie Piper,et al.  Vulnerability, Sharing, and Privacy: Analyzing Art Therapy for Older Adults with Dementia , 2016, CSCW.

[11]  Russell Beale,et al.  Digital tools for physically impaired visual artists , 2014, ASSETS.

[12]  Kathrin Marks Step into my (virtual) world: An exploration of virtual reality drawing applications for arts therapy , 2018 .

[13]  Gigi Smith,et al.  A hopelessness model of depressive symptoms in youth with epilepsy. , 2007, Journal of pediatric psychology.

[14]  K. Collie,et al.  Computer-Supported Distance Art Therapy: A Focus on Traumatic Illness , 2002 .

[15]  Davor Cubranic,et al.  An Art Therapy Solution to a Telehealth Problem. , 1999 .

[16]  Craig S. Anderson,et al.  Predictors of Depression after Stroke: A Systematic Review of Observational Studies , 2005 .

[17]  J. Lansen,et al.  Alexithymia—A challenge to art therapy: The story of Rita , 2006 .

[18]  Sandra Bassett,et al.  The assessment of patient adherence to physiotherapy rehabilitation , 2003 .

[19]  Ben Shneiderman,et al.  Creativity support tools: accelerating discovery and innovation , 2007, CACM.

[20]  Anne Marie Piper,et al.  Designing for the Third Hand: Empowering Older Adults with Cognitive Impairment through Creating and Sharing , 2016, Conference on Designing Interactive Systems.

[21]  Marshall McLuhan,et al.  The medium is the message , 2005 .

[22]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[23]  C. Winstein,et al.  Bimanual Training After Stroke: Are Two Hands Better Than One? , 2004, Topics in stroke rehabilitation.

[24]  G.C. Burdea,et al.  Virtual reality-enhanced stroke rehabilitation , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Darryl Charles,et al.  Augmented Reality Games for Upper-Limb Stroke Rehabilitation , 2009, 2010 Second International Conference on Games and Virtual Worlds for Serious Applications.

[26]  Jongeun Yim,et al.  Literature and art therapy in post-stroke psychological disorders. , 2015, The Tohoku journal of experimental medicine.

[27]  K. Reynolds,et al.  Using Technology to Increase Activity, Creativity and Engagement for Older Adults Through Visual Art , 2017 .

[28]  E. Hippel,et al.  Lead users: a source of novel product concepts , 1986 .

[29]  Courtney G. E. Hilderman,et al.  Virtual Reality Therapy for Adults Post-Stroke: A Systematic Review and Meta-Analysis Exploring Virtual Environments and Commercial Games in Therapy , 2014, PloS one.

[30]  David J. Brown,et al.  Virtual Reality in the Rehabilitation of People with Intellectual Disabilities: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[31]  Jon Berge Disability in the arts , 1997, SIGGRAPH '97.

[32]  R. Salomon,et al.  The Principles of Art Therapy in Virtual Reality , 2018, Front. Psychol..

[33]  Kristina Höök,et al.  Embracing First-Person Perspectives in Soma-Based Design , 2018, Informatics.

[34]  William W. Gaver,et al.  Feather, Scent, and Shaker: Supporting Simple Intimacy , 1996 .

[35]  Ann Lantz,et al.  User Participation When Users have Mental and Cognitive Disabilities , 2015, ASSETS.

[36]  S. Bermúdez i Badia,et al.  The impact of positive, negative and neutral stimuli in a virtual reality cognitive-motor rehabilitation task: a pilot study with stroke patients , 2016, Journal of NeuroEngineering and Rehabilitation.

[37]  P N Wilson,et al.  Virtual reality, disability and rehabilitation. , 1997, Disability and rehabilitation.

[38]  Gang Li,et al.  A user requirement study on the needs of visual artists with upper limb disabilities , 2006 .

[39]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[40]  S. Chun,et al.  Art Therapy Outcomes in the Rehabilitation Treatment of a Stroke Patient: A Case Report , 2008 .

[41]  Marcia A. Bockbrader,et al.  A feasibility study using interactive graphic art feedback to augment acute neurorehabilitation therapy. , 2013, NeuroRehabilitation.

[42]  Su Hyun Nam Meditative process in new media art: an affective possibility of digital media in the art making process , 2015, SIGGRAPH Asia Art Papers.

[43]  Sergi Bermúdez i Badia,et al.  RehabCity: design and validation of a cognitive assessment and rehabilitation tool through gamified simulations of activities of daily living , 2014, Advances in Computer Entertainment.

[44]  Laura Devendorf Making art and making artists , 2014, DIS Companion '14.

[45]  Anne Marie Piper,et al.  A Critical Lens on Dementia and Design in HCI , 2017, CHI.

[46]  E. Eisner The Arts and the Creation of Mind , 2003, Language Arts.

[47]  Hope Kinney,et al.  Medical Art Therapy , 2019, Encyclopedia of the UN Sustainable Development Goals.

[48]  Erica Halverson,et al.  Digital Art Making as a Representational Process , 2010, ICLS.

[49]  Eduardo E. Veas,et al.  Handheld devices for mobile augmented reality , 2010, MUM.

[50]  A. L. Faria,et al.  Benefits of virtual reality based cognitive rehabilitation through simulated activities of daily living: a randomized controlled trial with stroke patients , 2016, Journal of NeuroEngineering and Rehabilitation.

[51]  D. Waller,et al.  Fight like a ferret: a novel approach of using art therapy to reduce anxiety in stroke patients undergoing hospital rehabilitation , 2014, Medical Humanities.

[52]  Anthony Tang,et al.  Supporting non-verbal visual communication in online group art therapy , 2014, CHI Extended Abstracts.

[53]  Jinsil Hwaryoung Seo,et al.  Re-powering Senior Citizens with Interactive Art Making: Case Study with Independent Older Adults , 2018, CHI Extended Abstracts.

[54]  Martin R. Gibbs,et al.  "I Love All the Bits": The Materiality of Boardgames , 2016, CHI.

[55]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[56]  Gazihan Alankus,et al.  Reducing compensatory motions in video games for stroke rehabilitation , 2012, CHI.

[57]  Chi Thanh Vi,et al.  Not just seeing, but also feeling art: Mid-air haptic experiences integrated in a multisensory art exhibition , 2017, Int. J. Hum. Comput. Stud..

[58]  Paul Dourish,et al.  How HCI interprets the probes , 2007, CHI.

[59]  M. Alcañiz,et al.  Embodiment and Presence in Virtual Reality After Stroke. A Comparative Study With Healthy Subjects , 2019, Front. Neurol..

[60]  Daniel A. Keim,et al.  Visual Analytics: Definition, Process, and Challenges , 2008, Information Visualization.

[61]  Cathy Treadaway,et al.  Hand e-craft: an investigation into hand use in digital creative practice , 2009, C&C '09.

[62]  A. Rizzo,et al.  The application of virtual reality technology in rehabilitation. , 2001 .

[63]  S. Çelik,et al.  The Effect of Art Therapy with Clay on Hopelessness Levels Among Neurology Patients , 2017, Rehabilitation nursing : the official journal of the Association of Rehabilitation Nurses.

[64]  V. Kuptniratsaikul,et al.  Creative art therapy to enhance rehabilitation for stroke patients: a randomized controlled trial , 2016, Clinical rehabilitation.

[65]  Anne Marie Piper,et al.  Making as Expression: Informing Design with People with Complex Communication Needs through Art Therapy , 2018, CHI.

[66]  C. Wolfe,et al.  Qualitative analysis of stroke patients' motivation for rehabilitation , 2000, BMJ : British Medical Journal.

[67]  Kathy Blashki,et al.  The drive to create: an investigation of tools to support disabled artists , 2007, C&C '07.

[68]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[69]  Cathy A. Malchiodi,et al.  Handbook of Art Therapy , 2002 .