KitVision toolkit: supporting the creation of cognitive activities for tangible tabletop devices

Purpose This work presents KitVision, a software toolkit based on the End-User Development paradigm to create and to customize tangible tabletop interactive activities for clients with cognitive impairments. The KitVision toolkit has been developed with therapists in mind to engage them in the creation of therapeutic activities, which is the final aim of the work presented here. Methods The KitVision toolkit is based on a markup language specially designed to support the definition of cognitive therapeutic activities. It is composed of a graphic assistant, which allows therapists to develop their own activities, and a player, which allows the user to play the activities on a vision-based tangible tabletop. Two different evaluations have been carried out: an in-lab evaluation, that aimed to test the usability of the KitVision toolkit, and a second evaluation, in which an occupational therapist performed the whole process of creating a tangible activity with the toolkit in her workplace. Results The in-lab evaluation allowed us to detect and correct some usability problems in the KitVision graphic assistant before the second evaluation in a therapy center. As a result of this second evaluation, the occupational therapist decided to have a tabletop permanently installed in her therapy center. Conclusions The potentialities of the KitVision toolkit as an End-User Development tool were assessed after the occupational therapist had spent 1 year using the toolkit on her own, after which she was able to include the activities that she had developed in her daily therapy sessions.

[1]  Panos Markopoulos,et al.  Lessons Learnt from Deploying an End-User Development Platform for Physical Rehabilitation , 2015, CHI.

[2]  Eva Cerezo,et al.  Tackling developmental delays with therapeutic activities based on tangible tabletops , 2019, Universal Access in the Information Society.

[3]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[4]  C B Hall,et al.  Cognitive activities delay onset of memory decline in persons who develop dementia , 2009, Neurology.

[5]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[6]  Ying Li,et al.  A Tangible Tabletop Game Supporting Therapy of Children with Cerebral Palsy , 2008, Fun and Games.

[7]  Virpi Roto,et al.  User experience evaluation methods: current state and development needs , 2010, NordiCHI.

[8]  Ana Grasielle Dionísio Corrêa,et al.  GenVirtual: An Augmented Reality Musical Game for Cognitive and Motor Rehabilitation , 2007, 2007 Virtual Rehabilitation.

[9]  Mariano Alcañiz Raya,et al.  Cognition, technology and games for the elderly: An introduction to ELDERGAMES Project , 2006, PsychNology J..

[10]  HENRY LIEBERMAN,et al.  End-User Development: An Emerging Paradigm , 2006, End User Development.

[11]  Pierre Dillenbourg,et al.  Interactive tabletops in education , 2011, Int. J. Comput. Support. Collab. Learn..

[12]  Susan Evans,et al.  Incloodle: Evaluating an Interactive Application for Young Children with Mixed Abilities , 2016, CHI.

[13]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[14]  Gerhard Fischer,et al.  Design, adoption, and assessment of a socio-technical environment supporting independence for persons with cognitive disabilities , 2008, CHI.

[15]  Eva Cerezo,et al.  Playing with toys on a tabletop active surface , 2010, IDC.

[16]  Eva Cerezo,et al.  NIKVision: Developing a Tangible Application for and with Children , 2013, J. Univers. Comput. Sci..

[17]  Deborah Hix,et al.  Making the computer accessible to mentally retarded adults , 2002, CACM.

[18]  Ian Jacobs,et al.  Cascading Style Sheets, level 2 CSS2 Specification , 2008 .

[19]  Anne Marie Piper,et al.  Supporting People with Dementia in Digital Social Sharing , 2017, CHI.

[20]  Meredith Ringel Morris,et al.  iStuff: a physical user interface toolkit for ubiquitous computing environments , 2003, CHI '03.

[21]  Nigel Bevan,et al.  Usability is Quality of Use , 1995 .

[22]  Anne Marie Piper,et al.  Write-N-Speak: Authoring Multimodal Digital-Paper Materials for Speech-Language Therapy , 2011, TACC.

[23]  Panos Markopoulos,et al.  Five key challenges in end-user development for tangible and embodied interaction , 2013, ICMI '13.

[24]  Michael Valenzuela,et al.  Cognitive Exercise and Its Role in Cognitive Function in Older Adults , 2010, Current psychiatry reports.

[25]  SmartDrawer: RFID-based smart medicine drawer for assistive environments , 2009, PETRA '09.

[26]  Alexandra J. Fiocco,et al.  Exercising the brain to avoid cognitive decline: examining the evidence , 2010 .

[27]  M. Sarter,et al.  The cognitive neuroscience of sustained attention: where top-down meets bottom-up , 2001, Brain Research Reviews.

[28]  Vikram Patel,et al.  No health without mental health , 2007, The Lancet.

[29]  Gillian R. Hayes,et al.  Evaluating a Collaborative iPad Game's Impact on Social Relationships for Children with Autism Spectrum Disorder , 2015, TACC.

[30]  Eva Cerezo,et al.  Bringing tabletop technology to all: evaluating a tangible farm game with kindergarten and special needs children , 2012, Personal and Ubiquitous Computing.

[31]  Jonathan Evans.  In two minds: dual-process accounts of reasoning , 2003, Trends in Cognitive Sciences.

[32]  Wendy Ju,et al.  Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction , 2015 .

[33]  Saul Greenberg,et al.  Phidgets: easy development of physical interfaces through physical widgets , 2001, UIST '01.

[34]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[35]  Ross Bencina,et al.  reacTIVision: a computer-vision framework for table-based tangible interaction , 2007, TEI.

[36]  Jan Stage,et al.  Proceedings of Mause International Workshop on Review, Report and Refine Usability Evaluation Methods , 2007 .

[37]  Jonathan Evans,et al.  Human Reasoning: The Psychology Of Deduction , 1993 .

[38]  Mikko Polojärvi,et al.  Traditional games meet ICT: a case study on go game augmentation , 2010, TEI '10.

[39]  Luc Geurts,et al.  Empowering Occupational Therapists with a DIY-toolkit for Smart Soft Objects , 2015, TEI.

[40]  Laehyun Kim,et al.  Development of a cognitive assessment tool and training systems for elderly cognitive impairment , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[41]  D L Roenker,et al.  The impact of speed of processing training on cognitive and everyday performance , 2005, Aging & mental health.

[42]  Marc Abrams,et al.  UIML: An Appliance-Independent XML User Interface Language , 1999, Comput. Networks.

[43]  George W Rebok,et al.  Effects of cognitive training interventions with older adults: a randomized controlled trial. , 2002, JAMA.

[44]  Rui Rodrigues,et al.  Multi-touch as a Natural User Interface for elders: A survey , 2011, 6th Iberian Conference on Information Systems and Technologies (CISTI 2011).

[45]  Scott R. Klemmer,et al.  Papier-Mache: toolkit support for tangible input , 2004, CHI.

[46]  Thomas Grechenig,et al.  Designing Tangible Table-top Interfaces for Patients in Rehabilitation , 2007, CVHI.

[47]  G. Labouvie-vief,et al.  Cognitive strategy training and intellectual performance in the elderly. , 1976, Journal of gerontology.

[48]  Victor M. Ruiz Penichet,et al.  Cognitive rehabilitation based on collaborative and tangible computer games , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[49]  Gregory D. Abowd,et al.  Abaris: Evaluating Automated Capture Applied to Structured Autism Interventions , 2005, UbiComp.

[50]  Eva Cerezo,et al.  Lowering the threshold and raising the ceiling of tangible expressiveness in hybrid board-games , 2014, Multimedia Tools and Applications.

[51]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[52]  Ingrid Söderback,et al.  Occupational Therapy: Emphasis on Clinical Practice , 2009 .

[53]  Constantine Stephanidis,et al.  CONSTRACT: AN EDUCATOR-ORIENTED DESIGN STUDIO FOR AMBIENT EDUCATIONAL GAMES , 2017 .

[54]  J. M. Christian Bastien,et al.  Usability testing: a review of some methodological and technical aspects of the method , 2010, Int. J. Medical Informatics.