Robot Programming and Tangible Interfaces for Cognitive Training

This chapter presents the conceptual framework, the research rationale and preliminary outcomes of an innovative research agenda that explores the use of tangible interface and robot programming tasks as a method for providing cognitive training to patients with memory dysfunctions. The main argument of this approach is that when programming tasks and relevant tangible systems are used for cognitive training they activate and practice users’ logical-analytical and visuospatial skills, which may have beneficial impact on patients’ cognitive performance in daily activities. The chapter also presents preliminary outcomes from a pilot study where eleven patients suffering from mild cognitive impairment participated in a robot programming training session using the PROTEAS prototype tangible interface. Results (both qualitative and quantitative) revealed a significant negative correlation between patients’ “Task Completion Time” (TCT) and mental condition (as measured by MMSE index), indicating that TCT provides a measure directly related to patients’ cognitive capacity for analysis and planning.

[1]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[2]  Blaine A. Price,et al.  Using Robotics to Motivate ‘Back Door’ Learning , 2004, Education and Information Technologies.

[3]  S. Olkun.  Comparing Computer versus Concrete Manipulatives in Learning 2D Geometry , 2003 .

[4]  Ehud Sharlin,et al.  A tangible user interface for assessing cognitive mapping ability , 2009, Int. J. Hum. Comput. Stud..

[5]  D. Janaki Ram,et al.  Identification of Cognitive Processes of Effective and Ineffective Students During Computer Programming , 2010, TOCE.

[6]  G. Olympiou,et al.  Physical versus Virtual Manipulative Experimentation in Physics Learning. , 2011 .

[7]  E. Murphy,et al.  Second Chance Learners, Supporting Adults Learning Computer Programming , 2007 .

[8]  Yuxin Ma,et al.  Acquisition of Physics Content Knowledge and Scientific Inquiry Skills in a Robotics Summer Camp , 2007 .

[9]  Charles C. Tappert,et al.  Students Develop Real-World Web and Pervasive Computing Systems , 2002 .

[10]  Jean Vanderdonckt,et al.  AudioCubes: a distributed cube tangible interface based on interaction range for sound design , 2008, Tangible and Embedded Interaction.

[11]  Rosemary Luckin,et al.  Tangibles in the balance: a discovery learning task with physical or graphical materials , 2010, TEI '10.

[12]  Bertrand Schneider,et al.  Benefits of a Tangible Interface for Collaborative Learning and Interaction , 2011, IEEE Transactions on Learning Technologies.

[13]  Ishbel Duncan,et al.  Emergent Requirements for Supporting Introductory Programming , 2011 .

[14]  Ehud Sharlin,et al.  Tangible user interfaces: Tools to examine, assess, and treat dynamic constructional processes in children with developmental coordination disorders , 2006 .

[15]  Timothy S. McNerney.  From turtles to Tangible Programming Bricks: explorations in physical language design , 2004, Personal and Ubiquitous Computing.

[16]  Merredith Portsmore,et al.  Bringing Engineering to Elementary School , 2004 .

[17]  K. Ball,et al.  Long-term effects of cognitive training on everyday functional outcomes in older adults. , 2006, JAMA.

[18]  A. Rizzo,et al.  The application of virtual reality technology in rehabilitation. , 2001 .

[19]  James Gibson,et al.  Block Jam: A Tangible Interface for Interactive Music , 2003, NIME.

[20]  Z. C. Zacharia,et al.  Comparing and combining real and virtual experimentation: an effort to enhance students' conceptual understanding of electric circuits , 2007, J. Comput. Assist. Learn..

[21]  Benjamin Lok,et al.  Tangible User Interfaces Compensate for Low Spatial Cognition , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[22]  K. Crowley,et al.  The Robotic Autonomy Mobile Robotics Course: Robot Design, Curriculum Design and Educational Assessment , 2005, Auton. Robots.

[23]  J. Galen Buckwalter,et al.  Virtual Reality and Cognitive Rehabilitation: A Brief Review of the Future , 1997 .

[24]  Jasna Kuljis,et al.  Visualisation techniques for learning and teaching programming , 2000, ITI 2000. Proceedings of the 22nd International Conference on Information Technology Interfaces (Cat. No.00EX411).

[25]  Simon P. Davies,et al.  Models and Theories of Programming Strategy , 1993, Int. J. Man Mach. Stud..

[26]  Peta Wyeth,et al.  Using developmental theories to inform the design of technology for children , 2003, IDC '03.

[27]  D. Jeste,et al.  Cognitive training in Alzheimer's disease: a meta‐analysis of the literature , 2006, Acta psychiatrica Scandinavica.

[28]  Michael S. Horn,et al.  Comparing the use of tangible and graphical programming languages for informal science education , 2009, CHI.

[29]  Magda Tsolaki,et al.  Mini Mental State Examination (MMSE): A validation study in Greece , 2000 .

[30]  J. Schneider,et al.  Participation in cognitively stimulating activities and risk of incident Alzheimer disease. , 2002, JAMA.

[31]  Sharon Arkin,et al.  Language-Enriched Exercise Plus Socialization Slows Cognitive Decline in Alzheimer’s Disease , 2007, American journal of Alzheimer's disease and other dementias.

[32]  Steve Benford,et al.  The role of physical representations in solving number problems: A comparison of young children's use of physical and virtual materials , 2010, Comput. Educ..

[33]  Albert A. Rizzo,et al.  Virtual Environments for Assessing and Rehabilitating Cognitive/Functional Performance A Review of Projects at the USC Integrated Media Systems Center , 2001, Presence: Teleoperators & Virtual Environments.

[34]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.

[35]  Magda Tsolaki,et al.  Functional cognitive assessment scale (FUCAS): a new scale to assess executive cognitive function in daily life activities in patients with dementia and mild cognitive impairment , 2006, Human psychopharmacology.

[36]  Leon E. Winslow,et al.  Programming pedagogy—a psychological overview , 1996, SGCS.

[37]  Jinglong Wu.  Improving the Quality of Life for Dementia Patients through Progressive Detection, Treatment, and Care , 2016 .

[38]  M. Kosmidis,et al.  The verbal fluency task in the Greek population: Normative data, and clustering and switching strategies , 2004, Journal of the International Neuropsychological Society.

[39]  M. Takeda,et al.  Non‐pharmacological intervention for dementia patients , 2012, Psychiatry and clinical neurosciences.

[40]  Marian Petre,et al.  A gentle overview of software visualisation , 2006 .

[41]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[42]  Yury S. Dodonov,et al.  Response time analysis in cognitive tasks with increasing difficulty , 2012 .

[43]  Jörgen Lindh,et al.  Does lego training stimulate pupils' ability to solve logical problems? , 2007, Comput. Educ..

[44]  Caitlin Kelleher,et al.  Lowering the barriers to programming: A taxonomy of programming environments and languages for novice programmers , 2005, CSUR.

[45]  S. Blanchard,et al.  Strategies used by elementary schoolchildren solving robotics-based complex tasks: innovative potential of technology , 2010 .

[46]  Michael S. Horn,et al.  Tangible programming in the classroom: a practical approach , 2006, CHI Extended Abstracts.

[47]  Janet Rountree,et al.  Learning and Teaching Programming: A Review and Discussion , 2003, Comput. Sci. Educ..

[48]  C. Lyketsos,et al.  Validity and reliability of the newly translated Hellenic Neuropsychiatric Inventory (H‐NPI) applied to Greek outpatients with Alzheimer's disease: a study of disturbing behaviors among referrals to a memory clinic , 2004, International journal of geriatric psychiatry.

[49]  Donghwa Jeong,et al.  TaG-Games: Tangible geometric games for assessing cognitive problem-solving skills and fine motor proficiency , 2010, 2010 IEEE Conference on Multisensor Fusion and Integration.

[50]  Mark D. Gross,et al.  roBlocks: a robotic construction kit for mathematics and science education , 2006, ICMI '06.

[51]  Ghazi Shukur,et al.  The Effect of LEGO Training on Pupils' School Performance in Mathematics, Problem Solving Ability and Attitude: Swedish Data , 2006, J. Educ. Technol. Soc..

[52]  R. Pea,et al.  A Study of the Development of Programming Ability and Thinking Skills in High School Students , 1986 .

[53]  L A Hansen,et al.  The importance of neuritic plaques and tangles to the development and evolution of AD , 2004, Neurology.

[54]  T. Robbins,et al.  Early Detection and Differential Diagnosis of Alzheimer’s Disease and Depression with Neuropsychological Tasks , 2001, Dementia and Geriatric Cognitive Disorders.

[55]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[56]  Diana Yifan Xu,et al.  Design and evaluation of tangible interfaces for primary school children , 2007, IDC.

[57]  S. Ranjeeth.  An investigation of the impact of human cognition on the acquisition of computer programming skills by students at a university , 2008 .

[58]  Cristina Buiza,et al.  Efficacy of Cognitive Training Experiences in the Elderly: Can Technology Help? , 2009, HCI.

[59]  I. Liappas,et al.  Preliminary Report of a Validation Study of Instrumental Activities of Daily Living in a Greek Sample , 2007, Perceptual and motor skills.

[60]  Alissa Nicole Antle,et al.  Designing tangibles for children: what designers need to know , 2007, CHI Extended Abstracts.

[61]  Ehud Sharlin,et al.  Spatial Tangible User Interfaces for Cognitive Assessment and Training , 2004, BioADIT.

[62]  M. Tsolaki,et al.  Wechsler Memory Scale, Rivermead Behavioral Memory Test, and Everyday Memory Questionnaire in Healthy Adults and Alzheimer Patients , 2002 .

[63]  Carlos De Backer,et al.  The design and pilot evaluation of an interactive learning environment for introductory programming influenced by cognitive load theory and constructivism , 2013, Comput. Educ..

[64]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[65]  I. Nimmo-Smith,et al.  The structure of normal human attention: The Test of Everyday Attention , 1996, Journal of the International Neuropsychological Society.

[66]  M. Tsolaki,et al.  The validation of the short form of the Geriatric Depression Scale (GDS) in Greece , 1999, Aging.

[67]  R. Nudo,et al.  Neural Substrates for the Effects of Rehabilitative Training on Motor Recovery After Ischemic Infarct , 1996, Science.

[68]  J. Morris.  The Clinical Dementia Rating (CDR) , 1993, Neurology.