Generating Rules of Action Transition in Errors in Daily Activities from a Virtual Reality-Based Training Data

Developments in virtual reality (VR) have advanced numerous applications in clinical settings in the areas of learning and treatment in neuropsychology. Emerging VR applications today focus on the challenge of diagnosis and cognitive training of mild cognitive impairment (MCI) and dementia patients and address navigation and orientation, face recognition, cognitive functionality, and other instrumental activities of daily living (IADL). The information recorded and captured by VR-based technology is real-time and can be advantageous for further analysis of patients’ characteristics. The present study sought to utilize the data collected from VR-based software and a leap-motion device for learning in MCI cases to generate the rules for errors and action slips based on finger-action transitions when performing IADL. The finger motion was recorded as a time-series database, then an induction technique called Inductive Logic Programming (ILP), which uses logical and clausal language to represent the training data, was used to discover a concise classification rule using logical programming.

[1]  Bernard J. Baars,et al.  Experimental slips and human error , 1992 .

[2]  J. Reason Cognitive Underspecification Its Variety and Consequences , 1992 .

[3]  Fumio Mizoguchi,et al.  Constrained relative least general generalization for Inducing Constraint Logic Programs , 1995, New Generation Computing.

[4]  Marie-Odile Cordier,et al.  Temporal abstraction and inductive logic programming for arrhythmia recognition from electrocardiograms , 2003, Artif. Intell. Medicine.

[5]  Hayato Ohwada,et al.  Clustering Finger Motion Data from Virtual Reality-Based Training to Analyze Patients with Mild Cognitive Impairment , 2016, Int. J. Softw. Sci. Comput. Intell..

[6]  B. Baars Experimental slips and human error : exploring the architecture of volition , 1992 .

[7]  Tania Giovannetti,et al.  A New Approach to the Characterization of Subtle Errors in Everyday Action: Implications for Mild Cognitive Impairment , 2014, The Clinical neuropsychologist.

[8]  Lauren M. Bylsma,et al.  Distraction and action slips in an everyday task: Evidence for a dynamic representation of task context , 2005, Psychonomic bulletin & review.

[9]  D. Norman Categorization of action slips. , 1981 .

[10]  Jeremy N. Bailenson,et al.  Virtual Reality , 2009, J. Media Psychol. Theor. Methods Appl..

[11]  Hayato Ohwada,et al.  Utilizing finger movement data to cluster patients with everyday action impairment , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[12]  Hayato Ohwada,et al.  Yet Another Parallel Hypothesis Search for Inverse Entailment , 2015, ILP.

[13]  Philippe Fuchs,et al.  La Réalité virtuelle et ses applications , 2010 .