Things happening in the brain while humans learn to use new tools

In this paper, we propose a new technique based on recent neuroimaging studies as a tool for the assessment of interactive systems. For this purpose, we analyze the mental process that takes place while human subjects learn to use new tools by using two different approaches. One is an experiment on task performance based on the conventional direct testing method of a user interface, and the other is an indirect method based on recent neuroimaging studies that indirectly estimate the process of interaction through the observation of the human brain activities. The results obtained from the direct experiment on performance evaluation are compared with those from the indirect analysis of the human brain activity, which is measured by a non-invasive neuroimaging measuring method. The process of acquisition of internal models while subjects learn to use new tools is also discussed.

[1]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[2]  R. Shadmehr,et al.  Neural correlates of motor memory consolidation. , 1997, Science.

[3]  Neff Walker,et al.  Evaluation of the CyberGlove as a whole-hand input device , 1995, TCHI.

[4]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[5]  D. Norman.  The psychology of everyday things , 1990 .

[6]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[7]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[8]  O. Witte,et al.  Functional Mapping of the Human Brain , 2000 .

[9]  D. Norman.  The psychology of everyday things", Basic Books Inc , 1988 .

[10]  Yoshifumi Kitamura,et al.  Interactive Computer Animation of Hand Gestures using Status Estimation with Multiple Regression Analysis , 2001, Comput. Graph. Forum.

[11]  O. Hikosaka,et al.  Transition of Brain Activation from Frontal to Parietal Areas in Visuomotor Sequence Learning , 1998, The Journal of Neuroscience.

[12]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[13]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[14]  Jens Rasmussen,et al.  Information Processing and Human-Machine Interaction , 1986 .

[15]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[16]  Yoshifumi Kitamura,et al.  Virtual chopsticks: object manipulation using multiple exact interactions , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[17]  Jens Rasmussen,et al.  Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering , 1986 .