Writing in the air: A visualization tool for written languages

The present study investigated interactions between cognitive processes and finger actions called “kusho,” meaning “air-writing” in Japanese. Kanji-culture individuals often employ kusho behavior in which they move their fingers as a substitute for a pen to write mostly done when they are trying to recall the shape of a Kanji character or the spelling of an English word. To further examine the visualization role of kusho behavior on cognitive processing, we conducted a Kanji construction task in which a stimulus (i.e., sub-parts to be constructed) was simultaneously presented. In addition, we conducted a Kanji vocabulary test to reveal the relation between the kusho benefit and vocabulary size. The experiment provided two sets of novel findings. First, executing kusho behavior improved task performance (correct responses) as long as the participants watched their finger movements while solving the task. This result supports the idea that visual feedback of kusho behavior helps cognitive processing for the task. Second, task performance was positively correlated with the vocabulary score when stimuli were presented for a relatively long time, whereas the kusho benefits and vocabulary score were not correlated regardless of stimulus-presentation time. These results imply that a longer stimulus-presentation could allow participants to utilize their lexical resources for solving the task. The current findings together support the visualization role of kusho behavior, adding experimental evidence supporting the view that there are interactions between cognition and motor behavior.

[1]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[2]  R. Varley,et al.  Contribution of finger tracing to the recognition of Chinese characters. , 2000, International journal of language & communication disorders.

[3]  D. Benson,et al.  Visual recognition through kinaesthetic mediation , 1982, Psychological Medicine.

[4]  Hikari Yamashita.  Recognition of Japanese Phonographic Kana (Hiragana) and Logographic Kanji Characters by Passive Finger Tracing , 2014 .

[5]  Jonathan Grainger,et al.  On the Time Course of Visual Word Recognition: An Event-related Potential Investigation using Masked Repetition Priming , 2006, Journal of Cognitive Neuroscience.

[6]  A. Yamadori,et al.  Pure somaesthetic alexia: somaesthetic-verbal disconnection for letters. , 1998, Brain : a journal of neurology.

[7]  M. Kawamura,et al.  Somesthetic Disconnection Syndromes in Patients with Callosal Lesions , 2000, European Neurology.

[8]  M. B. Bender,et al.  Agraphesthesia A disorder of directional cutaneous kinesthesia or a disorientation in cutaneous space , 1982, Journal of the Neurological Sciences.

[9]  Alexander Pollatsek,et al.  Encoding multiple words simultaneously in reading is implausible , 2009, Trends in Cognitive Sciences.

[10]  Daragh E. Sibley,et al.  Individual Differences in Visual Word Recognition: Insights from the English Lexicon Project , 2012 .

[11]  Yoshihiro Itaguchi,et al.  Writing in the Air: Contributions of Finger Movement to Cognitive Processing , 2015, PloS one.

[12]  L. Pylkkänen,et al.  Tracking the time course of word recognition with MEG , 2003, Trends in Cognitive Sciences.

[13]  Thomas W. Schubert,et al.  Embodiment as a unifying perspective for psychology , 2009 .

[14]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[15]  L. Tan,et al.  Biological abnormality of impaired reading is constrained by culture , 2004, Nature.

[16]  Shigeaki Amano,et al.  Estimation of mental lexicon size with word familiarity database , 1998, ICSLP.

[17]  Toshio Inui,et al.  Visual language and handwriting movement: functional magnetic resonance imaging at 3 tesla during generation of ideographic characters , 2001, Brain Research Bulletin.

[18]  L. G. Gonzalez Rothi,et al.  Rehabilitation of a case of pure alexia: exploiting residual abilities. , 2000, Journal of the International Neuropsychological Society : JINS.

[19]  Yoshihiro Itaguchi,et al.  The influence of the indicator arm on end point distribution in proprioceptive localization with multi-joint arms , 2012, Experimental Brain Research.

[20]  Guinevere F. Eden,et al.  A combined fMRI study of typed spelling and reading , 2011, NeuroImage.

[21]  Rumjahn Hoosain,et al.  Psycholinguistic Implications for Linguistic Relativity: A Case Study of Chinese , 1991 .

[22]  Margaret Thomas.  Air Writing as a Technique for the Acquisition of Sino-Japanese Characters by Second Language Learners , 2015 .

[23]  M. Honda,et al.  Participation of the left posterior inferior temporal cortex in writing and mental recall of kanji orthography: A functional MRI study. , 2000, Brain : a journal of neurology.

[24]  G. Glover,et al.  Finger movements lighten neural loads in the recognition of ideographic characters. , 2003, Brain research. Cognitive brain research.

[25]  J. Duffy,et al.  An investigation of body part as object (BPO) responses in normal and brain-damaged adults , 1989, Brain and Cognition.

[26]  P. E. Morris,et al.  Practical aspects of memory : current research and issues , 1988 .

[27]  Dystypia without aphasia associated with visuospatial memory impairment in a patient with acute stroke. , 2012, Alzheimer disease and associated disorders.

[28]  E. Kaplan,et al.  DISTURBANCE OF GESTURE AND PANTOMIME IN APHASIA. , 1963, Brain : a journal of neurology.

[29]  How many words can we read at once? More intervenor effects in masked priming , 2013 .

[30]  J. L. Rasmussen.  Algorithm for Shaffer'S Multiple Comparison Tests , 1993 .

[31]  M. Naka.  Repeated writing facilitates children’s memory for pseudocharacters and foreign letters , 1998, Memory & cognition.

[32]  Hiroaki Naritomi,et al.  Dystypia: Isolated Typing Impairment without Aphasia, Apraxia or Visuospatial Impairment , 2002, European Neurology.

[33]  J. Dejerine.  Sur un cas de cécité verbale avec agraphie suivi d’autopsie , 1891 .

[34]  Pure agraphia and Gerstmann's syndrome as a visuospatial-language dissociation: An experimental case study , 1988, Brain and Language.

[35]  'Air writing' and second language learners' knowledge of Japanese kanji , 2013 .

[36]  David C. Plaut,et al.  A connectionist approach to word reading and acquired dyslexia: extension to sequential processing , 1999, Cogn. Sci..

[37]  A. Kashiwagi,et al.  Recovery process of a Japanese alexic without agraphia , 1989 .

[38]  P. Holcomb.  Semantic priming and stimulus degradation: implications for the role of the N400 in language processing. , 2007, Psychophysiology.

[39]  Giovanni B. Flores d'Arcais,et al.  PHONOLOGICAL AND SEMANTIC ACTIVATION IN READING KANJI CHARACTERS , 1995 .

[40]  M. Sasaki.  Why do Japanese Write Characters in Space? , 1987 .

[41]  Effects of Arm Stiffness and Muscle Effort on Position Reproduction Error in the Horizontal Plane , 2012, Perceptual and motor skills.

[42]  Dystypia in acute stroke not attributable to aphasia or neglect , 2013, BMJ Case Reports.

[43]  Michael Andres,et al.  Selective interference of finger movements on basic addition and subtraction problem solving. , 2013, Experimental psychology.