Serial position encoding of signs

Reduced short-term memory (STM) capacity has been reported for sign as compared to speech when items have to be recalled in a specific order. This difference has been attributed to a more precise and efficient serial position encoding in verbal STM (used for speech) than visuo-spatial STM (used for sign). We tested in the present investigation whether the reduced STM capacity with signs stems from a lack of positional encoding available in verbal STM. Error analyses reported in prior studies have revealed that positions are defined in verbal STM by distance from both the start and the end of the sequence (both-edges positional encoding scheme). Our analyses of the errors made by deaf participants with finger-spelled letters revealed that the both-edges positional encoding scheme underlies the STM representation of signs. These results indicate that the cause of the STM disadvantage is not the type of positional encoding but rather the difficulties in binding an item in visuo-spatial STM to its specific position in the sequence. Both-edges positional encoding scheme could be specific of sign, since it has not been found in visuo-spatial STM tasks conducted with hearing participants.

[1]  R. Conrad Serial order intrusions in immediate memory. , 1960, British journal of psychology.

[2]  R. Henson Short-Term Memory for Serial Order: The Start-End Model , 1998, Cognitive Psychology.

[3]  Ian Neath,et al.  Fill‐in and infill errors in order memory , 2005, Memory.

[4]  Margaret Wilson The case for sensorimotor coding in working memory , 2001, Psychonomic bulletin & review.

[5]  Daphne Bavelier,et al.  Short-term memory span: insights from sign language , 2004, Nature Neuroscience.

[6]  G. Mathur,et al.  The Structure of Sign Languages , 2014 .

[7]  Matthew M Botvinick,et al.  Short-term memory for serial order: a recurrent neural network model. , 2006, Psychological review.

[8]  Wendy Sandler,et al.  Sign Language and Linguistic Universals: Entering the lexicon: lexicalization, backformation, and cross-modal borrowing , 2006 .

[9]  B. Murdock,et al.  Memory for Serial Order , 1989 .

[10]  A. Baddeley,et al.  Word length and the structure of short-term memory , 1975 .

[11]  H. Werner The effect of boundary strength on interference and retention. , 1947, The American journal of psychology.

[12]  Ursula Bellugi,et al.  Remembering in signs , 1975, Cognition.

[13]  D. Norris,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1996, 49A (1), 80 ± 115 Unchained Memory: Error Patterns Rule out Chaining Models of Immediate Serial Recall , 2022 .

[14]  H. Hamilton,et al.  Linguistic encoding in short-term memory as a function of stimulus type , 1989, Memory & cognition.

[15]  U Bellugi,et al.  Processing of formational, semantic, and iconic information in American sign language. , 1981, Journal of experimental psychology. Human perception and performance.

[16]  N. Burgess Memory for Serial Order : A Network Model of the Phonological Loop and its Timing , 1999 .

[17]  P. Miller The role of spoken and sign languages in the retention of written words by prelingually deafened native signers. , 2007, Journal of deaf studies and deaf education.

[18]  Harry van der Hulst,et al.  Units in the analysis of signs , 1993, Phonology.

[19]  A. J. Hull,et al.  Predictability and Immediate Memory for Consonant Sequences , 1965 .

[20]  M. Marschark,et al.  Interactions of language and memory in deaf children and adults. , 1998, Scandinavian journal of psychology.

[21]  M. McCloskey,et al.  Grapheme-to-lexeme feedback in the spelling system: Evidence from a dysgraphic patient , 2006, Cognitive neuropsychology.

[22]  James S. NAffiNE Positional uncertainty in long-term memory , 1991 .

[23]  W. Stokoe,et al.  A dictionary of American sign language on linguistic principles , 1965 .

[24]  Margaret Wilson,et al.  A visuospatial “phonological loop” in working memory: Evidence from American Sign Language , 1997, Memory & cognition.

[25]  Leslie G. Ungerleider,et al.  Object and spatial visual working memory activate separate neural systems in human cortex. , 1996, Cerebral cortex.

[26]  R. Pintner,et al.  A comparison of deaf and hearing children in visual memory for digits , 1917 .

[27]  Elizabeth A. Hirshorn,et al.  Routes to short-term memory indexing: Lessons from deaf native users of American Sign Language , 2012, Cognitive neuropsychology.

[28]  Simon Farrell,et al.  End Anchoring in Short-Term Order Memory. , 2009 .

[29]  L. S. Liben,et al.  Short-term memory in deaf and hearing children in relation to stimulus characteristics. , 1977, Journal of experimental child psychology.

[30]  Simon Jacob Fischer-Baum Position representation: General principles or domain-specificity? , 2011 .

[31]  Matthew L. Hall,et al.  Persistent Difference in Short-Term Memory Span Between Sign and Speech , 2006, Psychological science.

[32]  R. Krakow,et al.  Deaf signers and serial recall in the visual modality: Memory for signs, fingerspelling, and print , 1985, Memory & cognition.

[33]  U. Bellugi,et al.  A comparison of sign language and spoken language , 1972 .

[34]  Jeremy Goslin,et al.  PhonItalia: a phonological lexicon for Italian , 2014, Behavior research methods.

[35]  Margaret Wilson,et al.  A “word length effect”for sign language: Further evidence for the role of language in structuring working memory , 1998, Memory & cognition.

[36]  R Conrad,et al.  Short-term memory in the deaf: a test for speech coding. , 1972, British journal of psychology.

[37]  V. L. Hanson,et al.  Short-term recall by deaf signers of American Sign Language: implications of encoding strategy for order recall. , 1982, Journal of experimental psychology. Learning, memory, and cognition.

[38]  Alice F. Healy,et al.  Separating item from order information in short-term memory , 1974 .

[39]  M. Corballis,et al.  Short-term memory and coding strategies in the deaf. , 1973, Journal of Experimental Psychology.

[40]  M. Rudner,et al.  Explicit Processing Demands Reveal Language Modality-Specific Organization of Working Memory , 2008, Journal of deaf studies and deaf education.

[41]  Murray T. Maybery,et al.  The short-term memory of profoundly deaf people for words, signs and abstract spatial stimuli , 1996 .

[42]  Scott K. Liddell Grammar, Gesture, and Meaning in American Sign Language , 2003 .

[43]  Matthew L. Hall,et al.  Short-term memory stages in sign vs. speech: The source of the serial span discrepancy , 2011, Cognition.

[44]  Margaret Wilson,et al.  Comparing Sign Language and Speech Reveals a Universal Limit on Short-Term Memory Capacity , 2006, Psychological science.

[45]  Susan M. Courtney,et al.  Binding serial order to representations in working memory: a spatial/verbal dissociation , 2011, Memory & cognition.

[46]  G. Eden,et al.  Phonological Awareness and Short‐Term Memory in Hearing and Deaf Individuals of Different Communication Backgrounds , 2008, Annals of the New York Academy of Sciences.

[47]  R. Campbell,et al.  Varieties of short-term memory coding in deaf teenagers. , 1996, Journal of deaf studies and deaf education.

[48]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[49]  Simon Farrell,et al.  Sequential dependencies in recall of sequences: Filling in the blanks , 2013, Memory & cognition.

[50]  Gordon D A Brown,et al.  Modeling age-related differences in immediate memory using SIMPLE. , 2006, Journal of memory and language.

[51]  Carlo Geraci,et al.  How grammar can cope with limited short-term memory: Simultaneity and seriality in sign languages , 2008, Cognition.

[52]  Lauren M. Bylsma,et al.  Regularization in short-term memory for serial order. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[53]  R. Battison,et al.  Lexical Borrowing in American Sign Language , 1978 .

[54]  R. Henson Positional information in short-term memory: Relative or absolute? , 1999, Memory & cognition.

[55]  W. A. Wickelgren,et al.  Associative intrusions in short-term recall. , 1966 .

[56]  M. Shand,et al.  Sign-based short-term coding of American Sign Language signs and printed English words by congenitally deaf signers , 1982, Cognitive Psychology.

[57]  R Conrad,et al.  Short-term memory processes in the deaf. , 1970, British journal of psychology.

[58]  E. Lichtenstein,et al.  The relationships between reading processes and English skills of deaf college students. , 1998, Journal of deaf studies and deaf education.

[59]  Instructed rehearsal strategies' influence on deaf memory processing. , 1976, Journal of speech and hearing research.

[60]  William K. Estes,et al.  On types of item coding and sources of recall in short-term memory. , 1991 .

[61]  B. Murdock,et al.  Positional and temporal clustering in serial order memory , 2012, Memory & cognition.

[62]  Jerker Rönnberg,et al.  Neural correlates of working memory for sign language. , 2004, Brain research. Cognitive brain research.

[63]  Brenda Rapp,et al.  Representation of letter position in spelling: Evidence from acquired dysgraphia , 2010, Cognition.

[64]  J. D. Bonvillian,et al.  The effect of sign language rehearsal on deaf subjects' immediate and delayed recall of English word lists , 1987, Applied Psycholinguistics.

[65]  A. Baddeley Working Memory, Thought, and Action , 2007 .

[66]  Michael McCloskey,et al.  Representation of item position in immediate serial recall: Evidence from intrusion errors. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[67]  M. Rudner,et al.  Effects of Age on the Temporal Organization of Working Memory in Deaf Signers , 2010, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[68]  Elissa L. Newport,et al.  Ordered short-term memory differs in signers and speakers: Implications for models of short-term memory , 2008, Cognition.

[69]  Michael McCloskey,et al.  Representation of letter position in single-word reading: Evidence from acquired dyslexia , 2013, Cognitive neuropsychology.

[70]  W. A. Wickelgren,et al.  Short-term Memory for Repeated and Non-repeated Items , 1965, The Quarterly journal of experimental psychology.