Dismantling the "Visual Ease Assumption: " A Review of Visual Narrative Processing in Clinical Populations

Visual narratives, such as wordless picture books and picture sequences like comics, have a long history in clinical testing, research, and intervention settings. The widespread "Visual Ease Assumption" rests on the premise that visual narratives, given their non-linguistic nature, may alleviate processing difficulties in populations that struggle with language. In this paper, I review the evidence for and against this Visual Ease Assumption in three clinical populations in which language deficits are common or diagnostic: autism spectrum disorder (ASD), specific language impairment (SLI; now known as Developmental Language Disorder, DLD), and aphasia. I first redefine the Visual Ease Assumption as two testable predictions: (a) that visual narrative processing should be unimpaired for clinical populations compared to neurotypical (NT) populations; and (b) that in clinical populations, visual narrative processing should be less impaired than linguistic narrative processing. Through a review of the limited evidence available to test these predictions in ASD, SLI, and aphasia, I show that the Visual Ease Assumption is largely unsupported in empirical studies. Furthermore, I outline three additional limitations of the Visual Ease Assumption regarding the complexity of narrative processing, visual narrative tasks, and cognitive deficits in different clinical populations. Therefore, visual narratives should not be assumed to be "easier" for clinical populations that struggle with language; instead, a more thorough consideration of the cognitive processes involved in visual narrative processing is needed.

[1]  D. Bishop,et al.  The underlying nature of specific language impairment. , 1992, Journal of child psychology and psychiatry, and allied disciplines.

[2]  Dorothy V. M. Bishop,et al.  The role of syntax in encoding and recall of pictorial narratives: Evidence from specific language impairment , 2005 .

[3]  N. Bell,et al.  Gestalt imagery: A critical factor in language comprehension , 1991, Annals of dyslexia.

[4]  L. Lloyd,et al.  The Effect of Remnant and Pictographic Books on the Communicative Interaction of Individuals with Global Aphasia , 2005 .

[5]  Lyndsey Nickels,et al.  Improving word finding: Practice makes (closer to) perfect? , 2002 .

[6]  Helen Tager-Flusberg,et al.  ‘Once upon a ribbit’: Stories narrated by autistic children , 1995 .

[7]  Marta Kutas,et al.  Getting a cue before getting a clue: Event-related potentials to inference in visual narrative comprehension , 2015, Neuropsychologia.

[8]  Inge-Marie Eigsti,et al.  Narrative Performance of Optimal Outcome Children and Adolescents with a History of an Autism Spectrum Disorder (ASD) , 2014, Journal of autism and developmental disorders.

[9]  Sarah Parsons,et al.  What Children with Autism Understand about Thoughts and Thought Bubbles , 1999 .

[10]  S. Baron-Cohen,et al.  Does the autistic child have a “theory of mind” ? , 1985, Cognition.

[11]  Livia Colle,et al.  Narrative Discourse in Adults with High-Functioning Autism or Asperger Syndrome , 2008, Journal of autism and developmental disorders.

[12]  W. Beatty,et al.  Picture and Motor Sequencing in Parkinson's Disease , 1990, Journal of geriatric psychiatry and neurology.

[13]  Denyse V. Hayward,et al.  Effectiveness of teaching story grammar knowledge to pre-school children with language impairment. An exploratory study , 2000 .

[14]  I. Kamp-Becker,et al.  Narrative competence and internal state language of children with Asperger Syndrome and ADHD. , 2012, Research in developmental disabilities.

[15]  Lars Smith,et al.  Response Times of Children and Adolescents with Asperger Syndrome on an ‘Advanced’ Test of Theory of Mind , 2007, Journal of autism and developmental disorders.

[16]  Neil Cohn,et al.  Visual Narrative Structure , 2013, Cogn. Sci..

[17]  Claire Hughes,et al.  Executive function deficits in autism spectrum disorders and attention-deficit/hyperactivity disorder: Examining profiles across domains and ages , 2006, Brain and Cognition.

[18]  Miško Subotić,et al.  Cognitive and electrophysiological characteristics of children with specific language impairment and subclinical epileptiform electroencephalogram , 2014, Journal of clinical and experimental neuropsychology.

[19]  Neil Cohn,et al.  Drawing the Line Between Constituent Structure and Coherence Relations in Visual Narratives , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[20]  P. Hagoort,et al.  Exceptions and anomalies: An ERP study on context sensitivity in autism , 2010, Neuropsychologia.

[21]  Neil Cohn,et al.  Prediction, events, and the advantage of Agents: The processing of semantic roles in visual narrative , 2013, Cognitive Psychology.

[22]  Peter J. B. Hancock,et al.  Viewing it differently: Social scene perception in Williams syndrome and Autism , 2008, Neuropsychologia.

[23]  Neil Cohn,et al.  (Pea)nuts and bolts of visual narrative: Structure and meaning in sequential image comprehension , 2012, Cognitive Psychology.

[24]  D. Westen,et al.  Clinical assessment of object relations and social cognition using stories told to the picture arrangement subtest of the WAIS-R. , 1993, Journal of personality assessment.

[25]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[26]  M. Bornens,et al.  Problems brought about by "reading" a sequence of pictures. , 1990, Journal of experimental child psychology.

[27]  R. Kana,et al.  Changes in intrinsic connectivity of the brain's reading network following intervention in children with autism , 2015, Human brain mapping.

[28]  F. Happé An advanced test of theory of mind: Understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adults , 1994, Journal of autism and developmental disorders.

[29]  Helen Tager-Flusberg,et al.  Attributing mental states to story characters: A comparison of narratives produced by autistic and mentally retarded individuals , 1995, Applied Psycholinguistics.

[30]  Tiffany L. Hutchins,et al.  Using communication to reduce challenging behaviors in individuals with autism spectrum disorders and intellectual disability. , 2014, Child and adolescent psychiatric clinics of North America.

[31]  B Z Liles,et al.  Narrative discourse in children with language disorders and children with normal language: a critical review of the literature. , 1993, Journal of speech and hearing research.

[32]  Neil Cohn,et al.  You're a Good Structure, Charlie Brown: The Distribution of Narrative Categories in Comic Strips , 2014, Cogn. Sci..

[33]  Simon Baron-Cohen,et al.  Thought-Bubbles Help Children with Autism Acquire an Alternative to a Theory of Mind , 2002, Autism : the international journal of research and practice.

[34]  E. Armstrong,et al.  Aphasic discourse analysis: The story so far , 2000 .

[35]  M. Bellon-Harn,et al.  Treatment Intensity , 2014 .

[36]  N. Minshew,et al.  A Comparison of WAIS-R Profiles in Adults With High-Functioning Autism or Differing Subtypes of Learning Disability , 2001, Applied neuropsychology.

[37]  M. L. Ralph,et al.  Improved vocabulary production after naming therapy in aphasia: can gains in picture naming generalize to connected speech? , 2009, International journal of language & communication disorders.

[38]  P. Gordon,et al.  Quantifying Narrative Ability in Autism Spectrum Disorder: A Computational Linguistic Analysis of Narrative Coherence , 2014, Journal of Autism and Developmental Disorders.

[39]  G. Olness Genre, verb, and coherence in picture‐elicited discourse of adults with aphasia , 2006 .

[40]  S. E. Weismer Constructive Comprehension Abilities Exhibited by Language-Disordered Children , 1985 .

[41]  E. Bavin,et al.  Narrative comprehension in 4-7-year-old children with autism: testing the Weak Central Coherence account. , 2010, International journal of language & communication disorders.

[42]  R H Brookshire,et al.  Presence, completeness, and accuracy of main concepts in the connected speech of non-brain-damaged adults and adults with aphasia. , 1995, Journal of speech and hearing research.

[43]  J. Buitelaar,et al.  The phenotype and neural correlates of language in autism: An integrative review , 2008, Neuroscience & Biobehavioral Reviews.

[44]  Jeffrey I. Gelfer,et al.  Reading Comprehension and Autism in the Primary General Education Classroom. , 2015 .

[45]  Chrystopher L. Nehaniv,et al.  The narrative construction of our (social) world: steps towards an interactive learning environment for children with autism , 2007, Universal Access in the Information Society.

[46]  Keely Harper-Hill,et al.  The Autism Diagnostic Observation Schedule and narrative assessment: Evidence for specific narrative impairments in autism spectrum disorders , 2015, International journal of speech-language pathology.

[47]  Dorothy V M Bishop,et al.  Narrative skills of children with communication impairments. , 2003, International journal of language & communication disorders.

[48]  Elizabeth Sheppard,et al.  Autism and Dimensionality: Differences Between Copying and Drawing Tasks , 2009, Journal of autism and developmental disorders.

[49]  S Baron-Cohen,et al.  Linguistic processing in high-functioning adults with autism or Asperger's syndrome. Is global coherence impaired? , 2000, Psychological Medicine.

[50]  B. Gordon,et al.  Visual and linguistic narrative comprehension in autism spectrum disorders: Neural evidence for modality-independent impairments , 2018, Brain and Language.

[51]  D. Bishop,et al.  Comprehension problems in children with specific language impairment: literal and inferential meaning. , 1992, Journal of speech and hearing research.

[52]  N. Franck,et al.  Impairment in event sequencing in disorganised and non-disorganised patients with schizophrenia , 2006, Brain Research Bulletin.

[53]  Amanda Stead,et al.  Pictorial and Graphemic Processing in Fluent Aphasia , 2012 .

[54]  A. Miranda,et al.  Narratives of children with high-functioning autism spectrum disorder: A meta-analysis. , 2016, Research in developmental disabilities.

[55]  R. Berman The Cambridge Handbook of Child Language: Language development in narrative contexts , 2009 .

[56]  M. Losh,et al.  Narrative Ability in High-Functioning Children with Autism or Asperger's Syndrome , 2003, Journal of autism and developmental disorders.

[57]  Trisha Greenhalgh,et al.  Phase 2 of CATALISE: a multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology , 2017, Journal of child psychology and psychiatry, and allied disciplines.

[58]  C. Deruelle,et al.  Do children perceive features of real and cartoon faces in the same way? Evidence from typical development and autism , 2010, Journal of clinical and experimental neuropsychology.

[59]  G. Bower,et al.  Mental models in narrative comprehension. , 1990, Science.

[60]  Nicola Botting,et al.  Narrative as a tool for the assessment of linguistic and pragmatic impairments , 2002 .

[61]  U. Bellugi,et al.  “Frog, where are you?” Narratives in children with specific language impairment, early focal brain injury, and Williams syndrome , 2004, Brain and Language.

[62]  J H Hogben,et al.  On the "specifics" of specific reading disability and specific language impairment. , 2000, Journal of child psychology and psychiatry, and allied disciplines.

[63]  Joseph P. McCleery,et al.  Neural correlates of verbal and nonverbal semantic integration in children with autism spectrum disorders. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[64]  P. Schneider Effects of Pictures Versus Orally Presented Stories on Story Retellings by Children With Language Impairment , 1996 .

[65]  T. Egner,et al.  Cognitive control mechanisms resolve conflict through cortical amplification of task-relevant information , 2005, Nature Neuroscience.

[66]  A. Kaufman,et al.  Sequential and simultaneous processing abilities of high-functioning autistic and language-impaired children , 1991, Journal of autism and developmental disorders.

[67]  Barbara C. Glaeser,et al.  Comic Strip Conversations: A Positive Behavioral Support Strategy , 2003 .

[68]  M. Losh,et al.  “The Frog Ate the Bug and Made his Mouth Sad”: Narrative Competence in Children with Autism , 2000, Journal of abnormal child psychology.

[69]  K. Quill,et al.  Instructional Considerations for Young Children with Autism: The Rationale for Visually Cued Instruction , 1997, Journal of autism and developmental disorders.

[70]  R. Rozema Manga and the Autistic Mind , 2015 .

[71]  Howard Gardner,et al.  Comprehension of humorous and nonhumorous materials by left and right brain-damaged patients , 1986, Brain and Cognition.

[72]  Walter Huber,et al.  Linguistic and nonlinguistic processing of narratives in aphasia , 1982, Brain and Language.

[73]  C. Deruelle,et al.  Typical Emotion Processing for Cartoon but not for Real Faces in Children with Autistic Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[74]  A. Marini,et al.  The effect of lexical deficits on narrative disturbances in fluent aphasia , 2015 .

[75]  G. Dawson,et al.  Prototype formation in autism , 2001, Development and Psychopathology.

[76]  Making Meaning Strategies for Literacy Learning , 2012 .

[77]  R. Jonkers,et al.  The effect of static versus dynamic depictions of actions in verb and sentence production in aphasia , 2017 .

[78]  K. Quill,et al.  Visually Cued Instruction for Children with Autism and Pervasive Developmental Disorders , 1995 .

[79]  Don Kincaid,et al.  A Research Synthesis of Social Story Interventions for Children With Autism Spectrum Disorders , 2004 .

[80]  S. Baron-Cohen,et al.  Mechanical, behavioural and Intentional understanding of picture stories in autistic children , 1986 .

[81]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[82]  Marcel Adam Just,et al.  Theory of Mind disruption and recruitment of the right hemisphere during narrative comprehension in autism , 2008, Neuropsychologia.

[83]  Chantal E. Stern,et al.  Fronto-striatal deficit in Parkinson's disease during semantic event sequencing , 2008, Neurobiology of Aging.

[84]  P. Hancock,et al.  Do Faces Capture the Attention of Individuals with Williams Syndrome or Autism? Evidence from Tracking Eye Movements , 2009, Journal of autism and developmental disorders.

[85]  C. Gray,et al.  Social Stories: Improving Responses of Students with Autism with Accurate Social Information , 1993 .

[86]  H. Wellman,et al.  Meta-analysis of theory-of-mind development: the truth about false belief. , 2001, Child development.

[87]  C. Gillberg,et al.  Narrative retelling in children with neurodevelopmental disorders: is there a role for nonverbal temporal-sequencing skills? , 2013, Scandinavian journal of psychology.

[88]  T. Foulsham,et al.  Reading Without Words: Eye Movements in the Comprehension of Comic Strips , 2016 .

[89]  N. Minshew,et al.  Wechsler IQ profiles in diagnosis of high-functioning autism , 1996, Journal of autism and developmental disorders.

[90]  N. Labruyere,et al.  Predicting ensuing actions in children and adolescents with autism spectrum disorders , 2010, Experimental Brain Research.

[91]  R. Schoonen,et al.  Efficacy of two different types of speech therapy for aphasic stroke patients , 1989, Applied Psycholinguistics.

[92]  Heather Harris Wright,et al.  Global coherence during discourse production in adults: a review of the literature. , 2016, International journal of language & communication disorders.

[93]  B. Gordon,et al.  Linguistic and Non-Linguistic Semantic Processing in Individuals with Autism Spectrum Disorders: An ERP Study , 2017, Journal of autism and developmental disorders.

[94]  Neil Cohn,et al.  The notion of the motion: The neurocognition of motion lines in visual narratives , 2015, Brain Research.

[95]  Tiffany L. Hutchins,et al.  Using social stories and comic strip conversations to promote socially valid outcomes for children with autism. , 2006, Seminars in Speech and Language.

[96]  Jennifer B. Ganz,et al.  The Use of Visual Supports to Facilitate Transitions of Students with Autism , 2000 .

[97]  Lester C. Loschky,et al.  The relative roles of visuospatial and linguistic working memory systems in generating inferences during visual narrative comprehension , 2015, Memory & Cognition.

[98]  M Hollander,et al.  Young children's understanding of thought bubbles and of thoughts. , 1996, Child development.

[99]  Patricia Howlin,et al.  Brief Report: Assessment of the Social-Emotional Profile in Children with Autism Spectrum Disorders using a Novel Comic Strip Task , 2012, Journal of autism and developmental disorders.

[100]  J. Wagemans,et al.  Global processing takes time: A meta-analysis on local-global visual processing in ASD. , 2013, Psychological bulletin.

[101]  Joseph P. Magliano,et al.  The Impact of Continuity Editing in Narrative Film on Event Segmentation , 2011, Cogn. Sci..

[102]  Karen A Hux,et al.  Using visual scene displays to create a shared communication space for a person with aphasia , 2010 .

[103]  Tiffany L. Hutchins,et al.  Test-Retest Reliability of a Theory of Mind Task Battery for Children With Autism Spectrum Disorders , 2008 .

[104]  H. Engeland,et al.  Looking at Images with Human Figures: Comparison Between Autistic and Normal Children , 2002, Journal of autism and developmental disorders.

[105]  Panayiota Kendeou,et al.  The Inferential Language Comprehension (iLC) Framework: Supporting Children's Comprehension of Visual Narratives , 2019, Top. Cogn. Sci..

[106]  J. J. Diehl,et al.  Story Recall and Narrative Coherence of High-Functioning Children with Autism Spectrum Disorders , 2006, Journal of abnormal child psychology.

[107]  A. J. North,et al.  Production of narrative and procedural discourse in aphasia , 1981, Brain and Language.

[108]  M. Toichi,et al.  Dual access to semantics in autism: is pictorial access superior to verbal access? , 2000, Journal of child psychology and psychiatry, and allied disciplines.

[109]  P. Rollins Personal Narratives in Individuals with High-Functioning ASD: A Lens Into Social Skills , 2014 .

[110]  Joseph P. Magliano,et al.  Aging and perceived event structure as a function of modality , 2012, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[111]  E. Hill Executive dysfunction in autism , 2004, Trends in Cognitive Sciences.

[112]  A. E. Cook,et al.  Face processing in children with autism , 2007, Autism : the international journal of research and practice.

[113]  Rama Novogrodsky Subject pronoun use by children with autism spectrum disorders (ASD) , 2013, Clinical linguistics & phonetics.

[114]  D. Sidtis Formulaic Language and Language Disorders , 2012 .

[115]  Neil Cohn,et al.  Action starring narratives and events: Structure and inference in visual narrative comprehension , 2015, Journal of cognitive psychology.

[116]  A. Bondy,et al.  The Picture Exchange Communication System , 1994, Seminars in speech and language.

[117]  Susan E. Gately Facilitating Reading Comprehension for Students on the Autism Spectrum , 2008 .

[118]  J. Belliveau,et al.  Cognitive Differences in Pictorial Reasoning Between High-Functioning Autism and Asperger’s Syndrome , 2009, Journal of autism and developmental disorders.

[119]  D. Kurtzberg,et al.  Electrophysiologic correlates of semantic classification in autistic and normal children , 1999 .

[120]  Catherine A. Best,et al.  Prototype formation in autism: Can individuals with autism abstract facial prototypes? , 2009, Autism research : official journal of the International Society for Autism Research.

[121]  Rhea Paul,et al.  Language and communication in autism , 2005 .

[122]  A. Veroff A structural determinant of hemispheric processing of pictorial material , 1978, Brain and Language.

[123]  M. Gernsbacher,et al.  Suppression of Story Character Goals During Reading , 2004, Discourse processes.

[124]  Tiffany L. Hutchins,et al.  The social validity of Social Stories™ for supporting the behavioural and communicative functioning of children with autism spectrum disorder , 2013, International journal of speech-language pathology.

[125]  Nancy L. Monson,et al.  Picture sequencing by schizophrenic patients , 1993 .

[126]  Mark Carter,et al.  A Review of the Efficacy of the Picture Exchange Communication System Intervention , 2009, Journal of autism and developmental disorders.

[127]  Morton Ann Gernsbacher,et al.  Two Decades of Structure Building. , 1997, Discourse processes.

[128]  P. Hancock,et al.  Looking at movies and cartoons: eye-tracking evidence from Williams syndrome and autism. , 2009, Journal of intellectual disability research : JIDR.

[129]  Susan Fager,et al.  AAC for adults with acquired neurological conditions: A review , 2007, Augmentative and alternative communication.

[130]  B. Höhle,et al.  Discourse production in aphasia: a current review of theoretical and methodological challenges , 2016 .