The representation of spatial mental models in long-term memory

This thesis is concerned with how people understand and remember spatial information derived from verbal descriptions. The thesis distinguishes between three different ways of representing spatial information in working memory. The first way is to represent the surface form of the source from which the spatial information is derived (the language of a description). The second is to represent the structure of the situation derived from that source (a spatial mental model). The third is to represent the perceptual characteristics of the situation from a particular perspective (a visual image). Considerable evidence exists that people construct and manipulate spatial mental models in working memory. The purpose of this thesis is to investigate the claim that mental models are represented in long-term memory. An outline of the spatial mental modeling processes required to understand a simple spatial description is proposed. It is proposed that spatial mental modeling is comprised of three processing stages. Firstly, comprehension processes are required to access the linguistic meaning of information presented in spatial description. Secondly, construction processes are required to build up a representation of the spatial structure of the situation derived from the language of the description. Thirdly, consultation processes are required to monitor construction and to access information from the spatial mental model. Nine experiments are reported which investigate evidence for and against the view that people remember the construction and consultation of a spatial mental model. In the final chapter this evidence is reviewed and a 'sketch' of a processing theory of memory for spatial descriptions is proposed. It is argued that memory for a spatial mental model is a product of the interaction between construction and consultation processes over a period of time rather than a simple 'copy' of a completed working memory spatial mental model.

[1]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[2]  Stephen K. Reed,et al.  Structural descriptions and the limitations of visual images* , 1974, Memory & cognition.

[3]  Robert H. Logie,et al.  Characteristics of visual short-term memory , 1989 .

[4]  A. Baddeley.  Human Memory: Theory and Practice, Revised Edition , 1990 .

[5]  Yvonne Rogers,et al.  Models in the mind : theory, perspective and application , 1992 .

[6]  John M. Gardiner,et al.  An appreciation of generate-recognize theory of recall , 1979 .

[7]  W. Brewer,et al.  Role of schemata in memory for places , 1981, Cognitive Psychology.

[8]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[9]  Jonathan St. B. T. Evans,et al.  Theories of Human Reasoning: The Fragmented State of the Art , 1991 .

[10]  M. Gernsbacher.  Cognitive processes and mechanisms in language comprehension : the structure building framework , 1991 .

[11]  Patrick C. Kyllonen,et al.  Reasoning ability is (little more than) working-memory capacity?! , 1990 .

[12]  Morton Ann Gernsbacher,et al.  Language Comprehension As Structure Building , 1990 .

[13]  Stephen E. Newstead,et al.  Mental models as an explanation of belief bias effects in syllogistic reasoning , 1993, Cognition.

[14]  Willem J. M. Levelt,et al.  Some Perceptual Limitations on Talking About Space , 1984 .

[15]  James L. McClelland,et al.  Levels indeed! A response to Broadbent , 1985 .

[16]  G. Bower.  Imagery as a relational organizer in associative learning , 1970 .

[17]  J. Richardson.  The role of mental imagery in models of transitive inference , 1987 .

[18]  14 The Processing of Texts Describing Spatial Configurations , 1989 .

[19]  T. McNamara.  Memory's view of space , 1991 .

[20]  D. Levine,et al.  Visual and spatial mental imagery: Dissociable systems of representation , 1988, Cognitive Psychology.

[21]  M. Land.  Visual Perception: Physiology, Psychology and Ecology, Vicki Bruce, Patrick Green. Lawrence Erlbaum, London (1985), xiii, +369. Price £8.95 (paperback) , 1986 .

[22]  D. Gentner,et al.  Flowing waters or teeming crowds: Mental models of electricity , 1982 .

[23]  F. Craik.  The fate of primary memory items in free recall , 1970 .

[24]  Irwin N. Jankovic,et al.  Principles of spatial problem solving. , 1982 .

[25]  R. M. Byrne,et al.  Remembering conclusions we have inferred: What biases reveal. , 1990 .

[26]  Jane Oakhill,et al.  Referential continuity and the coherence of discourse , 1982, Cognition.

[27]  C. Fletcher.  Assessing recognition memory for surface forms in discourse : a methodological note , 1992 .

[28]  Doris R. Pridemore,et al.  Using maps to retrieve text : a test of conjoint retention , 1992 .

[29]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[30]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[31]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[32]  J. Bransford,et al.  Sentence memory: A constructive versus interpretive approach ☆ ☆☆ , 1972 .

[33]  Gregory V. Jones.  Recognition Failure and Dual Mechanisms in Recall. , 1978 .

[34]  P. Johnson-Laird,et al.  Mental models and temporal reasoning , 1996, Cognition.

[35]  Patrick J. Hayes,et al.  The second naive physics manifesto , 1995 .

[36]  Philip N. Johnson-Laird,et al.  Précis of Deduction , 1993 .

[37]  F. W. Irwin.  Purposive Behavior in Animals and Men , 1932, The Psychological Clinic.

[38]  J. Fodor.  The Modularity of mind. An essay on faculty psychology , 1986 .

[39]  P. Langer,et al.  The effects of text version and feedback type on memorial representations , 1992 .

[40]  P. Johnson-Laird.  Comprehension as the Construction of Mental Models , 1981 .

[41]  H L Roediger,et al.  Implicit memory. Retention without remembering. , 1990, The American psychologist.

[42]  S. Palmer,et al.  The information processing approach to cognition , 1984 .

[43]  Using maps to remember text: an instructional analysis , 1993 .

[44]  D. Broadbent.  A question of levels: comment on McClelland and Rumelhart , 1985 .

[45]  P. Johnson-Laird,et al.  Propositional reasoning by model. , 1992, Psychological review.

[46]  J. Fodor.  Methodological solipsism considered as a research strategy in cognitive psychology , 1980, Behavioral and Brain Sciences.

[47]  Stephen M. Kosslyn,et al.  When is imagery used in everyday life? A diary study. , 1990 .

[48]  B. Tversky.  Spatial mental models , 1991 .

[49]  Daniel G. Morrow,et al.  Situation-Based Inferences During Narrative Comprehension , 1990 .

[50]  A. Garnham,et al.  On theories of belief bias in syllogistic reasoning , 1993, Cognition.

[51]  Richard C. Anderson,et al.  Taking different perspectives on a story. , 1977 .

[52]  G. Bower,et al.  Mental models in narrative comprehension. , 1990, Science.

[53]  G. Bower,et al.  Mental Models and Narrative Comprehension: Some Qualifications , 1993 .

[54]  Gregory V. Jones.  Tests of the dual-mechanism theory of recall , 1982 .

[55]  Roger C. Schank,et al.  Dynamic memory - a theory of reminding and learning in computers and people , 1983 .

[56]  A. Glenberg,et al.  Comprehension of illustrated text: Pictures help to build mental models☆ , 1992 .

[57]  N. Wetherick.  The Computer and the Mind: An Introduction to Cognitive Science. By Philip N. Johnson‐Laird. Pp. 444. (Harvard University Press, 1988.) £23.50. (Also available from Fontana (1988), £6.95.) , 1988 .

[58]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[59]  Alan D. Baddeley,et al.  Comprehension and working memory: A single case neuropsychological study , 1988 .

[60]  Jason E. Albrecht,et al.  Updating a mental model: maintaining both local and global coherence , 1993 .

[61]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[62]  R. Shepard.  Recognition memory for words, sentences, and pictures , 1967 .

[63]  Johnson-Laird Andruth,et al.  Only Reasoning , 2022 .

[64]  Philip N. Johnson-Laird,et al.  Mental Models in Cognitive Science , 1980, Cogn. Sci..

[65]  S. Kosslyn.  The medium and the message in mental imagery: A theory. , 1981 .

[66]  M. Smyth.  Cognition In Action , 1987 .

[67]  S. Payne.  A descriptive study of mental models , 1991 .

[68]  Patrick J. Hayes,et al.  The Naive Physics Manifesto , 1990, The Philosophy of Artificial Intelligence.

[69]  P. Johnson-Laird,et al.  The mental representation of spatial descriptions , 1982, Memory & cognition.

[70]  L. Rips.  Cognitive Processes in Propositional Reasoning. , 1983 .

[71]  E. Rosch.  Cognitive Representations of Semantic Categories. , 1975 .

[72]  E. Boring.  A history of experimental psychology, 2nd ed. , 1950 .

[73]  Barbara Rogoff,et al.  Contextual Organization and Intentionality in Adults' Spatial Memory. , 1987 .

[74]  William F. Brewer,et al.  The Structure of Human Memory , 1983 .

[75]  T. McNamara,et al.  Spatial and temporal contributions to the structure of spatial memory. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[76]  Antonio Gomes Penna,et al.  The mind's new science: a history of the cognitive revolution , 1987 .

[77]  John P. Frisby,et al.  Perception and Representation: A Cognitive Approach , 1986 .

[78]  P. Johnson-Laird,et al.  Spatial Descriptions and Referential Continuity , 1982 .

[79]  Walter Kintsch,et al.  Propositional and situational representations of text , 1985 .

[80]  Barbara Hayes-Roth,et al.  Differences in spatial knowledge acquired from maps and navigation , 1982, Cognitive Psychology.

[81]  F. Schmalhofer,et al.  Three components of understanding a programmer's manual: Verbatim, propositional and situational representations , 1986 .

[82]  Wilhelmina C. Savenye,et al.  Why maps improve memory for text: The influence of structural information on working memory operations , 1993 .

[83]  R. Shepard,et al.  Second-order isomorphism of internal representations: Shapes of states ☆ , 1970 .

[84]  T. McNamara.  Priming and constraints it places on theories of memory and retrieval , 1992 .

[85]  W. Kintsch.  Text comprehension, memory, and learning. , 1994, The American psychologist.

[86]  P. Langer,et al.  Influence of feedback type on comprehension with two variants of a text , 1991 .

[87]  W. Chase.  Spatial Representations of Taxi Drivers , 1983 .

[88]  N. P.,et al.  Meaning , amount of processing , and memory for words , 2022 .

[89]  S. Kosslyn.  Image and mind , 1982 .

[90]  H. H. Clark.  SPACE, TIME, SEMANTICS, AND THE CHILD , 1973 .

[91]  J. Richard Hanley,et al.  Impairment of the Visuo-Spatial Sketch Pad , 1991, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[92]  Philip N. Johnson-Laird,et al.  Advances in the psychology of reasoning: meta-deduction , 1992 .

[93]  Stephen E. Newstead,et al.  Intelligence and cognition : contemporary frames of reference , 1987 .

[94]  F. Craik,et al.  Levels of Processing in Human Memory , 1979 .

[95]  A. Siegel,et al.  Cognitive maps of a college campus: A new look at freshman orientation , 1979 .

[96]  David C. Rubin,et al.  Autobiographical memory: Introduction , 1986 .

[97]  A. Paivio,et al.  Concreteness, imagery, and meaningfulness values for 925 nouns. , 1968, Journal of experimental psychology.

[98]  Morton Ann Gernsbacher,et al.  Surface information loss in comprehension , 1985, Cognitive Psychology.

[99]  G. Miller,et al.  Language and Perception , 1976 .

[100]  Jonathan Evans,et al.  Human Reasoning: The Psychology Of Deduction , 1993 .

[101]  Gregory V. Jones.  Independence and Exclusivity Among Psychological Processes: Implications for the Structure of Recall. , 1987 .

[102]  P. N. Johnson-Laird,et al.  Rationality, memory and the search for counterexamples , 1985, Cognition.

[103]  M. Braine.  On the Relation Between the Natural Logic of Reasoning and Standard Logic. , 1978 .

[104]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[105]  H. Roediger,et al.  Altering retrieval demands reverses the picture superiority effect , 1987, Memory & cognition.

[106]  G. Bower,et al.  Human Associative Memory , 1973 .

[107]  Jonathan St. B. T. Evans,et al.  Reasoning with knights and knaves: A discussion of rips , 1990, Cognition.

[108]  Carol McGuinness,et al.  Visual Imagery: The Question of Representation , 1989 .

[109]  Raymond W. Kulhavy,et al.  Comparing Elaboration and Dual Coding Theories: The Case of Maps and Text , 1993 .

[110]  Henry Montgomery,et al.  Mental models and problem solving: Three challenges to a theory of restructuring and insight , 1988 .

[111]  T. Leahey.  The mythical revolutions of American psychology. , 1992 .

[112]  The role of imagery in models of cognition. , 1977 .

[113]  G. Cohen,et al.  Memory for proper names: age differences in retrieval , 1986 .

[114]  M. HAMMERTON,et al.  A Non-parametric Alternative to d′ , 1971, Nature.

[115]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[116]  G. Einstein,et al.  Relational and item-specific information in memory , 1981 .

[117]  Marc Marschark,et al.  Imagery and organization in the recall of prose , 1985 .

[118]  Robert H. Logie,et al.  Components of fluent reading , 1985 .

[119]  Arthur C. Graesser,et al.  Recognition memory for typical and atypical actions in scripted activities: Tests of a script pointer + tag hypothesis , 1979 .

[120]  Morton Ann Gernsbacher,et al.  Do Readers Mentally Represent Characters' Emotional States? , 1992, Cognition & emotion.

[121]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[122]  B Tversky,et al.  Descriptions and depictions of environments , 1992, Memory & cognition.

[123]  Roger S. Brown,et al.  The "Tip of the Tongue" Phenomenon , 1966 .

[124]  G. Radvansky,et al.  Mental models and the fan effect. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[125]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[126]  Dedre Gentner,et al.  Multiple models of evaporation processes , 1989 .

[127]  O. G. Selfridge,et al.  Pandemonium: a paradigm for learning , 1988 .

[128]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[129]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[130]  Jonathan Evans.  The cognitive psychology of reasoning: An introduction , 1993 .

[131]  H. P. Bahrick.  Two-phase model for prompted recall. , 1970 .

[132]  S. Kosslyn,et al.  Imagery, propositions, and the form of internal representations , 1977, Cognitive Psychology.

[133]  John R. Anderson.  Arguments concerning representations for mental imagery. , 1978 .

[134]  G. Radvansky,et al.  Mental model organization. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[135]  P. Johnson-Laird.  Human and Machine Thinking , 1992 .

[136]  W. Brewer.  Schemas versus mental models in human memory. , 1987 .

[137]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[138]  Heinz Mandl,et al.  Knowledge Acquisition from Text and Pictures , 1989 .

[139]  Richard C. Anderson,et al.  Serial Position and Rated Importance in the Recall of Text. Technical Report No. 219. , 1981 .

[140]  G. Cohen.  Recognition and retrieval of proper names: Age differences in the fan effect , 1990 .

[141]  Stephen M Kosslyn,et al.  Sequential processes in image generation , 1988, Cognitive Psychology.

[142]  P. M. E. Altham,et al.  A NON‐PARAMETRIC MEASURE OF SIGNAL DISCRIMINABILITY , 1973 .

[143]  E. Hilgard,et al.  The history of psychology: a survey and critical assessment. , 1991, Annual review of psychology.

[144]  G. R. Potts.  Information Processing Strategies Used in the Encoding of Linear Orderings. , 1972 .

[145]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[146]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[147]  Mark T. Keane,et al.  Cognitive Psychology: A Student's Handbook , 1990 .

[148]  M. Conway.  Content and organizational differences between autobiographical and semantic memories , 1984 .

[149]  Philip N. Johnson-Laird,et al.  Reasoning by model: The case of multiple quantification. , 1989 .

[150]  M. Farah.  Is visual imagery really visual? Overlooked evidence from neuropsychology. , 1988, Psychological review.

[151]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[152]  T. McNamara,et al.  The representation and integration in memory of spatial and nonspatial information , 1992, Memory & cognition.

[153]  Stephen M. Kosslyn,et al.  A cognitive neuroscience of visual cognition: Further developments. , 1991 .

[154]  Z. Pylyshyn.  Computing in cognitive science , 1989 .

[155]  D. N. Lee.  The optic flow field: the foundation of vision. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[156]  Sentence-order feedback during processing of sequential or spatial texts , 1991 .

[157]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[158]  D. F. Marks,et al.  Visual imagery differences in the recall of pictures. , 1973, British journal of psychology.

[159]  Jane Oakhill,et al.  Discourse processing and text representation from a “Mental Models” perspective , 1992 .

[160]  G. Cohen.  Memory In The Real World , 1989 .

[161]  S. Morra,et al.  Working memory (or the M operator) and the planning of children's drawings , 1988 .

[162]  Richard J. Brown.  Neuropsychology Mental Structure , 1989 .

[163]  A. Glenberg,et al.  Mental models contribute to foregrounding during text comprehension , 1987 .

[164]  John D. Bransford,et al.  The abstraction of linguistic ideas , 1971 .

[165]  F. O. Huck,et al.  Visual Information Processing , 1992 .

[166]  Kathleen M. Galotti,et al.  Approaches to studying formal and everyday reasoning. , 1989 .

[167]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[168]  Ruth M. J. Byrne,et al.  Meta-logical problems: Knights, knaves, and rips , 1990, Cognition.

[169]  A. Paivio.  Mental Representations: A Dual Coding Approach , 1986 .

[170]  P. Johnson-Laird.  Mental models and probabilistic thinking , 1994, Cognition.

[171]  Michael W. Eysenck,et al.  Processing Depth, Elaboration of Encoding, Memory Stores, and Expended Processing Capacity. , 1979 .

[172]  Herbert H. Clark,et al.  Linguistic processes in deductive reasoning. , 1969 .

[173]  W. H. F. Barnes.  The Nature of Explanation , 1944, Nature.

[174]  A. Tversky.  Features of Similarity , 1977 .

[175]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[176]  R H Logie,et al.  Interference with visual short-term memory. , 1990, Acta psychologica.

[177]  R. H. Walters.  The Growth of Logical Thinking from Childhood to Adolescence , 1960 .

[178]  Contributions of different feedback assistance to text memorial representation , 1993 .

[179]  Hartry Field.  Mental representation , 2021, Encyclopedia of Autism Spectrum Disorders.

[180]  Philip N. Johnson-Laird,et al.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology the Effects of Belief on the Spontaneous Production of Syllogistic Conclusions , 2022 .

[181]  Michael W. Eysenck,et al.  A handbook of cognitive psychology , 1984 .

[182]  R. Logie.  Visuo-Spatial Processing in Working Memory , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[183]  Richard C. Anderson,et al.  Recall of Previously Unrecallable Information Following a Shift in Perspective. Technical Report No. 41. , 1977 .

[184]  P. Johnson-Laird,et al.  The psychology of syllogisms , 1978, Cognitive Psychology.

[185]  Peter E. Morris,et al.  Linking images and free recall , 1974 .

[186]  Philip N. Johnson-Laird,et al.  A computational analysis of consciousness. , 1983 .

[187]  T. Leahey.  A History of Modern Psychology , 1991 .

[188]  Stephen K. Reed,et al.  The role of analogy in transfer between similar problem states , 1974 .

[189]  A. Baddeley.  Working Memory: The Interface between Memory and Cognition , 1992, Journal of Cognitive Neuroscience.

[190]  Donald A. Norman,et al.  Some observations on mental models , 1987 .