What can Functional Neuroimaging Tell the Experimental Psychologist?

I argue here that functional neuroimaging data—which I restrict to the haemodynamic techniques of fMRI and PET—can inform psychological theorizing, provided one assumes a “systematic” function–structure mapping in the brain. In this case, imaging data simply comprise another dependent variable, along with behavioural data, that can be used to test competing theories. In particular, I distinguish two types of inference: function-to-structure deduction and structure-to-function induction. With the former inference, a qualitatively different pattern of activity over the brain under two experimental conditions implies at least one different function associated with changes in the independent variable. With the second type of inference, activity of the same brain region(s) under two conditions implies a common function, possibly not predicted a priori. I illustrate these inferences with imaging studies of recognition memory, short-term memory, and repetition priming. I then consider in greater detail what is meant by a “systematic” function–structure mapping and argue that, particularly for structure-to-function induction, this entails a one-to-one mapping between functional and structural units, although the structural unit may be a network of interacting regions and care must be taken over the appropriate level of functional/structural abstraction. Nonetheless, the assumption of a systematic function–structure mapping is a “working hypothesis” that, in common with other scientific fields, cannot be proved on independent grounds and is probably best evaluated by the success of the enterprise as a whole. I also consider statistical issues such as the definition of a qualitative difference and methodological issues such as the relationship between imaging and behavioural data. I finish by reviewing various objections to neuroimaging, including neophrenology, functionalism, and equipotentiality, and by observing some criticisms of current practice in the imaging literature.

[1]  K. Lashley Brain Mechanisms and Intelligence: A Quantitative Study of Injuries to the Brain , 1965 .

[2]  Samuel W. Fernberger,et al.  Brain Mechanisms and Intelligence: A Quantitative Study of Injuries to the Brain. , 1931 .

[3]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[4]  S. Sternberg Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[5]  S. Sternberg The discovery of processing stages , 1969 .

[6]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[7]  Vera Rich,et al.  Promises, promises , 1974, Nature.

[8]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[9]  J. Winn,et al.  Brain , 1878, The Lancet.

[10]  L. Squire,et al.  Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. , 1980, Science.

[11]  W. Estes,et al.  Item and order information in short-term memory: Evidence for multilevel perturbation processes. , 1981 .

[12]  David Caplan,et al.  On the cerebral localization of linguistic functions: Logical and empirical issues surrounding deficit analysis and functional localization , 1981, Brain and Language.

[13]  J. Marshall Multiple perspectives on modularity , 1984, Cognition.

[14]  P. A. Kolers,et al.  Procedures of mind. , 1984 .

[15]  J. Morton,et al.  On reducing language to biology , 1984 .

[16]  K. Brodmann Vergleichende Lokalisationslehre der Großhirnrinde : in ihren Prinzipien dargestellt auf Grund des Zellenbaues , 1985 .

[17]  A. Caramazza On drawing inferences about the structure of normal cognitive systems from the analysis of patterns of impaired performance: The case for single-patient studies , 1986, Brain and Cognition.

[18]  E. Balint Memory and consciousness. , 1987, The International journal of psycho-analysis.

[19]  J. Kaas The organization of neocortex in mammals: implications for theories of brain function. , 1987, Annual review of psychology.

[20]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[21]  K. Kirsner,et al.  Discovering functionally independent mental processes: the principle of reversed association. , 1988, Psychological review.

[22]  David E. Irwin,et al.  Modern mental chronometry , 1988, Biological Psychology.

[23]  Richard J. Brown Neuropsychology Mental Structure , 1989 .

[24]  J. Gardiner,et al.  Recollective experience in word and nonword recognition , 1990, Memory & cognition.

[25]  J. Tanji,et al.  The role of premotor cortex and the supplementary motor area in the temporal control of movement in man. , 1993, Brain : a journal of neurology.

[26]  A. Allport Attention and control: have we been asking the wrong questions? A critical review of twenty-five years , 1993 .

[27]  N Birbaumer,et al.  Classical conditioning after cerebellar lesions in humans. , 1993, Behavioral neuroscience.

[28]  Suparna Rajaram,et al.  Remembering and knowing: Two means of access to the personal past , 1993, Memory & cognition.

[29]  Sophie Papst,et al.  Memory Systems 1994 , 1994 .

[30]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[31]  E. Tulving,et al.  Memory Systems 1994 , 1994 .

[32]  L R Squire,et al.  Remembering and knowing: two different expressions of declarative memory. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[33]  M. Rugg ERP studies of memory. , 1995 .

[34]  L. Jacoby,et al.  The Relation between Remembering and Knowing as Bases for Recognition: Effects of Size Congruency , 1995 .

[35]  N. Lavie Perceptual load as a necessary condition for selective attention. , 1995, Journal of experimental psychology. Human perception and performance.

[36]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[37]  Karl J. Friston,et al.  The Trouble with Cognitive Subtraction , 1996, NeuroImage.

[38]  Gurindar S. Sohi,et al.  Memory systems , 1996, CSUR.

[39]  M. Rugg,et al.  Electrophysiology of Mind. , 1996 .

[40]  J. Cacioppo,et al.  Brain imaging and cognitive neuroscience. Toward strong inference in attributing function to structure. , 1996, The American psychologist.

[41]  W. Donaldson,et al.  The role of decision processes in remembering and knowing , 1996, Memory & cognition.

[42]  Edward E. Smith,et al.  Working Memory: A View from Neuroimaging , 1997, Cognitive Psychology.

[43]  E. Hirshman,et al.  Modeling the conscious correlates of recognition memory: Reflections on the remember-know paradigm , 1997, Memory & cognition.

[44]  Karl J. Friston,et al.  Cognitive Conjunction: A New Approach to Brain Activation Experiments , 1997, NeuroImage.

[45]  C. Büchel,et al.  Modulation of connectivity in visual pathways by attention: cortical interactions evaluated with structural equation modelling and fMRI. , 1997, Cerebral cortex.

[46]  Michael Matessa,et al.  A Production System Theory of Serial Memory , 1997 .

[47]  C D Frith,et al.  Modulating irrelevant motion perception by varying attentional load in an unrelated task. , 1997, Science.

[48]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[49]  R. Henson Short-Term Memory for Serial Order: The Start-End Model , 1998, Cognitive Psychology.

[50]  M. Hallett,et al.  The functional neuroanatomy of simple and complex sequential finger movements: a PET study. , 1998, Brain : a journal of neurology.

[51]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[52]  S. Dehaene,et al.  Imaging unconscious semantic priming , 1998, Nature.

[53]  F. Bellezza,et al.  The detection model of recognition using know and remember judgments , 1998, Memory & cognition.

[54]  A. McIntosh,et al.  Mapping cognition to the brain through neural interactions. , 1999, Memory.

[55]  Geraint Rees,et al.  Inattentional blindness versus inattentional amnesia for , 1999 .

[56]  T. Shallice,et al.  Recollection and Familiarity in Recognition Memory: An Event-Related Functional Magnetic Resonance Imaging Study , 1999, The Journal of Neuroscience.

[57]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[58]  I. Wilkinson,et al.  Introduction to functional magnetic resonance imaging , 1999 .

[59]  Rugg,et al.  Recollection and familiarity in recognition memory: an event-related fMRI study , 1999 .

[60]  Karl J. Friston,et al.  The physiological basis of attentional modulation in extrastriate visual areas , 1999, Nature Neuroscience.

[61]  C. Frith,et al.  Inattentional blindness versus inattentional amnesia for fixated but ignored words. , 1999, Science.

[62]  N. Burgess Memory for Serial Order : A Network Model of the Phonological Loop and its Timing , 1999 .

[63]  Karl J. Friston,et al.  Delineating Necessary and Sufficient Neural Systems with Functional Imaging Studies of Neuropsychological Patients , 1999, Journal of Cognitive Neuroscience.

[64]  S. Small,et al.  AN INTRODUCTION TO FUNCTIONAL MAGNETIC RESONANCE IMAGING , 1999 .

[65]  Karl J. Friston,et al.  Attentional modulation of effective connectivity from V2 to V5/MT in humans. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[66]  N Burgess,et al.  Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study , 2000, Neuropsychologia.

[67]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[68]  J. Duncan,et al.  Common regions of the human frontal lobe recruited by diverse cognitive demands , 2000, Trends in Neurosciences.

[69]  M. Rugg,et al.  Retrieval processing and episodic memory , 2000, Trends in Cognitive Sciences.

[70]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[71]  Adam Phillips,et al.  Promises, Promises , 2000 .

[72]  G D Brown,et al.  Oscillator-based memory for serial order. , 2000, Psychological review.

[73]  T. Shallice,et al.  Confidence in Recognition Memory for Words: Dissociating Right Prefrontal Roles in Episodic Retrieval , 2000, Journal of Cognitive Neuroscience.

[74]  T. Shallice,et al.  Neuroimaging evidence for dissociable forms of repetition priming. , 2000, Science.

[75]  Frank Tong,et al.  The Face of Controversy , 2001, Science.

[76]  S. Sternberg,et al.  Separate modifiability, mental modules, and the use of pure and composite measures to reveal them. , 2001, Acta psychologica.

[77]  J. Duncan An adaptive coding model of neural function in prefrontal cortex , 2001 .

[78]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[79]  Satoru Saito,et al.  The phonological loop and memory for rhythms: An individual differences approach , 2001, Memory.

[80]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[81]  M. Rugg,et al.  Task-dependency of the neural correlates of episodic encoding as measured by fMRI. , 2001, Cerebral cortex.

[82]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[83]  Refractor Vision , 2000, The Lancet.

[84]  R. Henson,et al.  Frontal lobes and human memory: insights from functional neuroimaging. , 2001, Brain : a journal of neurology.

[85]  R N Henson,et al.  Depth of processing effects on neural correlates of memory encoding: relationship between findings from across- and within-task comparisons. , 2001, Brain : a journal of neurology.

[86]  R. Henson,et al.  State-related and item-related neural correlates of successful memory encoding , 2002, Nature Neuroscience.

[87]  Rugg,et al.  Episodic memory retrieval: an (event-related) functional neuroimaging perspective , 2002 .

[88]  D. Heeger,et al.  In this issue , 2002, Nature Reviews Drug Discovery.

[89]  Karl J. Friston,et al.  PHRENOLOGY : What Can Neuroimaging Tell Us About Distributed Circuitry ? , 2005 .

[90]  H. Pashler STEVENS' HANDBOOK OF EXPERIMENTAL PSYCHOLOGY , 2002 .

[91]  Jean-Baptiste Poline,et al.  Multivariate Model Specification for fMRI Data , 2002, NeuroImage.

[92]  G. Rees The new phrenology: the limits of localizing cognitive processes in the brain , 2002 .

[93]  Karl J. Friston Functional integration and inference in the brain , 2002, Progress in Neurobiology.

[94]  A. Yonelinas The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[95]  D. Attwell,et al.  The neural basis of functional brain imaging signals , 2002, Trends in Neurosciences.

[96]  R. Goebel,et al.  Mirror-Symmetric Tonotopic Maps in Human Primary Auditory Cortex , 2003, Neuron.

[97]  M. Gerstein,et al.  Ontologies for proteomics: towards a systematic definition of structure and function that scales to the genome level. , 2003, Current opinion in chemical biology.

[98]  Paul C. Fletcher,et al.  Regional Brain Activations Predicting Subsequent Memory Success: An Event-Related Fmri Study of the Influence of Encoding Tasks , 2003, Cortex.

[99]  N. Burgess,et al.  Selective Interference with Verbal Short-Term Memory for Serial Order Information: A New Paradigm and Tests of a Timing-Signal Hypothesis , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[100]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[101]  R. Henson,et al.  Electrophysiological and haemodynamic correlates of face perception, recognition and priming. , 2003, Cerebral cortex.

[102]  R. Henson,et al.  Neural response suppression, haemodynamic repetition effects, and behavioural priming , 2003, Neuropsychologia.

[103]  Doris Y. Tsao,et al.  Neuroimaging Weighs In: Humans Meet Macaques in “Primate” Visual Cortex , 2003, The Journal of Neuroscience.

[104]  R. Henson,et al.  A familiarity signal in human anterior medial temporal cortex? , 2003, Hippocampus.

[105]  Andrew Heathcote,et al.  Item recognition memory and the receiver operating characteristic. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[106]  E. Hubbard A discussion and review of Uttal (2001) The New Phrenology , 2003 .

[107]  Tim Shallice,et al.  Functional imaging and neuropsychology findings: how can they be linked? , 2003, NeuroImage.

[108]  Max Coltheart,et al.  Brain Imaging, Connectionism, and Cognitive Neuropsychology , 2004, Cognitive neuropsychology.

[109]  T. Harley Does Cognitive Neuropsychology have a future? , 2004, Cognitive neuropsychology.

[110]  P. Halligan,et al.  The relevance of behavioural measures for functional-imaging studies of cognition , 2004, Nature Reviews Neuroscience.

[111]  R. Dolan,et al.  fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. , 2004, Journal of neurophysiology.

[112]  R. Miall,et al.  A system in the human brain for predicting the actions of others , 2004, Nature Neuroscience.

[113]  Karl J. Friston,et al.  Degenerate neuronal systems sustaining cognitive functions , 2004, Journal of anatomy.

[114]  Jane E Herron,et al.  Probability effects on the neural correlates of retrieval success: an fMRI study , 2004, NeuroImage.

[115]  Karl J. Friston,et al.  Functional ontologies for cognition: The systematic definition of structure and function , 2005, Cognitive neuropsychology.