What’s she doing in the kitchen? Context helps when actions are hard to recognize

Specific spatial environments are often indicative of where certain actions may take place: In kitchens we prepare food, and in bathrooms we engage in personal hygiene, but not vice versa. In action recognition, contextual cues may constrain an observer’s expectations toward actions that are more strongly associated with a particular context than others. Such cues should become particularly helpful when the action itself is difficult to recognize. However, to date only easily identifiable actions were investigated, and the effects of context on recognition were rather interfering than facilitatory. To test whether context also facilitates action recognition, we measured recognition performance of hardly identifiable actions that took place in compatible, incompatible, and neutral contextual settings. Action information was degraded by pixelizing the area of the object manipulation while the room in which the action took place remained fully visible. We found significantly higher accuracy for actions that took place in compatible compared to incompatible and neutral settings, indicating facilitation. Additionally, action recognition was slower in incompatible settings than in compatible and neutral settings, indicating interference. Together, our findings demonstrate that contextual information is effectively exploited during action observation, in particular when visual information about the action itself is sparse. Differential effects on speed and accuracy suggest that contexts modulate action recognition at different levels of processing. Our findings emphasize the importance of contextual information in comprehensive, ecologically valid models of action recognition.

[1]  tephen E. Palmer The effects of contextual scenes on the identification of objects , 1975, Memory & cognition.

[2]  Moritz F. Wurm,et al.  Objects Mediate Goal Integration in Ventrolateral Prefrontal Cortex during Action Observation , 2015, PloS one.

[3]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[4]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[5]  Russell A. Epstein The cortical basis of visual scene processing , 2005 .

[6]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  David Badre,et al.  Left ventrolateral prefrontal cortex and the cognitive control of memory , 2007, Neuropsychologia.

[8]  Elan Barenholtz,et al.  Quantifying the role of context in visual object recognition , 2010 .

[9]  Moritz F. Wurm,et al.  Objects tell us what action we can expect: dissociating brain areas for retrieval and exploitation of action knowledge during action observation in fMRI , 2014, Front. Psychol..

[10]  Moritz F. Wurm,et al.  Do we mind other minds when we mind other minds' actions? A functional magnetic resonance imaging study , 2011, Human brain mapping.

[11]  K. Rayner,et al.  Effect of background information on object identification. , 1989 .

[12]  Laurel J Buxbaum,et al.  Uncovering the architecture of action semantics. , 2014, Journal of experimental psychology. Human perception and performance.

[13]  Y. Munakata,et al.  Hebbian learning and development. , 2004, Developmental science.

[14]  Patric Bach,et al.  The affordance-matching hypothesis: how objects guide action understanding and prediction , 2014, Front. Hum. Neurosci..

[15]  Ricarda I. Schubotz,et al.  Squeezing lemons in the bathroom: Contextual information modulates action recognition , 2012, NeuroImage.

[16]  Dwight J. Kravitz,et al.  A new neural framework for visuospatial processing , 2011, Nature Reviews Neuroscience.

[17]  Ricarda I. Schubotz,et al.  Predicting goals in action episodes attenuates BOLD response in inferior frontal and occipitotemporal cortex , 2014, Behavioural Brain Research.

[18]  D. Yves von Cramon,et al.  The Case of Pretense: Observing Actions and Inferring Goals , 2009, Journal of Cognitive Neuroscience.

[19]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[20]  M. Kutas,et al.  An electrophysiological study of scene effects on object identification. , 2003, Brain research. Cognitive brain research.

[21]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[22]  I. Biederman,et al.  On the information extracted from a glance at a scene. , 1974, Journal of experimental psychology.

[23]  D. Yves von Cramon,et al.  The Context–Object–Manipulation Triad: Cross Talk during Action Perception Revealed by fMRI , 2012, Journal of Cognitive Neuroscience.

[24]  A. Pollatsek,et al.  Identification of objects in scenes: the role of scene background in object naming. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[25]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[26]  Moritz F. Wurm,et al.  Action observers implicitly expect actors to act goal‐coherently, even if they do not: An fMRI study , 2014, Human brain mapping.

[27]  Jodi L. Davenport,et al.  Scene Consistency in Object and Background Perception , 2004, Psychological science.

[28]  Christian Keysers,et al.  Object visibility alters the relative contribution of ventral visual stream and mirror neuron system to goal anticipation during action observation , 2015, NeuroImage.