Evolutionary Constraints on Human Object Perception

Language and culture endow humans with access to conceptual information that far exceeds any which could be accessed by a non-human animal. Yet, it is possible that, even without language or specific experiences, non-human animals represent and infer some aspects of similarity relations between objects in the same way as humans. Here, we show that monkeys' discrimination sensitivity when identifying images of animals is predicted by established measures of semantic similarity derived from human conceptual judgments. We used metrics from computer vision and computational neuroscience to show that monkeys' and humans' performance cannot be explained by low-level visual similarity alone. The results demonstrate that at least some of the underlying structure of object representations in humans is shared with non-human primates, at an abstract level that extends beyond low-level visual similarity. Because the monkeys had no experience with the objects we tested, the results suggest that monkeys and humans share a primitive representation of object similarity that is independent of formal knowledge and cultural experience, and likely derived from common evolutionary constraints on object representation.

[1]  Ty W. Boyer,et al.  Asymmetrical Interference Effects between Two-Dimensional Geometric Shapes and Their Corresponding Shape Words , 2014, PloS one.

[2]  A. Braun,et al.  Toward an evolutionary perspective on conceptual representation: species-specific calls activate visual and affective processing systems in the macaque. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[3]  R. Herrnstein,et al.  Natural concepts in pigeons. , 1976, Journal of experimental psychology. Animal behavior processes.

[4]  Bradford Z. Mahon,et al.  What drives the organization of object knowledge in the brain? , 2011, Trends in Cognitive Sciences.

[5]  C. Gallistel,et al.  Preverbal and verbal counting and computation , 1992, Cognition.

[6]  G. Miller,et al.  Cognitive science. , 1981, Science.

[7]  A. Wright,et al.  Pictorial similarity judgments and the organization of visual memory in the rhesus monkey. , 1982, Journal of experimental psychology. General.

[8]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[9]  S. Dehaene,et al.  Cultural Recycling of Cortical Maps , 2007, Neuron.

[10]  Daniel Mirman,et al.  Effects of near and distant semantic neighbors on word production , 2011, Cognitive, affective & behavioral neuroscience.

[11]  Maryellen C. MacDonald,et al.  Sentence comprehension , 2018 .

[12]  R. Herrnstein,et al.  Complex Visual Concept in the Pigeon , 1964, Science.

[13]  Katherine D. Kinzler,et al.  Core knowledge. , 2007, Developmental science.

[14]  D. Mirman,et al.  Dynamics of activation of semantically similar concepts during spoken word recognition , 2009, Memory & cognition.

[15]  J. Cantlon,et al.  Shared System for Ordering Small and Large Numbers in Monkeys and Humans , 2006, Psychological science.

[16]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[17]  Bruno Rossion,et al.  Early electrophysiological responses to multiple face orientations correlate with individual discrimination performance in humans , 2007, NeuroImage.

[18]  A. Wright,et al.  Monkeys (Macaca mulatta) learn category matching in a nonidentical same-different task. , 1994, Journal of experimental psychology. Animal behavior processes.

[19]  R. Klein,et al.  The effects of nicotine on spatial and non-spatial expectancies in a covert orienting task , 1998, Neuropsychologia.

[20]  S. Jamieson Likert scales: how to (ab)use them , 2004, Medical education.

[21]  Derek C. Penn,et al.  Darwin's mistake: Explaining the discontinuity between human and nonhuman minds , 2008, Behavioral and Brain Sciences.

[22]  Ken McRae,et al.  Category - Specific semantic deficits , 2008 .

[23]  Nikolaus Kriegeskorte,et al.  Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation , 2014, PLoS Comput. Biol..

[24]  Bradford Z. Mahon,et al.  Lexical selection is not by competition: a reinterpretation of semantic interference and facilitation effects in the picture-word interference paradigm. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[25]  Dwight J. Kravitz,et al.  The ventral visual pathway: an expanded neural framework for the processing of object quality , 2013, Trends in Cognitive Sciences.

[26]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[27]  Daniel Mirman,et al.  Attractor Dynamics and Semantic Neighborhood Density: Processing Is Slowed by near Neighbors and Speeded by Distant Neighbors We Thank Ann Kulikowski for Her Help with Data Collection And , 2022 .

[28]  James T. Townsend,et al.  Methods of Modeling Capacity in Simple Processing Systems , 2014 .

[29]  E. Warrington,et al.  Categories of knowledge. Further fractionations and an attempted integration. , 1987, Brain : a journal of neurology.

[30]  Glyn W. Humphreys,et al.  From objects to names: A cognitive neuroscience approach , 1999, Psychological research.

[31]  L. Phillips,et al.  Impulsivity and speed-accuracy strategies in intelligence test performance , 1995 .

[32]  David P Vinson,et al.  Semantic feature production norms for a large set of objects and events , 2008, Behavior research methods.

[33]  Emily P. Bernier,et al.  Core Social Cognition , 2013 .

[34]  M. Wakita,et al.  Pigeons' discrimination of paintings by Monet and Picasso. , 1995, Journal of the experimental analysis of behavior.

[35]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[36]  N. Logothetis,et al.  Functional imaging of the monkey brain , 1999, Nature Neuroscience.

[37]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[38]  Mark S. Seidenberg,et al.  Semantic feature production norms for a large set of living and nonliving things , 2005, Behavior research methods.

[39]  Doris Y. Tsao,et al.  Faces and objects in macaque cerebral cortex , 2003, Nature Neuroscience.

[40]  E. Wasserman,et al.  Conceptual behavior in pigeons: Categories, subcategories, and pseudocategories. , 1988 .

[41]  G. Orians,et al.  Evolved responses to landscapes. , 1992 .

[42]  D. Ross,et al.  The Origin of Mind: Evolution of Brain, Cognition, and General Intelligence , 2006 .

[43]  B. Wandell Computational neuroimaging of human visual cortex. , 1999, Annual review of neuroscience.

[44]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[45]  Dwight J. Kravitz,et al.  A new neural framework for visuospatial processing , 2011, Nature Reviews Neuroscience.

[46]  James L. Crowley Vision for man-machine interaction , 1995, Robotics Auton. Syst..

[47]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  A. Caramazza,et al.  Predicting Conceptual Processing Capacity from Spontaneous Neuronal Activity of the Left Middle Temporal Gyrus , 2012, The Journal of Neuroscience.

[49]  R. Vogels Categorization of complex visual images by rhesus monkeys. Part 1: behavioural study , 1999, The European journal of neuroscience.

[50]  C. Spence,et al.  Tactile-Visual Links in Exogenous Spatial Attention under Different Postures: Convergent Evidence from Psychophysics and ERPs , 2001, Journal of Cognitive Neuroscience.

[51]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  H S Terrace,et al.  Ordering of the numerosities 1 to 9 by monkeys. , 1998, Science.

[53]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[54]  Laurie R Santos,et al.  Evidence for kind representations in the absence of language: Experiments with rhesus monkeys (Macaca mulatta) , 2007, Cognition.

[55]  S. Thorpe,et al.  Rapid categorization of natural images by rhesus monkeys , 1998, Neuroreport.

[56]  W. Maki,et al.  Latent structure in measures of associative, semantic, and thematic knowledge , 2008, Psychonomic bulletin & review.

[57]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  R. Goebel,et al.  Human Object-Similarity Judgments Reflect and Transcend the Primate-IT Object Representation , 2013, Front. Psychol..

[59]  M. Banaji,et al.  Navigating the social world : what infants, children, and other species can teach us , 2013 .

[60]  M. Garrett,et al.  Representing the meanings of object and action words: The featural and unitary semantic space hypothesis , 2004, Cognitive Psychology.

[61]  Thomas Serre,et al.  Object recognition with features inspired by visual cortex , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[62]  C. Murphyy The effects of nicotine on spatial and non ! spatial expectancies in a covert orienting task , 1998 .

[63]  Q. Vuong,et al.  The Respective Role of Low and High Spatial Frequencies in Supporting Configural and Featural Processing of Faces , 2005, Perception.

[64]  Michael Tomasello,et al.  Reply to comments. Two Key Steps in the Evolution of Human Cooperation: The Interdependence Hypothesis , 2012 .

[65]  Ty W. Boyer,et al.  Isolated processing of geometric shapes and their corresponding shape words: Evidence from a delayed match-to-sample task. , 2016, Journal of experimental psychology. Human perception and performance.

[66]  J. Cerella Visual classes and natural categories in the pigeon. , 1979, Journal of experimental psychology. Human perception and performance.

[67]  Frank Keil,et al.  Children's thinking: What never develops? , 1981, Cognition.

[68]  Is associative priming a valid method to differentiate the serial and parallel models of face identification? , 2006 .

[69]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[70]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[71]  E. Markman Constraints on word learning: Speculations about their nature, origins, and domain specificity. , 1992 .

[72]  R. P. McDonald,et al.  Test Theory: A Unified Treatment , 1999 .

[73]  J. Vauclair,et al.  Judgment of conceptual identity in monkeys , 2001, Psychonomic bulletin & review.

[74]  M. Fabre-Thorpe,et al.  Humans and monkeys share visual representations , 2011, Proceedings of the National Academy of Sciences.

[75]  Eric Wanner,et al.  Language acquisition: the state of the art , 1982 .

[76]  L. Cosmides,et al.  Category-specific attention for animals reflects ancestral priorities, not expertise , 2007, Proceedings of the National Academy of Sciences.

[77]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[78]  Michael Tomasello,et al.  Two Key Steps in the Evolution of Human Cooperation , 2012, Current Anthropology.

[79]  Robert Leech,et al.  Sentence comprehension in competing speech: Dichotic sentence-word priming reveals hemispheric differences in auditory semantic processing , 2012 .

[80]  D. V. Essen,et al.  Neural mechanisms of form and motion processing in the primate visual system , 1994, Neuron.

[81]  V. Sloutsky,et al.  Induction and categorization in young children: a similarity-based model. , 2004, Journal of experimental psychology. General.

[82]  David C. Geary,et al.  The Origin of Mind: Evolution of Brain, Cognition, and General Intelligence , 2004 .

[83]  J. Vauclair,et al.  Categorization of alphanumeric characters by Guinea baboons : within- and between-class stimulus discrimination , 1996 .

[84]  A. Caramazza,et al.  Subjective Structures and Operations in Semantic Memory. , 1976 .

[85]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[86]  K. Fernow New York , 1896, American Potato Journal.

[87]  L. Cosmides,et al.  The Adapted mind : evolutionary psychology and the generation of culture , 1992 .

[88]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[89]  Lance J. Rips,et al.  Semantic distance and the verification of semantic relations , 1973 .