Animal Coloration Patterns: Linking Spatial Vision to Quantitative Analysis

Animal coloration patterns, from zebra stripes to bird egg speckles, are remarkably varied. With research on the perception, function, and evolution of animal patterns growing rapidly, we require a convenient framework for quantifying their diversity, particularly in the contexts of camouflage, mimicry, mate choice, and individual recognition. Ideally, patterns should be defined by their locations in a low-dimensional pattern space that represents their appearance to their natural receivers, much as color is represented by color spaces. This synthesis explores the extent to which animal patterns, like colors, can be described by a few perceptual dimensions in a pattern space. We begin by reviewing biological spatial vision, focusing on early stages during which neurons act as spatial filters or detect simple features such as edges. We show how two methods from computational vision—spatial filtering and feature detection—offer qualitatively distinct measures of animal coloration patterns. Spatial filters provide a measure of the image statistics, captured by the spatial frequency power spectrum. Image statistics give a robust but incomplete representation of the appearance of patterns, whereas feature detectors are essential for sensing and recognizing physical objects, such as distinctive markings and animal bodies. Finally, we discuss how pattern space analyses can lead to new insights into signal design and macroevolution of animal phenotypes. Overall, pattern spaces open up new possibilities for exploring how receiver vision may shape the evolution of animal pattern signals.

[1]  Andrew F. Laine,et al.  Visual textures, machine vision and animal camouflage. , 1992, Trends in ecology & evolution.

[2]  H. B. Shaffer,et al.  Rapid Color Evolution in an Aposematic Species: A Phylogenetic Analysis of Color Variation in the Strikingly Polymorphic Strawberry Poison-dart Frog , 2008, Evolution; international journal of organic evolution.

[3]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[5]  Lars Chittka,et al.  Perception Space—The Final Frontier , 2005, PLoS biology.

[6]  Krisztina Kupán,et al.  Camouflage and Clutch Survival in Plovers and Terns , 2016, Scientific Reports.

[7]  N. Marshall,et al.  To Be Seen or to Hide: Visual Characteristics of Body Patterns for Camouflage and Communication in the Australian Giant Cuttlefish Sepia apama , 2011, The American Naturalist.

[8]  J. Lythgoe,et al.  Zebra stripes and tiger stripes: the spatial frequency distribution of the pattern compared to that of the background is significant in display and crypsis , 1987 .

[9]  I. Cuthill,et al.  Disruptive coloration, crypsis and edge detection in early visual processing , 2006, Proceedings of the Royal Society B: Biological Sciences.

[10]  P. Pye-Smith The Descent of Man, and Selection in Relation to Sex , 1871, Nature.

[11]  Randolf Menzel,et al.  FLOWERS THROUGH INSECT EYES , 1997 .

[12]  L. Maffei,et al.  The visual cortex as a spatial frequency analyser. , 1973, Vision research.

[13]  Innes C. Cuthill,et al.  Why the leopard got its spots: relating pattern development to ecology in felids , 2011, Proceedings of the Royal Society B: Biological Sciences.

[14]  R. Jovani,et al.  Fractal geometry of a complex plumage trait reveals bird's quality , 2013, Proceedings of the Royal Society B: Biological Sciences.

[15]  Mark F. Hansen,et al.  Biologically inspired 3D face recognition from surface normals , 2010, Biometrics Technology.

[16]  S. Kastner,et al.  From Behavior to Neural Dynamics: An Integrated Theory of Attention , 2015, Neuron.

[17]  David G. Lowe,et al.  Towards a Computational Model for Object Recognition in IT Cortex , 2000, Biologically Motivated Computer Vision.

[18]  Qasim Zaidi,et al.  Perceptual Spaces: Mathematical Structures to Neural Mechanisms , 2013, The Journal of Neuroscience.

[19]  M. Wiener,et al.  Animal eyes. , 1957, The American orthoptic journal.

[20]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[21]  M. Stevens,et al.  Camouflage through behavior in moths: the role of background matching and disruptive coloration , 2015 .

[22]  Muhammad A. J. Qadri,et al.  Experimental Divergences in the Visual Cognition of Birds and Mammals. , 2015, Comparative cognition & behavior reviews.

[23]  Laura A. Kelley,et al.  Animal visual illusion and confusion: the importance of a perceptual perspective , 2014 .

[24]  Christian L. Cox,et al.  Coral snakes predict the evolution of mimicry across New World snakes , 2016, Nature Communications.

[25]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[26]  Allan W. Snyder,et al.  Acuity of compound eyes: Physical limitations and design , 2004, Journal of comparative physiology.

[27]  L. Reymond Spatial visual acuity of the eagle Aquila audax: a behavioural, optical and anatomical investigation , 1985, Vision Research.

[28]  Sönke Johnsen,et al.  Visual Acuity and the Evolution of Signals. , 2018, Trends in ecology & evolution.

[29]  Thomas W. Pike,et al.  Quantifying camouflage and conspicuousness using visual salience , 2018 .

[30]  S. Merilaita,et al.  Animal camouflage: current issues and new perspectives , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  Amara Lynn Graps,et al.  An introduction to wavelets , 1995 .

[32]  Roland J. Baddeley,et al.  Cultural evolution of military camouflage , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[33]  John A. Endler,et al.  A framework for analysing colour pattern geometry: adjacent colours , 2012 .

[34]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[35]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[36]  Pierre Kornprobst,et al.  Bio-inspired computer vision: Towards a synergistic approach of artificial and biological vision , 2016, Comput. Vis. Image Underst..

[37]  Andreas R. Pfenning,et al.  Global view of the functional molecular organization of the avian cerebrum: Mirror images and functional columns , 2013, The Journal of comparative neurology.

[38]  R. Shapley,et al.  New perspectives on the mechanisms for orientation selectivity , 1997, Current Opinion in Neurobiology.

[39]  I. Cuthill,et al.  Using digital photography to study animal coloration , 2007 .

[40]  Randolf Menzel,et al.  Insect visual perception: complex abilities of simple nervous systems , 1997, Current Opinion in Neurobiology.

[41]  Innes C. Cuthill,et al.  Distance-dependent defensive coloration , 2014, Current Biology.

[42]  William L. Allen,et al.  Assessing the potential information content of multicomponent visual signals: a machine learning approach , 2015, Proceedings of the Royal Society B: Biological Sciences.

[43]  James J DiCarlo,et al.  Eight open questions in the computational modeling of higher sensory cortex , 2016, Current Opinion in Neurobiology.

[44]  Tanya Y. Berger-Wolf,et al.  Animal Population Censusing at Scale with Citizen Science and Photographic Identification , 2017, AAAI Spring Symposia.

[45]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[46]  D. Uhlrich,et al.  Cross-species correspondence of spatial contrast sensitivity functions , 1981, Behavioural Brain Research.

[47]  Ben. G. Weinstein A computer vision for animal ecology. , 2018, The Journal of animal ecology.

[48]  Mary M. Conte,et al.  Spatial organization of nonlinear interactions in form perception , 1991, Vision Research.

[49]  Fabian A. Soto,et al.  Mechanisms of object recognition: what we have learned from pigeons , 2014, Front. Neural Circuits.

[50]  Sönke Johnsen,et al.  AcuityView: An r package for portraying the effects of visual acuity on scenes observed by an animal , 2017 .

[51]  Rolf G. Kuehni,et al.  Color Space and Its Divisions , 2003 .

[52]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[53]  Almut Kelber,et al.  The spatial tuning of achromatic and chromatic vision in budgerigars. , 2011, Journal of vision.

[54]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[55]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[56]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[57]  A F Laine,et al.  A wavelet-based metric for visual texture discrimination with applications in evolutionary ecology. , 1995, Mathematical biosciences.

[58]  Peter Thompson,et al.  Basic Vision: An Introduction to Visual Perception , 2006 .

[59]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[60]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[61]  Martin Stevens,et al.  Image calibration and analysis toolbox – a free software suite for objectively measuring reflectance, colour and pattern , 2015, Methods in ecology and evolution.

[62]  William L. Allen,et al.  Character displacement of Cercopithecini primate visual signals , 2014, Nature Communications.

[63]  Lauren L. Cloutman,et al.  Interaction between dorsal and ventral processing streams: Where, when and how? , 2013, Brain and Language.

[64]  E. Poulton Adaptive Coloration in Animals , 1940, Nature.

[65]  R. Prum,et al.  Evolution of Avian Plumage Color in a Tetrahedral Color Space: A Phylogenetic Analysis of New World Buntings , 2008, The American Naturalist.

[66]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[67]  M. Stevens,et al.  Pattern mimicry of host eggs by the common cuckoo, as seen through a bird's eye , 2010, Proceedings of the Royal Society B: Biological Sciences.

[68]  J. Beck,et al.  Contrast and spatial variables in texture segregation: Testing a simple spatial-frequency channels model , 1989, Perception & psychophysics.

[69]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[70]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[71]  Flávio P. Ferreira,et al.  Statistics of spatial cone-excitation ratios in natural scenes. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[72]  G. Barsh,et al.  Developmental mechanisms of stripe patterns in rodents , 2016, Nature.

[73]  R. Baddeley,et al.  A review of cuttlefish camouflage and object recognition and evidence for depth perception , 2008, Journal of Experimental Biology.

[74]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[75]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[76]  Francis Gilbert,et al.  Distance transform: a tool for the study of animal colour patterns , 2013 .

[77]  I. Cuthill,et al.  Spotting the difference: towards fully-automated population monitoring of African penguins Spheniscus demersus , 2010 .

[78]  H. Kühl,et al.  Animal biometrics: quantifying and detecting phenotypic appearance. , 2013, Trends in ecology & evolution.

[79]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[80]  A. Kelber,et al.  Colour spaces in ecology and evolutionary biology , 2017, Biological reviews of the Cambridge Philosophical Society.

[81]  M. Stevens,et al.  Quantifying camouflage: how to predict detectability from appearance , 2017, BMC Evolutionary Biology.

[82]  C. Town,et al.  Pattern recognition algorithm reveals how birds evolve individual egg pattern signatures , 2014, Nature Communications.

[83]  Hannah M. Rowland,et al.  The biology of color , 2017, Science.

[84]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  D. Osorio,et al.  Coevolution of coloration and colour vision? , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[86]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[87]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[88]  A. Reiner,et al.  Do birds possess homologues of mammalian primary visual, somatosensory and motor cortices? , 2000, Trends in Neurosciences.

[89]  Eleanor M. Caves,et al.  Does coevolution with a shared parasite drive hosts to partition their defences among species? , 2017, Proceedings of the Royal Society B: Biological Sciences.

[90]  G. Rosenthal Spatiotemporal Dimensions of Visual Signals in Animal Communication , 2007 .

[91]  Diane M. Beck,et al.  Top-down and bottom-up mechanisms in biasing competition in the human brain , 2009, Vision Research.

[92]  Fabian A. Soto,et al.  Visual object categorization in birds and primates: Integrating behavioral, neurobiological, and computational evidence within a “general process” framework , 2011, Cognitive, Affective, & Behavioral Neuroscience.

[93]  Nico Cellinese,et al.  Mass digitization of scientific collections: New opportunities to transform the use of biological specimens and underwrite biodiversity science , 2012, ZooKeys.

[94]  D. Kemp,et al.  An Integrative Framework for the Appraisal of Coloration in Nature , 2015, The American Naturalist.

[95]  Philip K Maini,et al.  Using mathematical models to help understand biological pattern formation. , 2004, Comptes rendus biologies.

[96]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[97]  Roger Hanlon,et al.  Cephalopod dynamic camouflage , 2007, Current Biology.

[98]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[99]  J. Endler,et al.  Paradox lost: variable colour-pattern geometry is associated with differences in movement in aposematic frogs , 2014, Biology Letters.

[100]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[101]  M. Stevens,et al.  Visual modeling shows that avian host parents use multiple visual cues in rejecting parasitic eggs , 2010, Proceedings of the National Academy of Sciences.

[102]  Martin Stevens,et al.  Predator perception and the interrelation between different forms of protective coloration , 2007, Proceedings of the Royal Society B: Biological Sciences.

[103]  J. Mappes,et al.  Trade-off between warning signal efficacy and mating success in the wood tiger moth , 2012, Proceedings of the Royal Society B: Biological Sciences.

[104]  C. Chubb,et al.  The scaling effects of substrate texture on camouflage patterning in cuttlefish , 2009, Vision Research.

[105]  H. K. HAltTLIn THE RESPONSE OF SINGLE OPTIC NERVE FIBERS OF THE VERTEBRATE EYE TO ILLUMINATION OF THE RETINA , 2004 .

[106]  G. Ruxton,et al.  Egg-Laying Substrate Selection for Optimal Camouflage by Quail , 2013, Current Biology.

[107]  G. Ruxton,et al.  Signal Diversity, Sexual Selection, and Speciation , 2015 .

[108]  M. Mills,et al.  Not just black and white: pigment pattern development and evolution in vertebrates. , 2009, Seminars in cell & developmental biology.

[109]  M V Srinivasan,et al.  Camouflage by edge enhancement in animal coloration patterns and its implications for visual mechanisms , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[110]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[111]  J. Endler,et al.  Comparing entire colour patterns as birds see them , 2005 .

[112]  J. DiCarlo,et al.  Using goal-driven deep learning models to understand sensory cortex , 2016, Nature Neuroscience.

[113]  Daniel Osorio,et al.  Camouflage and perceptual organization in the animal kingdom , 2015 .

[114]  Roland J. Baddeley,et al.  The evolution and function of pattern diversity in snakes , 2013 .

[115]  J. Gómez,et al.  SpotEgg: An image‐processing tool for automatised analysis of colouration and spottiness , 2017 .

[116]  D. Osorio,et al.  Juvenile plaice (Pleuronectes platessa) produce camouflage by flexibly combining two separate patterns , 2006, Journal of Experimental Biology.

[117]  C. Town,et al.  Manta Matcher: automated photographic identification of manta rays using keypoint features , 2013, Ecology and evolution.

[118]  D. Westmoreland,et al.  Egg color as an adaptation for thermoregulation , 2007 .

[119]  Charles Chubb,et al.  Cuttlefish camouflage: The effects of substrate contrast and size in evoking uniform, mottle or disruptive body patterns , 2008, Vision Research.

[120]  Benedict G. Hogan,et al.  Higher-level pattern features provide additional information to birds when recognizing and rejecting parasitic eggs , 2019, Philosophical Transactions of the Royal Society B.

[121]  M. Stevens,et al.  Shape matters: animal colour patterns as signals of individual quality , 2017, Proceedings of the Royal Society B: Biological Sciences.

[122]  Sexual dimorphism and intra-populational colour pattern variation in the aposematic frog Dendrobates tinctorius , 2013, Evolutionary Ecology.

[123]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[124]  K. Summers,et al.  Interspecific and intraspecific views of color signals in the strawberry poison frog Dendrobates pumilio , 2004, Journal of Experimental Biology.

[125]  M. Huynen,et al.  Disruptive coloration and background pattern matching , 2005, Nature.

[126]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[127]  D. Pfennig,et al.  Predator Cognition Permits Imperfect Coral Snake Mimicry , 2010, The American Naturalist.

[128]  D. V. van Essen,et al.  Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. , 1993, Science.

[129]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[130]  A. Baddeley An Error Metric for Binary Images , 1992 .

[131]  B. Julesz,et al.  Visual discrimination of textures with identical third-order statistics , 1978, Biological Cybernetics.

[132]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[133]  M. Vorobyev,et al.  Animal colour vision — behavioural tests and physiological concepts , 2003, Biological reviews of the Cambridge Philosophical Society.

[134]  Tanya Y. Berger-Wolf,et al.  Biometric animal databases from field photographs: identification of individual zebra in the wild , 2011, ICMR.

[135]  N. Gostling,et al.  From DNA to Diversity: Molecular Genetics and the Evolution of Animal Design , 2002, Heredity.

[136]  D. Field,et al.  Natural image statistics and efficient coding. , 1996, Network.

[137]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[138]  Ralph Michael,et al.  Neural contrast sensitivity calculated from measured total contrast sensitivity and modulation transfer function , 2010, Acta ophthalmologica.