Quantitative Colour Pattern Analysis (QCPA): A Comprehensive Framework for the Analysis of Colour Patterns in Nature

To understand the function of colour signals in nature, we require robust quantitative analytical frameworks to enable us to estimate how animal and plant colour patterns appear against their natural background as viewed by ecologically relevant species. Due to the quantitative limitations of existing methods, colour and pattern are rarely analysed in conjunction with one another, despite a large body of literature and decades of research on the importance of spatiochromatic colour pattern analyses. Furthermore, key physiological limitations of animal visual systems such as spatial acuity, spectral sensitivities, photoreceptor abundances and receptor noise levels are rarely considered together in colour pattern analyses. Here, we present a novel analytical framework, called the ‘Quantitative Colour Pattern Analysis’ (QCPA). We have overcome many quantitative and qualitative limitations of existing colour pattern analyses by combining calibrated digital photography and visual modelling. We have integrated and updated existing spatiochromatic colour pattern analyses, including adjacency, visual contrast and boundary strength analysis, to be implemented using calibrated digital photography through the ‘Multispectral Image Analysis and Calibration’ (MICA) Toolbox. This combination of calibrated photography and spatiochromatic colour pattern analyses is enabled by the inclusion of psychophysical colour and luminance discrimination thresholds for image segmentation, which we call ‘Receptor Noise Limited Clustering’, used here for the first time. Furthermore, QCPA provides a novel psycho-physiological approach to the modelling of spatial acuity using convolution in the spatial or frequency domains, followed by ‘Receptor Noise Limited Ranked Filtering’ to eliminate intermediate edge artefacts and recover sharp boundaries following smoothing. We also present a new type of colour pattern analysis, the ‘Local Edge Intensity Analysis’ (LEIA) as well as a range of novel psycho-physiological approaches to the visualisation of spatiochromatic data. QCPA combines novel and existing pattern analysis frameworks into what we hope is a unified, user-friendly, free and open source toolbox and introduce a range of novel analytical and data-visualisation approaches. These analyses and tools have been seamlessly integrated into the MICA toolbox providing a dynamic and user-friendly workflow. QCPA is a framework for the empirical investigation of key theories underlying the design, function and evolution of colour patterns in nature. We believe that it is compatible with, but more thorough than, other existing colour pattern analyses.

[1]  Martin Stevens,et al.  Motion dazzle and the effects of target patterning on capture success , 2014, BMC Evolutionary Biology.

[2]  Martin Giurfa,et al.  Detection of coloured patterns by honeybees through chromatic and achromatic cues , 2001, Journal of Comparative Physiology A.

[3]  Gopal Murali,et al.  Now you see me, now you don't: dynamic flash coloration as an antipredator strategy in motion , 2018, Animal Behaviour.

[4]  James Mallet,et al.  EVOLUTION OF DIVERSITY IN WARNING COLOR AND MIMICRY: Polymorphisms, Shifting , 1999 .

[5]  Roger T Hanlon,et al.  Hyperspectral imaging of cuttlefish camouflage indicates good color match in the eyes of fish predators , 2011, Proceedings of the National Academy of Sciences.

[6]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  S. Merilaita,et al.  Selection for cryptic coloration in a visually heterogeneous habitat , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[8]  A. Kelber,et al.  Colour spaces in ecology and evolutionary biology , 2017, Biological reviews of the Cambridge Philosophical Society.

[9]  Martin Stevens,et al.  Visual Ecology , 2015 .

[10]  J. Endler On the measurement and classification of colour in studies of animal colour patterns , 1990 .

[11]  F. Kingdom,et al.  Interactions between chromatic- and luminance-contrast-sensitive stereopsis mechanisms , 2002, Vision Research.

[12]  Robert L. Goldstone,et al.  Categorical perception. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[13]  安藤 広志,et al.  20世紀の名著名論:David Marr:Vision:a Computational Investigation into the Human Representation and Processing of Visual Information , 2005 .

[14]  Daniel Osorio,et al.  Animal Coloration Patterns: Linking Spatial Vision to Quantitative Analysis , 2019, The American Naturalist.

[15]  K. McGarigal,et al.  FRAGSTATS: spatial pattern analysis program for quantifying landscape structure. , 1995 .

[16]  J. Endler,et al.  Paradox lost: variable colour-pattern geometry is associated with differences in movement in aposematic frogs , 2014, Biology Letters.

[17]  C. Rowe Receiver psychology and the evolution of multicomponent signals , 1999, Animal Behaviour.

[18]  L. Silveira,et al.  Comparative neurophysiology of spatial luminance contrast sensitivity , 2011 .

[19]  Anastasia H Dalziell,et al.  Mimicry for all modalities. , 2016, Ecology letters.

[20]  L. Silveira,et al.  Twelve chromatically opponent ganglion cell types in turtle retina , 2008, Visual Neuroscience.

[21]  Jenny C. A. Read,et al.  Pattern and Speed Interact to Hide Moving Prey , 2019, Current Biology.

[22]  Hannah M. Rowland,et al.  The biology of color , 2017, Science.

[23]  Innes C Cuthill,et al.  Background complexity and the detectability of camouflaged targets by birds and humans , 2016, Proceedings of the Royal Society B: Biological Sciences.

[24]  H. Edelsbrunner,et al.  Efficient algorithms for agglomerative hierarchical clustering methods , 1984 .

[26]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[27]  Jia Jin Marc Chang,et al.  Colour pattern measurements successfully differentiate two cryptic Onchidiidae Rafinesque, 1815 species , 2019, Marine Biodiversity.

[28]  Martin J How,et al.  Parallel processing of polarization and intensity information in fiddler crab vision , 2019, Science Advances.

[29]  N. Marshall,et al.  To Be Seen or to Hide: Visual Characteristics of Body Patterns for Camouflage and Communication in the Australian Giant Cuttlefish Sepia apama , 2011, The American Naturalist.

[30]  J. Endler,et al.  The relative importance of local and global visual contrast in mate choice , 2019, Animal Behaviour.

[31]  J. Endler,et al.  How viewing objects with the dorsal or ventral retina affects colour-related behaviour in guppies (Poecilia reticulata) , 2019, Vision Research.

[32]  Ruth Rosenholtz,et al.  Feature congestion: A measure of visual clutter , 2010 .

[33]  A. Kelber Bird colour vision – from cones to perception , 2019, Current Opinion in Behavioral Sciences.

[34]  I. Cuthill,et al.  Camouflage , 1918, The Hospital.

[35]  J. Endler Variation in the appearance of guppy color patterns to guppies and their predators under different visual conditions , 1991, Vision Research.

[36]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[37]  Innes C Cuthill,et al.  Camouflage in a dynamic world , 2019, Current Opinion in Behavioral Sciences.

[38]  Peter A. Todd,et al.  pat‐geom: A software package for the analysis of animal patterns , 2019, Methods in Ecology and Evolution.

[39]  M. Stevens,et al.  Camouflage strategies interfere differently with observer search images , 2018, Proceedings of the Royal Society B: Biological Sciences.

[40]  P H T HARTLEY,et al.  Animal camouflage. , 1948, Endeavour.

[41]  Cedric P. van den Berg,et al.  Toxicity and taste: unequal chemical defences in a mimicry ring , 2018, Proceedings of the Royal Society B: Biological Sciences.

[42]  Sönke Johnsen,et al.  AcuityView: An r package for portraying the effects of visual acuity on scenes observed by an animal , 2017 .

[43]  L. Fleishman Motion detection in the presence and absence of background motion in anAnolis lizard , 1986, Journal of Comparative Physiology A.

[44]  Jair E. Garcia,et al.  Why colour is complex: Evidence that bees perceive neither brightness nor green contrast in colour signal processing , 2018, FACETS.

[45]  E. Poulton Adaptive Coloration in Animals , 1940, Nature.

[46]  R. Prum,et al.  Evolution of Avian Plumage Color in a Tetrahedral Color Space: A Phylogenetic Analysis of New World Buntings , 2008, The American Naturalist.

[47]  J. Marshall,et al.  Behavioral color vision in a cichlid fish: Metriaclima benetos , 2017, Journal of Experimental Biology.

[48]  N. Marshall,et al.  Colours and colour vision in reef fishes: Past, present and future research directions. , 2018, Journal of fish biology.

[49]  Kurt H. Riitters,et al.  Landscape 'Contagion' in Raster and Vector Environments , 1996, Int. J. Geogr. Inf. Sci..

[50]  M. Vorobyev,et al.  Detection of Fruit and the Selection of Primate Visual Pigments for Color Vision , 2004, The American Naturalist.

[51]  Thomas Serre,et al.  Hierarchical Models of the Visual System , 2014, Encyclopedia of Computational Neuroscience.

[52]  A. Kelber,et al.  Chromatic and achromatic vision: parameter choice and limitations for reliable model predictions , 2018 .

[53]  F. Kingdom,et al.  Texture-orientation mechanisms pool colour and luminance contrast , 2002, Vision Research.

[54]  Ilse M Daly,et al.  Complex gaze stabilization in mantis shrimp , 2018, Proceedings of the Royal Society B: Biological Sciences.

[55]  J. Endler,et al.  The current and future state of animal coloration research , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[56]  Sexual dimorphism and intra-populational colour pattern variation in the aposematic frog Dendrobates tinctorius , 2013, Evolutionary Ecology.

[57]  Julie M. Harris,et al.  Interactions between luminance and color signals: effects on shape. , 2013, Journal of vision.

[58]  N. Marshall,et al.  Coral reef fish perceive lightness illusions , 2016, Scientific Reports.

[59]  M. Cummings Modelling divergence in luminance and chromatic detection performance across measured divergence in surfperch (Embiotocidae) habitats , 2004, Vision Research.

[60]  Sönke Johnsen,et al.  Computational visual ecology in the pelagic realm , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[61]  K. Summers,et al.  Interspecific and intraspecific views of color signals in the strawberry poison frog Dendrobates pumilio , 2004, Journal of Experimental Biology.

[62]  K. L. Cheney,et al.  Conspicuousness is correlated with toxicity in marine opisthobranchs , 2010, Journal of evolutionary biology.

[63]  I. Cuthill,et al.  Using digital photography to study animal coloration , 2007 .

[64]  A generalized equation for the calculation of receptor noise limited colour distances in n-chromatic visual systems , 2017, Royal Society Open Science.

[65]  Matthew D. Shawkey,et al.  pavo: an R package for the analysis, visualization and organization of spectral data , 2013 .

[66]  James J. Foster,et al.  Polarisation vision: overcoming challenges of working with a property of light we barely see , 2018, The Science of Nature.

[67]  Carrie C Veilleux,et al.  Nocturnal light environments and species ecology: implications for nocturnal color vision in forests , 2012, Journal of Experimental Biology.

[68]  M. Vorobyev,et al.  Receptor noise as a determinant of colour thresholds , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[69]  Eleanor M. Caves,et al.  Categorical perception of colour signals in a songbird , 2018, Nature.

[70]  J. Endler,et al.  Success of the receptor noise model in predicting colour discrimination in guppies depends upon the colours tested , 2019, Vision Research.

[71]  D. Kemp,et al.  An Integrative Framework for the Appraisal of Coloration in Nature , 2015, The American Naturalist.

[72]  J. Endler,et al.  Comparing entire colour patterns as birds see them , 2005 .

[73]  Guy Wallis,et al.  Visual Acuity in a Species of Coral Reef Fish: Rhinecanthus aculeatus , 2014, Brain, Behavior and Evolution.

[74]  Martin Stevens,et al.  Image calibration and analysis toolbox – a free software suite for objectively measuring reflectance, colour and pattern , 2015, Methods in ecology and evolution.

[75]  Randolf Menzel,et al.  Colour thresholds and receptor noise: behaviour and physiology compared , 2001, Vision Research.

[76]  O. Lind Colour vision and background adaptation in a passerine bird, the zebra finch (Taeniopygia guttata) , 2016, Royal Society Open Science.

[77]  M. Land Motion and vision: why animals move their eyes , 1999, Journal of Comparative Physiology A.

[78]  J. Endler,et al.  GEOGRAPHIC VARIATION IN FEMALE PREFERENCES FOR MALE TRAITS IN POECILIA RETICULATA , 1995, Evolution; international journal of organic evolution.

[79]  P. Gregory,et al.  Can snakes hide in plain view? Chromatic and achromatic crypsis of two colour forms of the Western Terrestrial Garter Snake (Thamnophis elegans) , 2013 .

[80]  A. Kelber,et al.  Bird colour vision: behavioural thresholds reveal receptor noise , 2015, Journal of Experimental Biology.

[81]  D. Papaj,et al.  Complex signal function: developing a framework of testable hypotheses , 2004, Behavioral Ecology and Sociobiology.

[82]  M. Vorobyev,et al.  A review of the evolution of animal colour vision and visual communication signals , 2008, Vision Research.

[83]  Brandon J. Russell,et al.  Use of Hyperspectral Imagery to Assess Cryptic Color Matching in Sargassum Associated Crabs , 2015, PloS one.

[84]  Alexandra Willis,et al.  Colour and luminance interactions in the visual perception of motion , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[85]  Steven K. Shevell,et al.  Understanding how neural responses contribute to the diversity of avian colour vision , 2019, Animal Behaviour.

[86]  M. Wiener,et al.  Animal eyes. , 1957, The American orthoptic journal.

[87]  R. Peters,et al.  Motion-based signaling in sympatric species of Australian agamid lizards , 2017, Journal of Comparative Physiology A.

[88]  Cedric P. van den Berg,et al.  Pattern edges improve predator learning of aposematic signals , 2018, Behavioral Ecology.

[89]  N. Marshall,et al.  Conspicuous visual signals do not coevolve with increased body size in marine sea slugs , 2014, Journal of evolutionary biology.

[90]  William L. Allen,et al.  Assessing the potential information content of multicomponent visual signals: a machine learning approach , 2015, Proceedings of the Royal Society B: Biological Sciences.

[91]  Jason W. Osborne,et al.  Best Practices in Exploratory Factor Analysis , 2014 .

[92]  Shaun P. Collin,et al.  Communication in Fishes , 2006 .

[93]  J. Troscianko,et al.  Rufous Common Cuckoo chicks are not always female , 2018, Journal of Ornithology.

[94]  J. Endler A Predator’s View of Animal Color Patterns , 1978 .

[95]  Perceptual distance between colored stimuli in the lizard Anolis sagrei: comparing visual system models to empirical results , 2016, Behavioral Ecology and Sociobiology.

[96]  Felipe M Gawryszewski,et al.  Color vision models: Some simulations, a general n‐dimensional model, and the colourvision R package , 2018, Ecology and evolution.

[97]  Anna E. Hughes,et al.  Dissociation between perception and smooth pursuit eye movements in speed judgments of moving Gabor targets. , 2018, Journal of vision.

[98]  J. Endler Progressive background in moths, and a quantitative measure of crypsis , 1984 .

[99]  T. White,et al.  Comparing colors using visual models , 2018 .

[100]  J. Lythgoe The Ecology of vision , 1979 .

[101]  Jeffrey A. Sloan,et al.  Spatial frequency analysis of the visual environment: Anisotropy and the carpentered environment hypothesis , 1978, Vision Research.

[102]  M. Stevens,et al.  Pattern mimicry of host eggs by the common cuckoo, as seen through a bird's eye , 2010, Proceedings of the Royal Society B: Biological Sciences.

[103]  Chris D. Jiggins,et al.  Patternize: An R package for quantifying color pattern variation , 2017, bioRxiv.

[104]  M. Vorobyev,et al.  Photoreceptor sectral sensitivities in terrestrial animals: adaptations for luminance and colour vision , 2005, Proceedings of the Royal Society B: Biological Sciences.

[105]  C. Rowe Receiver psychology: a receiver's perspective , 2013, Animal Behaviour.

[106]  Thomas W. Pike,et al.  Quantifying camouflage and conspicuousness using visual salience , 2018 .

[107]  R. Shapley,et al.  Color in the Cortex: single- and double-opponent cells , 2011, Vision Research.

[108]  Jenny C. A. Read,et al.  A Novel Form of Stereo Vision in the Praying Mantis , 2018, Current Biology.

[109]  N. Vereecken Pollinator-mediated selection, reproductive isolation and floral evolution in Ophrys orchids , 2008 .

[110]  Michael J. Bok,et al.  Photoreception and vision in the ultraviolet , 2016, Journal of Experimental Biology.

[111]  John A. Endler,et al.  A framework for analysing colour pattern geometry: adjacent colours , 2012 .

[112]  S. Shevell,et al.  Color in complex scenes. , 2008, Annual review of psychology.

[113]  N. Marshall,et al.  Communication and camouflage with the same 'bright' colours in reef fishes. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[114]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[115]  Martin J. How,et al.  A Different Form of Color Vision in Mantis Shrimp , 2014, Science.

[116]  Eleanor M. Caves,et al.  Spectral sensitivity, spatial resolution and temporal resolution and their implications for conspecific signalling in cleaner shrimp , 2016, Journal of Experimental Biology.

[117]  N. Marshall,et al.  Colour thresholds in a coral reef fish , 2016, Royal Society Open Science.

[118]  M. Vorobyev,et al.  Animal colour vision — behavioural tests and physiological concepts , 2003, Biological reviews of the Cambridge Philosophical Society.

[119]  Hugo Gruson,et al.  pavo 2.0: new tools for the spectral and spatial analysis of colour in R , 2018, bioRxiv.

[120]  D. Kemp,et al.  Colour and luminance contrasts predict the human detection of natural stimuli in complex visual environments , 2017, Biology Letters.

[121]  J. Marshall,et al.  Fluorescence as a means of colour signal enhancement , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[122]  M. Herberstein,et al.  Colour mimicry and sexual deception by Tongue orchids (Cryptostylis) , 2009, Naturwissenschaften.

[123]  D. Ventura,et al.  Influence of Spatial and Chromatic Noise on Luminance Discrimination , 2017, Scientific Reports.

[124]  William L. Allen,et al.  Analyzing Visual Signals as Visual Scenes , 2013, American journal of primatology.

[125]  M. Vorobyev,et al.  Discrimination of coloured patterns by honeybees through chromatic and achromatic cues , 2002, Journal of Comparative Physiology A.

[126]  Eric J. Warrant,et al.  Scotopic colour vision in nocturnal hawkmoths , 2002, Nature.

[127]  I. Cuthill,et al.  Visual pigments, oil droplets, ocular media and cone photoreceptor distribution in two species of passerine bird: the blue tit (Parus caeruleus L.) and the blackbird (Turdus merula L.) , 2000, Journal of Comparative Physiology A.

[128]  M. Stevens,et al.  Quantifying camouflage: how to predict detectability from appearance , 2017, BMC Evolutionary Biology.

[129]  C. Town,et al.  Pattern recognition algorithm reveals how birds evolve individual egg pattern signatures , 2014, Nature Communications.

[130]  Janelle L. Morano,et al.  Evolution of correlated complexity in the radically different courtship signals of birds-of-paradise , 2018, bioRxiv.

[131]  Naomi F. Green,et al.  Stabilizing selection on individual pattern elements of aposematic signals , 2017, Proceedings of the Royal Society B: Biological Sciences.

[132]  Hugo Gruson,et al.  pavo 2.0: new tools for the spectral and spatial analysis of colour in R , 2018, bioRxiv.

[133]  Tim Guilford,et al.  The Evolution of Multimodal Warning Displays , 1999, Evolutionary Ecology.

[134]  Lars Chittka,et al.  Cognitive dimensions of predator responses to imperfect mimicry. , 2007, PLoS biology.