The Camouflage Machine: Optimising protective colouration using deep learning with genetic algorithms

The essential problem in visual detection is separating an object from its background. Whether in nature or human conflict, camouflage aims to make the problem harder, while conspicuous signals (e.g. for warning or mate attraction) require the opposite. Our goal is to provide a reliable method for identifying the hardest and easiest to find patterns, for any given environment. The problem is challenging because the parameter space provided by varying natural scenes and potential patterns is vast. Here we successfully solve the problem using deep learning with genetic algorithms and illustrate our solution by identifying appropriate patterns in two environments. To show the generality of our approach, we do so for both trichromatic and dichromatic visual systems. Patterns were validated using human participants; those identified as the best camouflage were significantly harder to find than a widely adopted military camouflage pattern, while those identified as most conspicuous were significantly easier than other patterns. Our method, dubbed the ‘Camouflage Machine’, will be a useful tool for those interested in identifying the most effective patterns in a given context.

[1]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[2]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[3]  J. Butts,et al.  Firearm-Related Hunting Fatalities in North Carolina: Impact of the 'Hunter Orange' Law , 1996, Southern medical journal.

[4]  Juan Carlos Fernández,et al.  Multiobjective evolutionary algorithms to identify highly autocorrelated areas: the case of spatial distribution in financially compromised farms , 2014, Ann. Oper. Res..

[5]  Martin Stevens,et al.  Anti-Predator Coloration and Behaviour: A Longstanding Topic with Many Outstanding Questions , 2015 .

[6]  Slobodan Markovic,et al.  Subjective experience of architectural objects: A cross-cultural study , 2016 .

[7]  M. Ionescu,et al.  Subliminal perception of complex visual stimuli. , 2016, Romanian journal of ophthalmology.

[8]  T. Caro Concealing Coloration in Animals. By Judy Diamond and Alan B. Bond. Cambridge (Massachusetts): Harvard University Press. $29.95. x + 271 p.; ill.; index. ISBN: 978-0-674-05235-2. 2013. , 2014 .

[9]  Innes C. Cuthill,et al.  Distance-dependent defensive coloration in the poison frog Dendrobates tinctorius, Dendrobatidae , 2018, Proceedings of the National Academy of Sciences.

[10]  Françoise Viénot,et al.  Digital video colourmaps for checking the legibility of displays by dichromats , 1999 .

[11]  J. Henderson Regarding Scenes , 2007 .

[12]  H. Leder,et al.  Visualizing the Impact of Art: An Update and Comparison of Current Psychological Models of Art Experience , 2016, Front. Hum. Neurosci..

[13]  Roland J. Baddeley,et al.  The evolution and function of pattern diversity in snakes , 2013 .

[14]  James D. Murray,et al.  Spatial models and biomedical applications , 2003 .

[15]  Nicholas E. Scott-Samuel,et al.  Optimising colour for camouflage and visibility: the effects of the environment and the observer’s visual system , 2018, bioRxiv.

[16]  R. Jewkes,et al.  Perceptions and Experiences of Research Participants on Gender-Based Violence Community Based Survey: Implications for Ethical Guidelines , 2012, PloS one.

[17]  Thomas N. Sherratt,et al.  The evolution of crypsis in replicating populations of web‐based prey , 2007 .

[18]  Daniel Osorio,et al.  Camouflage and perceptual organization in the animal kingdom , 2015 .

[19]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[20]  J. G. Fennell,et al.  Optimizing colour for camouflage and visibility using deep learning: the effects of the environment and the observer's visual system , 2019, Journal of the Royal Society Interface.

[21]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[22]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[23]  Theodore Stankowich,et al.  Ecocorrelates of pelage coloration in pigs and peccaries , 2018, Journal of Mammalogy.

[24]  A. Bond,et al.  Visual predators select for crypticity and polymorphism in virtual prey , 2002, Nature.

[25]  William L. Allen,et al.  A Quantitative Test of the Predicted Relationship between Countershading and Lighting Environment , 2012, The American Naturalist.

[26]  Julie M. Harris,et al.  Orientation to the sun by animals and its interaction with crypsis , 2015, Functional ecology.

[27]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[28]  T. Caro The Adaptive Significance of Coloration in Mammals , 2005 .

[29]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[30]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[31]  A. Kelber,et al.  Colour spaces in ecology and evolutionary biology , 2017, Biological reviews of the Cambridge Philosophical Society.

[32]  Alan C Kamil,et al.  Spatial heterogeneity, predator cognition, and the evolution of color polymorphism in virtual prey. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Roland J. Baddeley,et al.  Cultural evolution of military camouflage , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  J. Wagemans The Oxford handbook of perceptual organization , 2015 .

[35]  A. Bond,et al.  Concealing Coloration in Animals , 2013 .

[36]  I. Cuthill,et al.  Camouflage , 1918, The Hospital.

[37]  Hannah M. Rowland,et al.  The biology of color , 2017, Science.

[38]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[39]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[40]  Innes C. Cuthill,et al.  Distance-dependent pattern blending can camouflage salient aposematic signals , 2017, Proceedings of the Royal Society B: Biological Sciences.

[41]  Lothar Thiele,et al.  A Comparison of Selection Schemes Used in Evolutionary Algorithms , 1996, Evolutionary Computation.

[42]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[43]  Innes C. Cuthill,et al.  Why the leopard got its spots: relating pattern development to ecology in felids , 2011, Proceedings of the Royal Society B: Biological Sciences.

[44]  Neil Kessel,et al.  Cross-cultural Study , 1964 .

[45]  Daniel Osorio,et al.  Animal Coloration Patterns: Linking Spatial Vision to Quantitative Analysis , 2019, The American Naturalist.

[46]  R. Blum,et al.  A cross-cultural study , 1969 .

[47]  Sami Merilaita,et al.  The effect of signal appearance and distance on detection risk in an aposematic butterfly larva (Parnassius apollo) , 2008, Animal Behaviour.

[48]  M. Carrasco,et al.  The temporal dynamics of visual search: evidence for parallel processing in feature and conjunction searches. , 1999, Journal of experimental psychology. Human perception and performance.

[49]  G. H. Jacobs THE DISTRIBUTION AND NATURE OF COLOUR VISION AMONG THE MAMMALS , 1993, Biological reviews of the Cambridge Philosophical Society.

[50]  T. Caro The colours of extant mammals. , 2013, Seminars in cell & developmental biology.

[51]  Elizabeth S. Paul,et al.  Social Anxiety Modulates Subliminal Affective Priming , 2012, PloS one.

[52]  Maria Vanrell,et al.  Color encoding in biologically-inspired convolutional neural networks , 2018, Vision Research.

[53]  J. E. Pearson Complex Patterns in a Simple System , 1993, Science.

[54]  Kevin Skadron,et al.  Scalable parallel programming , 2008, 2008 IEEE Hot Chips 20 Symposium (HCS).

[55]  M. Stevens Concealing Coloration in Animals Concealing Coloration in Animals. By Judy Diamond & Alan B. Bond. Cambridge, Massachusetts: Belknap Press of Harvard University Press (2013). Pp. x + 271. Price $29.95. , 2013, Animal Behaviour.

[56]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[57]  Innes C. Cuthill,et al.  Distance-dependent defensive coloration , 2014, Current Biology.