The Generative Adversarial Brain

The idea that the brain learns generative models of the world has been widely promulgated. Most approaches have assumed that the brain learns an explicit density model that assigns a probability to each possible state of the world. However, explicit density models are difficult to learn, requiring approximate inference techniques that may find poor solutions. An alternative approach is to learn an implicit density model that can sample from the generative model without evaluating the probabilities of those samples. The implicit model can be trained to fool a discriminator into believing that the samples are real. This is the idea behind generative adversarial algorithms, which have proven adept at learning realistic generative models. This paper develops an adversarial framework for probabilistic computation in the brain. It first considers how generative adversarial algorithms overcome some of the problems that vex prior theories based on explicit density models. It then discusses the psychological and neural evidence for this framework, as well as how the breakdown of the generator and discriminator could lead to delusions observed in some mental disorders.

[1]  Christopher Ré,et al.  Learning to Compose Domain-Specific Transformations for Data Augmentation , 2017, NIPS.

[2]  Ruyuan Zhang,et al.  High internal noise and poor external noise filtering characterize perception in autism spectrum disorder , 2017, Scientific Reports.

[3]  S. J. Segal,et al.  Influence of imaged pictures and sounds on detection of visual and auditory signals. , 1970, Journal of experimental psychology.

[4]  Trevor Darrell,et al.  Adversarial Feature Learning , 2016, ICLR.

[5]  Daniel L. Schacter,et al.  Neural processes underlying memory attribution on a reality-monitoring task. , 2006, Cerebral cortex.

[6]  S. Gershman,et al.  Where do hypotheses come from? , 2017, Cognitive Psychology.

[7]  R P Bentall,et al.  Reality monitoring and psychotic hallucinations. , 1991, The British journal of clinical psychology.

[8]  H. Critchley,et al.  An Interoceptive Predictive Coding Model of Conscious Presence , 2011, Front. Psychology.

[9]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[10]  C. Frith,et al.  From drugs to deprivation: a Bayesian framework for understanding models of psychosis , 2009, Psychopharmacology.

[11]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[12]  R. Bilder,et al.  Meta-analysis of symptom factors in schizophrenia , 1998, Schizophrenia Research.

[13]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[14]  Lars Muckli,et al.  The Predictive Coding Account of Psychosis , 2018, Biological Psychiatry.

[15]  Rajesh P. N. Rao,et al.  Predictive Coding , 2019, A Blueprint for the Hard Problem of Consciousness.

[16]  Gustavo Deco,et al.  Predictive Coding in the Visual Cortex by a Recurrent Network with Gabor Receptive Fields , 2001, Neural Processing Letters.

[17]  Michael U. Gutmann,et al.  Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models , 2015, J. Mach. Learn. Res..

[18]  M. Coltheart,et al.  Abductive inference and delusional belief , 2010, Cognitive neuropsychiatry.

[19]  Samuel Gershman,et al.  Imaginative Reinforcement Learning: Computational Principles and Neural Mechanisms , 2017, Journal of Cognitive Neuroscience.

[20]  M. Coltheart,et al.  Confabulation and delusion: A common monitoring framework , 2010, Cognitive neuropsychiatry.

[21]  Carey K. Morewedge,et al.  Mental Simulation as Substitute for Experience , 2016 .

[22]  D. Hemsley,et al.  A psychophysical investigation of auditory functioning in schizophrenia. , 1981, The British journal of clinical psychology.

[23]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Michael H. Herzog,et al.  Human Perceptual Learning by Mental Imagery , 2009, Current Biology.

[25]  R. Gregory Perceptions as hypotheses. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  Carolyn Copper,et al.  Does mental practice enhance performance , 1994 .

[27]  Xaq Pitkow,et al.  Inference by Reparameterization in Neural Population Codes , 2016, NIPS.

[28]  Zara M. Bergström,et al.  A Specific Brain Structural Basis for Individual Differences in Reality Monitoring , 2011, The Journal of Neuroscience.

[29]  Hanna Damasio,et al.  Double Dissociation between Overt and Covert Face Recognition , 1995, Journal of Cognitive Neuroscience.

[30]  O. François,et al.  Approximate Bayesian Computation (ABC) in practice. , 2010, Trends in ecology & evolution.

[31]  Alexandre Pouget,et al.  Complex Inference in Neural Circuits with Probabilistic Population Codes and Topic Models , 2012, NIPS.

[32]  Richard S. Sutton,et al.  Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming , 1990, ML.

[33]  D. Sagi,et al.  Common mechanisms of visual imagery and perception. , 1995, Science.

[34]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[35]  F. Volkmar,et al.  A Predictive Coding Account of Psychotic Symptoms in Autism Spectrum Disorder , 2017, Journal of autism and developmental disorders.

[36]  D. Weinberger,et al.  Genes, dopamine and cortical signal-to-noise ratio in schizophrenia , 2004, Trends in Neurosciences.

[37]  P. Diggle,et al.  Monte Carlo Methods of Inference for Implicit Statistical Models , 1984 .

[38]  P. Weerd Perceptual filling-in: More than the eye can see. , 2006 .

[39]  M. Farah,et al.  Psychophysical evidence for a shared representational medium for mental images and percepts. , 1985, Journal of experimental psychology. General.

[40]  Simon Haykin,et al.  Incorporating Prior Information in Machine Learning by Creating Virtual Examples , 2001 .

[41]  Paul C. Fletcher,et al.  Separable Forms of Reality Monitoring Supported by Anterior Prefrontal Cortex , 2008, Journal of Cognitive Neuroscience.

[42]  Sebastian Nowozin,et al.  f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization , 2016, NIPS.

[43]  R. Bentall,et al.  Reality testing and auditory hallucinations: a signal detection analysis. , 1985, The British journal of clinical psychology.

[44]  Ferenc Huszár,et al.  Variational Inference using Implicit Distributions , 2017, ArXiv.

[45]  Vilayanur S. Ramachandran,et al.  Three laws of qualia: what neurology tells us about the biological functions of consciousness , 1997 .

[46]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[47]  József Fiser,et al.  Perceptual Decision-Making as Probabilistic Inference by Neural Sampling , 2014, Neuron.

[48]  Cheves West Perky An Experimental study of imagination. , 1910 .

[49]  Tomaso Poggio,et al.  Incorporating prior information in machine learning by creating virtual examples , 1998, Proc. IEEE.

[50]  Ricardo Silva,et al.  Constraining bridges between levels of analysis: A computational justification for locally Bayesian learning , 2013 .

[51]  Daniel C. Dennett,et al.  Filling in versus finding out: A ubiquitous confusion in cognitive science , 1992 .

[52]  Stanislas Dehaene,et al.  Toward a computational theory of conscious processing , 2014, Current Opinion in Neurobiology.

[53]  Jon Driver,et al.  Phantoms in the Brain , 1999, Nature Medicine.

[54]  Sing-Hang Cheung,et al.  Inflation versus filling-in: why we feel we see more than we actually do in peripheral vision , 2018, bioRxiv.

[55]  Peter De Weerd,et al.  Perceptual filling-in: More than the eye can see. , 2006, Progress in brain research.

[56]  Andreas Huth,et al.  Statistical inference for stochastic simulation models--theory and application. , 2011, Ecology letters.

[57]  Sebastian Nowozin,et al.  Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks , 2017, ICML.

[58]  Aaron C. Courville,et al.  Adversarially Learned Inference , 2016, ICLR.

[59]  Jane R. Garrison,et al.  Reality monitoring impairment in schizophrenia reflects specific prefrontal cortex dysfunction , 2017, NeuroImage: Clinical.

[60]  David J. Heeger,et al.  Unreliable Evoked Responses in Autism , 2012, Neuron.

[61]  M J Farah,et al.  Perceptual interference and facilitation with auditory imagery , 1983, Perception & psychophysics.

[62]  Samuel J. Gershman,et al.  Complex Probabilistic Inference , 2017 .

[63]  Rj Dolan,et al.  Phantoms in the brain: Probing the mysteries of the human mind , 1998 .

[64]  Marcia K. Johnson,et al.  Reality Monitoring , 2005 .

[65]  Marcia K. Johnson,et al.  Brain Mechanisms of Reality Monitoring , 2017, Trends in Cognitive Sciences.

[66]  Amos J. Storkey,et al.  Data Augmentation Generative Adversarial Networks , 2017, ICLR 2018.

[67]  Adam N. Sanborn,et al.  Bayesian Brains without Probabilities , 2016, Trends in Cognitive Sciences.

[68]  Samuel J. Gershman,et al.  A theory of learning to infer , 2019, bioRxiv.

[69]  John W. Fisher,et al.  Dreaming More Data: Class-dependent Distributions over Diffeomorphisms for Learned Data Augmentation , 2015, AISTATS.

[70]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[71]  Daniel J. Simons,et al.  Current Approaches to Change Blindness , 2000 .

[72]  H. Lau,et al.  Empirical support for higher-order theories of conscious awareness , 2011, Trends in Cognitive Sciences.

[73]  P. Garety,et al.  The Formation of Maintenance of Delusions: a Bayesian Analysis , 1986, British Journal of Psychiatry.

[74]  L. Pessoa,et al.  Beyond the Grand Illusion: What Change Blindness Really Teaches Us About Vision , 2000 .

[75]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[76]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[77]  N. Valenza,et al.  Hyperfamiliarity for unknown faces after left lateral temporo-occipital venous infarction: a double dissociation with prosopagnosia. , 2003, Brain : a journal of neurology.

[78]  S. Denéve,et al.  Neural processing as causal inference , 2011, Current Opinion in Neurobiology.

[79]  József Fiser,et al.  Neural Variability and Sampling-Based Probabilistic Representations in the Visual Cortex , 2016, Neuron.