Charles Bonnet Syndrome: Evidence for a Generative Model in the Cortex?

Several theories propose that the cortex implements an internal model to explain, predict, and learn about sensory data, but the nature of this model is unclear. One condition that could be highly informative here is Charles Bonnet syndrome (CBS), where loss of vision leads to complex, vivid visual hallucinations of objects, people, and whole scenes. CBS could be taken as indication that there is a generative model in the brain, specifically one that can synthesise rich, consistent visual representations even in the absence of actual visual input. The processes that lead to CBS are poorly understood. Here, we argue that a model recently introduced in machine learning, the deep Boltzmann machine (DBM), could capture the relevant aspects of (hypothetical) generative processing in the cortex. The DBM carries both the semantics of a probabilistic generative model and of a neural network. The latter allows us to model a concrete neural mechanism that could underlie CBS, namely, homeostatic regulation of neuronal activity. We show that homeostatic plasticity could serve to make the learnt internal model robust against e.g. degradation of sensory input, but overcompensate in the case of CBS, leading to hallucinations. We demonstrate how a wide range of features of CBS can be explained in the model and suggest a potential role for the neuromodulator acetylcholine. This work constitutes the first concrete computational model of CBS and the first application of the DBM as a model in computational neuroscience. Our results lend further credence to the hypothesis of a generative model in the brain.

[1]  E. Rolls,et al.  Computational models of schizophrenia and dopamine modulation in the prefrontal cortex , 2008, Nature Reviews Neuroscience.

[2]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[3]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Konrad Kording,et al.  Bayesian models: the structure of the world, uncertainty, behavior, and the brain , 2011, Annals of the New York Academy of Sciences.

[5]  B. Love,et al.  The myth of computational level theory and the vacuity of rational analysis , 2011, Behavioral and Brain Sciences.

[6]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[7]  Renaud Jardri,et al.  Computational Models of Hallucinations , 2013 .

[8]  S. Grossberg How hallucinations may arise from brain mechanisms of learning, attention, and volition , 2000, Journal of the International Neuropsychological Society.

[9]  R. H. Perry,et al.  Acetylcholine and Hallucinations - Disease-Related Compared to Drug-Induced Alterations in Human Consciousness , 1995, Brain and Cognition.

[10]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[11]  David Mumford,et al.  On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[12]  Peter Dayan,et al.  A Hierarchical Model of Binocular Rivalry , 1998, Neural Computation.

[13]  Y. Goda,et al.  Unraveling Mechanisms of Homeostatic Synaptic Plasticity , 2010, Neuron.

[14]  A. Yuille,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Vision as Bayesian inference: analysis by synthesis? , 2022 .

[15]  Marcello G P Rosa,et al.  Hierarchical development of the primate visual cortex, as revealed by neurofilament immunoreactivity: early maturation of the middle temporal area (MT). , 2006, Cerebral cortex.

[16]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[17]  Christopher K. I. Williams,et al.  Transformation Equivariant Boltzmann Machines , 2011, ICANN.

[18]  E. Marder,et al.  Variability, compensation and homeostasis in neuron and network function , 2006, Nature Reviews Neuroscience.

[19]  D. Ffytche,et al.  The perceptual consequences of visual loss: 'positive' pathologies of vision. , 1999, Brain : a journal of neurology.

[20]  L. Aakerlund,et al.  Neural networks as models of psychopathology , 1998, Biological Psychiatry.

[21]  Jason Morrison,et al.  Now you see it, now you don't: More data at the cognitive level needed before the PAD model can be accepted , 2005, Behavioral and Brain Sciences.

[22]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[23]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[24]  Andrew Y. Ng,et al.  Unsupervised learning models of primary cortical receptive fields and receptive field plasticity , 2011, NIPS.

[25]  Klaus Podoll,et al.  Complex visual hallucinations , 2007 .

[26]  Yoshua Bengio,et al.  A Generative Process for sampling Contractive Auto-Encoders , 2012, ICML 2012.

[27]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[28]  Francis Crick,et al.  The function of dream sleep , 1983, Nature.

[29]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[30]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Geoffrey E. Hinton,et al.  Learning a Nonlinear Embedding by Preserving Class Neighbourhood Structure , 2007, AISTATS.

[32]  Charles Kemp,et al.  Bayesian models of cognition , 2008 .

[33]  David P. Reichert Deep Boltzmann Machines as Hierarchical Generative Models of Perceptual Inference in the Cortex , 2012 .

[34]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[35]  Peggy Seriès,et al.  A Hierarchical Generative Model of Recurrent Object-Based Attention in the Visual Cortex , 2011, ICANN.

[36]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[37]  D. Norris,et al.  How the Bayesians got their beliefs (and what those beliefs actually are): comment on Bowers and Davis (2012). , 2012, Psychological bulletin.

[38]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[39]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[40]  Geoffrey E. Hinton,et al.  Transforming Auto-Encoders , 2011, ICANN.

[41]  Bradley C. Love,et al.  Pinning down the theoretical commitments of Bayesian cognitive models , 2011, Behavioral and Brain Sciences.

[42]  Geoffrey E. Hinton,et al.  Factored 3-Way Restricted Boltzmann Machines For Modeling Natural Images , 2010, AISTATS.

[43]  G. Turrigiano The Self-Tuning Neuron: Synaptic Scaling of Excitatory Synapses , 2008, Cell.

[44]  Peter Dayan,et al.  Acetylcholine in cortical inference , 2002, Neural Networks.

[45]  Yoshua Bengio,et al.  Justifying and Generalizing Contrastive Divergence , 2009, Neural Computation.

[46]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[47]  G. Tononi Consciousness as Integrated Information: a Provisional Manifesto , 2008, The Biological Bulletin.

[48]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Christopher K. I. Williams,et al.  The Shape Boltzmann Machine: A Strong Model of Object Shape , 2012, International Journal of Computer Vision.

[50]  Robert W. McCarley,et al.  Visual hallucinations, attention, and neural circuitry: Perspectives from schizophrenia research , 2005, Behavioral and Brain Sciences.

[51]  Ronald Melzack,et al.  The Charles Bonnet Syndrome: ‘Phantom Visual Images’ , 1991, Perception.

[52]  Michael E. Hasselmo,et al.  Unraveling the attentional functions of cortical cholinergic inputs: interactions between signal-driven and cognitive modulation of signal detection , 2005, Brain Research Reviews.

[53]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[54]  L. Younes Parametric Inference for imperfectly observed Gibbsian fields , 1989 .

[55]  Aapo Hyvärinen,et al.  Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior , 2002, NIPS.

[56]  Peggy Seriès,et al.  Neuronal Adaptation for Sampling-Based Probabilistic Inference in Perceptual Bistability , 2011, NIPS.

[57]  Yoshua Bengio,et al.  Unsupervised Models of Images by Spikeand-Slab RBMs , 2011, ICML.

[58]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[59]  D. Ffytche,et al.  Visual hallucinatory syndromes and the anatomy of the visual brain. , 2000, Brain : a journal of neurology.

[60]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[61]  V. Lamme Towards a true neural stance on consciousness , 2006, Trends in Cognitive Sciences.

[62]  J. Bowers,et al.  Bayesian just-so stories in psychology and neuroscience. , 2012, Psychological bulletin.

[63]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[64]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[65]  G. Menon,et al.  Complex visual hallucinations in the visually impaired: the Charles Bonnet Syndrome. , 2003, Survey of ophthalmology.

[66]  Karl J. Friston Hallucinations and perceptual inference , 2005, Behavioral and Brain Sciences.

[67]  P. Vroomen,et al.  Of Roman chariots and goats in overcoats: The syndrome of Charles Bonnet , 2007, Journal of Clinical Neuroscience.

[68]  E. Perry,et al.  Why people see things that are not there: A novel Perception and Attention Deficit model for recurrent complex visual hallucinations , 2005, Behavioral and Brain Sciences.

[69]  Niraj S. Desai,et al.  Homeostatic plasticity in the CNS: synaptic and intrinsic forms , 2003, Journal of Physiology-Paris.

[70]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[71]  Matthew W Self,et al.  Different glutamate receptors convey feedforward and recurrent processing in macaque V1 , 2012, Proceedings of the National Academy of Sciences.

[72]  Yuhong Yang,et al.  Information Theory, Inference, and Learning Algorithms , 2005 .

[73]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[74]  L H Finkel,et al.  Neuroengineering models of brain disease. , 2000, Annual review of biomedical engineering.

[75]  Pascal Vincent,et al.  A Generative Process for Contractive Auto-Encoders , 2012, ICML.

[76]  W. Burke,et al.  The neural basis of Charles Bonnet hallucinations: a hypothesis , 2002, Journal of neurology, neurosurgery, and psychiatry.

[77]  Dominic H. ffytche,et al.  Visual hallucinatory syndromes: past, present, and future , 2007, Dialogues in clinical neuroscience.

[78]  J A Reggia,et al.  Pathogenesis of schizophrenic delusions and hallucinations: a neural model. , 1996, Schizophrenia bulletin.

[79]  Geoffrey E. Hinton,et al.  On deep generative models with applications to recognition , 2011, CVPR 2011.

[80]  O. Mason,et al.  The Psychotomimetic Effects of Short-Term Sensory Deprivation , 2009, The Journal of nervous and mental disease.

[81]  Geoffrey E. Hinton,et al.  3D Object Recognition with Deep Belief Nets , 2009, NIPS.

[82]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[83]  C. Frith,et al.  From drugs to deprivation: a Bayesian framework for understanding models of psychosis , 2009, Psychopharmacology.

[84]  S. Nelson,et al.  Hebb and homeostasis in neuronal plasticity , 2000, Current Opinion in Neurobiology.

[85]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[86]  F. Andermann,et al.  Complex visual hallucinations. Clinical and neurobiological insights. , 1998, Brain : a journal of neurology.

[87]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[88]  Geoffrey E. Hinton,et al.  Modeling image patches with a directed hierarchy of Markov random fields , 2007, NIPS.

[89]  Lotfi B Merabet,et al.  Suppression of Complex Visual Hallucinatory Experiences by Occipital Transcranial Magnetic Stimulation: A Case Report , 2003, Neurocase.

[90]  Thomas L. Griffiths,et al.  Modeling the effects of memory on human online sentence processing with particle filters , 2008, NIPS.

[91]  D. Ffytche,et al.  The anatomy of conscious vision: an fMRI study of visual hallucinations , 1998, Nature Neuroscience.

[92]  David Mumford,et al.  Neuronal Architectures for Pattern-theoretic Problems , 1995 .

[93]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[94]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[95]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[96]  Jeffrey S. Bowers,et al.  Is that what Bayesians believe? reply to Griffiths, Chater, Norris, and Pouget (2012). , 2012, Psychological bulletin.

[97]  R. Teunisse,et al.  Visual hallucinations in psychologically normal people: Charles Bonnet's syndrome , 1996, The Lancet.

[98]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[99]  Aaron C. Courville,et al.  The pigeon as particle filter , 2007, NIPS 2007.

[100]  R. Hoffman,et al.  Cortical pruning and the development of schizophrenia: a computer model. , 1989, Schizophrenia bulletin.

[101]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[102]  Peggy Seriès,et al.  Hallucinations in Charles Bonnet Syndrome Induced by Homeostasis: a Deep Boltzmann Machine Model , 2010, NIPS.

[103]  Tijmen Tieleman,et al.  Training restricted Boltzmann machines using approximations to the likelihood gradient , 2008, ICML '08.

[104]  Dominic H. ffytche,et al.  Two visual hallucinatory syndromes , 2005, Behavioral and Brain Sciences.

[105]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[106]  Adam N Sanborn,et al.  Rational approximations to rational models: alternative algorithms for category learning. , 2010, Psychological review.

[107]  K. Mueser,et al.  Hallucinations in schizophrenia , 1990, Acta psychiatrica Scandinavica.