Habituation as a neural algorithm for online odor discrimination

Significance Identifying relevant information embedded within a constant and noisy background is a challenge faced by many sensory systems in the brain. Habituation—the reduction in responsiveness to repeated, neutral stimuli—is an unsupervised learning method the brain uses to overcome this challenge. Here, we propose a neural algorithm for odor habituation based on the olfactory circuit in fruit flies. We demonstrate how habituation enhances discrimination between similar odors and improves foreground detection by subtracting background noise. More broadly, this perspective helps bridge the gap between sensory neurobiology and cognition. Habituation is a form of simple memory that suppresses neural activity in response to repeated, neutral stimuli. This process is critical in helping organisms guide attention toward the most salient and novel features in the environment. Here, we follow known circuit mechanisms in the fruit fly olfactory system to derive a simple algorithm for habituation. We show, both empirically and analytically, that this algorithm is able to filter out redundant information, enhance discrimination between odors that share a similar background, and improve detection of novel components in odor mixtures. Overall, we propose an algorithmic perspective on the biological mechanism of habituation and use this perspective to understand how sensory physiology can affect odor perception. Our framework may also help toward understanding the effects of habituation in other more sophisticated neural systems.

[1]  Nirag Kadakia,et al.  Front-end Weber-Fechner gain control enhances the fidelity of combinatorial odor coding , 2018, bioRxiv.

[2]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[3]  G. Rubin,et al.  The neuronal architecture of the mushroom body provides a logic for associative learning , 2014, eLife.

[4]  M. Stopfer,et al.  Encoding a temporally structured stimulus with a temporally structured neural representation , 2005, Nature Neuroscience.

[5]  Nathaniel B Sawtell,et al.  Generalization of learned responses in the mormyrid electrosensory lobe , 2019, eLife.

[6]  Xuelong Li,et al.  Compressed Hashing , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Stephen Marsland,et al.  Using habituation in machine learning , 2009, Neurobiology of Learning and Memory.

[8]  Giacomo Vivanti,et al.  Attention to novelty versus repetition: Contrasting habituation profiles in Autism and Williams syndrome , 2017, Developmental Cognitive Neuroscience.

[9]  Nicolas Y. Masse,et al.  Olfactory Information Processing in Drosophila , 2009, Current Biology.

[10]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[11]  Dmitri B. Chklovskii,et al.  Neuroscience-Inspired Online Unsupervised Learning Algorithms: Artificial neural networks , 2019, IEEE Signal Processing Magazine.

[12]  Nicu Sebe,et al.  A Survey on Learning to Hash , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  M. Fletcher,et al.  Olfactory bulb acetylcholine release dishabituates odor responses and reinstates odor investigation , 2018, Nature Communications.

[14]  L. Luo,et al.  Diversity and Wiring Variability of Olfactory Local Interneurons in the Drosophila Antennal Lobe , 2010, Nature Neuroscience.

[15]  Mani Ramaswami,et al.  Olfactory habituation in Drosophila-odor encoding and its plasticity in the antennal lobe. , 2014, Progress in brain research.

[16]  Moritz Helmstaedter,et al.  The Mutual Inspirations of Machine Learning and Neuroscience , 2015, Neuron.

[17]  Katherine I Nagel,et al.  Mechanisms Underlying Population Response Dynamics in Inhibitory Interneurons of the Drosophila Antennal Lobe , 2016, The Journal of Neuroscience.

[18]  Alison I Weber,et al.  Coding Principles in Adaptation. , 2019, Annual review of vision science.

[19]  Alexei A. Koulakov,et al.  A primacy code for odor identity , 2017, Nature Communications.

[20]  Joydeep Ghosh,et al.  Habituation based neural networks for spatio-temporal classification , 1997, Neurocomputing.

[21]  Stefano Soatto,et al.  Emergence of Invariance and Disentanglement in Deep Representations , 2017, 2018 Information Theory and Applications Workshop (ITA).

[22]  Maxim Bazhenov,et al.  Differential effects of adaptation on odor discrimination. , 2018, Journal of neurophysiology.

[23]  Richard G. Baraniuk,et al.  A Probabilistic Framework for Deep Learning , 2016, NIPS.

[24]  Donald A. Wilson,et al.  Synaptic adaptation and odor-background segmentation , 2007, Neurobiology of Learning and Memory.

[25]  Charles F Stevens,et al.  What the fly’s nose tells the fly’s brain , 2015, Proceedings of the National Academy of Sciences.

[26]  Timothy E. J. Behrens,et al.  Inhibitory engrams in perception and memory , 2017, Proceedings of the National Academy of Sciences.

[27]  Kalpana Goyal,et al.  Review of background subtraction methods using Gaussian mixture model for video surveillance systems , 2017, Artificial Intelligence Review.

[28]  V. Balasubramanian,et al.  Competitive binding predicts nonlinear responses of olfactory receptors to complex mixtures , 2018, Proceedings of the National Academy of Sciences.

[29]  Yiming Li,et al.  Transformation of odor selectivity from projection neurons to single mushroom body neurons mapped with dual-color calcium imaging , 2013, Proceedings of the National Academy of Sciences.

[30]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[31]  Ronald L. Davis,et al.  The GABAergic anterior paired lateral neuron suppresses and is suppressed by olfactory learning , 2008, Nature Neuroscience.

[32]  Shawn R. Olsen,et al.  Divisive Normalization in Olfactory Population Codes , 2010, Neuron.

[33]  Scott Waddell,et al.  Olfactory learning skews mushroom body output pathways to steer behavioral choice in Drosophila , 2015, Current Opinion in Neurobiology.

[34]  Kei Ito,et al.  Gamma‐aminobutyric acid (GABA)‐mediated neural connections in the Drosophila antennal lobe , 2009, The Journal of comparative neurology.

[35]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[36]  Andrew C. Lin,et al.  Sparse, Decorrelated Odor Coding in the Mushroom Body Enhances Learned Odor Discrimination , 2014, Nature Neuroscience.

[37]  Eric T. Trautman,et al.  A Complete Electron Microscopy Volume of the Brain of Adult Drosophila melanogaster , 2017, Cell.

[38]  Ashok Veeraraghavan,et al.  Fast Retinomorphic Event Stream for Video Recognition and Reinforcement Learning , 2018, 1805.06374.

[39]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[40]  G. Rubin,et al.  Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila , 2014, eLife.

[41]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[42]  M. A. Arbib,et al.  How does the toad's visual system discriminate different worm-like stimuli? , 2004, Biological Cybernetics.

[43]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[44]  G. Laurent,et al.  Encoding of Mixtures in a Simple Olfactory System , 2013, Neuron.

[45]  Thomas A Cleland,et al.  Olfactory bulb habituation to odor stimuli. , 2010, Behavioral neuroscience.

[46]  Emre Özbilge,et al.  On-line expectation-based novelty detection for mobile robots , 2016, Robotics Auton. Syst..

[47]  Glenn C. Turner,et al.  Olfactory representations by Drosophila mushroom body neurons. , 2008, Journal of neurophysiology.

[48]  Wanhe Li,et al.  Imaging a Population Code for Odor Identity in the Drosophila Mushroom Body , 2013, The Journal of Neuroscience.

[49]  Shawn R. Olsen,et al.  Sensory processing in the Drosophila antennal lobe increases reliability and separability of ensemble odor representations , 2007, Nature Neuroscience.

[50]  A. Mueen,et al.  Diminished EEG habituation to novel events effectively classifies Parkinson’s patients , 2018, Clinical Neurophysiology.

[51]  Thierry Emonet,et al.  Olfactory receptor neurons use gain control and complementary kinetics to encode intermittent odorant stimuli , 2017, eLife.

[52]  Robert A. A. Campbell,et al.  Cellular-Resolution Population Imaging Reveals Robust Sparse Coding in the Drosophila Mushroom Body , 2011, The Journal of Neuroscience.

[53]  Sanjoy Dasgupta,et al.  A neural data structure for novelty detection , 2018, Proceedings of the National Academy of Sciences.

[54]  Baranidharan Raman,et al.  Temporally Diverse Firing Patterns in Olfactory Receptor Neurons Underlie Spatiotemporal Neural Codes for Odors , 2010, The Journal of Neuroscience.

[55]  Kei Ito,et al.  Organization of antennal lobe‐associated neurons in adult Drosophila melanogaster brain , 2012, The Journal of comparative neurology.

[56]  D. Hassabis,et al.  Neuroscience-Inspired Artificial Intelligence , 2017, Neuron.

[57]  Heng Tao Shen,et al.  Hashing for Similarity Search: A Survey , 2014, ArXiv.

[58]  T. Abrams,et al.  Insights into a molecular switch that gates sensory neuron synapses during habituation in Aplysia , 2009, Neurobiology of Learning and Memory.

[59]  L. Abbott,et al.  Random Convergence of Olfactory Inputs in the Drosophila Mushroom Body , 2013, Nature.

[60]  Bowen Zhou,et al.  ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs , 2015, TACL.

[61]  Maxim Bazhenov,et al.  Learning Modifies Odor Mixture Processing to Improve Detection of Relevant Components , 2015, The Journal of Neuroscience.

[62]  L. Buck,et al.  Combinatorial Receptor Codes for Odors , 1999, Cell.

[63]  T. Parrish,et al.  Learning to Smell the Roses: Experience-Dependent Neural Plasticity in Human Piriform and Orbitofrontal Cortices , 2006, Neuron.

[64]  Merav Parter,et al.  Random Sketching, Clustering, and Short-Term Memory in Spiking Neural Networks , 2020, ITCS.

[65]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[66]  Glenn C. Turner,et al.  Integration of the olfactory code across dendritic claws of single mushroom body neurons , 2013, Nature Neuroscience.

[67]  Paola Cognigni,et al.  Do the right thing: neural network mechanisms of memory formation, expression and update in Drosophila , 2018, Current Opinion in Neurobiology.

[68]  Andrew C. Giles,et al.  Behavioral and genetic characterization of habituation using Caenorhabditis elegans , 2009, Neurobiology of Learning and Memory.

[69]  Ramon Huerta,et al.  Nonassociative plasticity alters competitive interactions among mixture components in early olfactory processing , 2013, The European journal of neuroscience.

[70]  Ben Sutcliffe,et al.  Neurogenetic dissection of the Drosophila lateral horn reveals major outputs, diverse behavioural functions, and interactions with the mushroom body , 2019, eLife.

[71]  Donald A. Wilson,et al.  Odor-specific habituation arises from interaction of afferent synaptic adaptation and intrinsic synaptic potentiation in olfactory cortex. , 2009, Learning & memory.

[72]  F. Abdullah,et al.  A habituation based approach for detection of visual changes in surveillance camera , 2017 .

[73]  R. F. Thompson,et al.  Habituation: a model phenomenon for the study of neuronal substrates of behavior. , 1966, Psychological review.

[74]  Andrew C. Lin,et al.  Neuronal mechanisms underlying innate and learned olfactory processing in Drosophila. , 2019, Current opinion in insect science.

[75]  David L. Glanzman,et al.  Habituation in Aplysia: The Cheshire Cat of neurobiology , 2009, Neurobiology of Learning and Memory.

[76]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[77]  Jing W. Wang,et al.  A Presynaptic Gain Control Mechanism Fine-Tunes Olfactory Behavior , 2008, Neuron.

[78]  Frédéric Berthommier,et al.  Mitral cell temporal response patterns evoked by odor mixtures in the rat olfactory bulb. , 2002, Journal of neurophysiology.

[79]  Gerald M. Rubin,et al.  Heterosynaptic Plasticity Underlies Aversive Olfactory Learning in Drosophila , 2015, Neuron.

[80]  Paul Szyszka,et al.  The Speed of Smell: Odor-Object Segregation within Milliseconds , 2012, PloS one.

[81]  Louis K. Scheffer,et al.  A connectome of a learning and memory center in the adult Drosophila brain , 2017, eLife.

[82]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[83]  A. Roli Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[84]  Rainer W Friedrich,et al.  Processing of Odor Mixtures in the Zebrafish Olfactory Bulb , 2004, The Journal of Neuroscience.

[85]  Steven M. Peterson,et al.  A spatiotemporal coding mechanism for background-invariant odor recognition , 2013, Nature Neuroscience.

[86]  W. Gareth J. Howells,et al.  An online background subtraction algorithm deployed on a NAO humanoid robot based monitoring system , 2016, Robotics Auton. Syst..

[87]  Gero Miesenböck,et al.  Mechanisms of Sensory Discrimination: Insights from Drosophila Olfaction. , 2019, Annual review of biophysics.

[88]  Rishabh Chandak,et al.  Dynamic contrast enhancement and flexible odor codes , 2017 .

[89]  Subhabrata Sanyal,et al.  Plasticity of local GABAergic interneurons drives olfactory habituation , 2011, Proceedings of the National Academy of Sciences.

[90]  Sanjoy Dasgupta,et al.  A neural algorithm for a fundamental computing problem , 2017 .

[91]  Michael A. Arbib,et al.  Modeling the dishabituation hierarchy: The role of the primordial hippocampus , 1992, Biological Cybernetics.

[92]  Young-Min Kim,et al.  A hybrid framework combining background subtraction and deep neural networks for rapid person detection , 2018, Journal of Big Data.

[93]  Markus Knaden,et al.  Odor mixtures of opposing valence unveil inter-glomerular crosstalk in the Drosophila antennal lobe , 2019, Nature Communications.

[94]  Dumitru Erhan,et al.  Show and Tell: Lessons Learned from the 2015 MSCOCO Image Captioning Challenge , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[95]  V. Murthy,et al.  An olfactory cocktail party: figure-ground segregation of odorants in rodents , 2014, Nature Neuroscience.

[96]  Mani Ramaswami,et al.  Network Plasticity in Adaptive Filtering and Behavioral Habituation , 2014, Neuron.

[97]  John R. Carlson,et al.  Coding of Odors by a Receptor Repertoire , 2006, Cell.

[98]  Matthieu Louis,et al.  A circuit supporting concentration-invariant odor perception in Drosophila , 2009, Journal of biology.

[99]  Soon Ki Jung,et al.  Deep Neural Network Concepts for Background Subtraction: A Systematic Review and Comparative Evaluation , 2018, Neural Networks.

[100]  F. Zufall,et al.  The cellular and molecular basis of odor adaptation. , 2000, Chemical senses.

[101]  T. Komiyama,et al.  Dynamic Sensory Representations in the Olfactory Bulb: Modulation by Wakefulness and Experience , 2012, Neuron.

[102]  Kei Ito,et al.  Central synaptic mechanisms underlie short-term olfactory habituation in Drosophila larvae. , 2010, Learning & memory.

[103]  Christiane Linster,et al.  Neurobiology of a simple memory. , 2008, Journal of neurophysiology.