Neural Autoassociative Memories for Binary Vectors: A Survey

[1]  Anja Becker,et al.  New directions in nearest neighbor searching with applications to lattice sieving , 2016, IACR Cryptol. ePrint Arch..

[2]  Matthias Löwe,et al.  On a Model of Associative Memory with Huge Storage Capacity , 2017, 1702.01929.

[3]  Daniel J. Amit,et al.  Learning in Neural Networks with Material Synapses , 1994, Neural Computation.

[4]  John J. Hopfield,et al.  Dense Associative Memory Is Robust to Adversarial Inputs , 2017, Neural Computation.

[5]  James A. Anderson,et al.  Cognitive and psychological computation with neural models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Mayank Goswami,et al.  Distance Sensitive Bloom Filters Without False Negatives , 2017, SODA.

[7]  Evgeny Osipov,et al.  Modality classification of medical images with distributed representations based on cellular automata reservoir computing , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[8]  Shun-ichi Amari,et al.  Characteristics of sparsely encoded associative memory , 1989, Neural Networks.

[9]  Günther Palm,et al.  Memory Capacities for Synaptic and Structural Plasticity G ¨ Unther Palm , 2022 .

[10]  Vincent Gripon,et al.  Associative Memories to Accelerate Approximate Nearest Neighbor Search , 2016, ArXiv.

[11]  M. Usher,et al.  Capacities of multiconnected memory models , 1988 .

[12]  Donald C. Wunsch,et al.  Generalization of Features in the Assembly Neural Networks , 2004, Int. J. Neural Syst..

[13]  Evgeny Osipov,et al.  On Bidirectional Transitions between Localist and Distributed Representations: The Case of Common Substrings Search Using Vector Symbolic Architecture , 2014, BICA.

[14]  Claude Berrou,et al.  Storing Sparse Messages in Networks of Neural Cliques , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Pentti Kanerva,et al.  Sparse Distributed Memory , 1988 .

[16]  Evgeny Osipov,et al.  Imitation of honey bees’ concept learning processes using Vector Symbolic Architectures , 2015, BICA 2015.

[17]  Stephen I. Gallant,et al.  Representing Objects, Relations, and Sequences , 2013, Neural Computation.

[18]  Pentti Kanerva,et al.  Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random Vectors , 2009, Cognitive Computation.

[19]  Dmitri A. Rachkovskij,et al.  Modification of Holographic Graph Neuron Using Sparse Distributed Representations , 2016 .

[20]  Gutfreund.  Neural networks with hierarchically correlated patterns. , 1988, Physical review. A, General physics.

[21]  Abbott,et al.  Storage capacity of generalized networks. , 1987, Physical review. A, General physics.

[22]  Mathias Bæk Tejs Knudsen,et al.  Fast Similarity Sketching , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[23]  Alexander V. Goltsev,et al.  Secondary learning in the assembly neural network , 2004, Neurocomputing.

[24]  Alexander A. Frolov,et al.  Boolean Factor Analysis by Attractor Neural Network , 2007, IEEE Transactions on Neural Networks.

[25]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[26]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[27]  Michael Rabbat,et al.  Memory Vectors for Similarity Search in High-Dimensional Spaces , 2014, IEEE Transactions on Big Data.

[28]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.

[29]  G. A. Kohring,et al.  Neural networks with many-neuron interactions , 1990 .

[30]  Thomas Dybdahl Ahle.  Optimal Las Vegas Locality Sensitive Data Structures , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[31]  A. Bovier.  Sharp upper bounds on perfect retrieval in the Hopfield model , 1999 .

[32]  J. J. Hopfield,et al.  ‘Unlearning’ has a stabilizing effect in collective memories , 1983, Nature.

[33]  A Kartashov,et al.  Quality and efficiency of retrieval for Willshaw-like autoassociative networks: III. Willshaw–Potts model , 1997 .

[34]  Vincent Gripon,et al.  Twin Neurons for Efficient Real-World Data Distribution in Networks of Neural Cliques: Applications in Power Management in Electronic Circuits , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Vincent Gripon,et al.  Sparse Neural Networks With Large Learning Diversity , 2011, IEEE Transactions on Neural Networks.

[36]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[37]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Amin Karbasi,et al.  Coupled neural associative memories , 2013, 2013 IEEE Information Theory Workshop (ITW).

[39]  Andrei Broder,et al.  Network Applications of Bloom Filters: A Survey , 2004, Internet Math..

[40]  John J. Hopfield,et al.  Dense Associative Memory for Pattern Recognition , 2016, NIPS.

[41]  Andrei L. Mikaelian,et al.  Vector neural net identifying many strongly distorted and correlated patterns , 2005, SPIE/COS Photonics Asia.

[42]  Evgeny Osipov,et al.  Brain-like classifier of temporal patterns , 2014, 2014 International Conference on Computer and Information Sciences (ICCOINS).

[43]  Alexander A. Frolov,et al.  Recurrent-Neural-Network-Based Boolean Factor Analysis and Its Application to Word Clustering , 2009, IEEE Transactions on Neural Networks.

[44]  Teuvo Kohonen,et al.  Content-addressable memories , 1980 .

[45]  T. N. Baidyk,et al.  Structure of neural assembly , 1992, [Proceedings] 1992 RNNS/IEEE Symposium on Neuroinformatics and Neurocomputers.

[46]  Alexander Goltsev,et al.  Modular neural networks with radial neural columnar architecture , 2015, BICA 2015.

[47]  H. Horner,et al.  Transients and basins of attraction in neutral network models , 1989 .

[48]  Nikolaos Papakonstantinou,et al.  Fault detection in the hyperspace: Towards intelligent automation systems , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[49]  Thomas Reimer,et al.  Random mappings designed for commercial search engines , 2015, ArXiv.

[50]  A A Frolov,et al.  Informational characteristics of neural networks capable of associative learning based on Hebbian plasticity , 1993 .

[51]  David Burshtein.  Long-term attraction in higher order neural networks , 1998, IEEE Trans. Neural Networks.

[52]  Denis Kleyko,et al.  Autoscaling Bloom filter: controlling trade-off between true and false positives , 2017, Neural Computing and Applications.

[53]  Lev B. Ioffe,et al.  The Augmented Models of Associative Memory Asymmetric Interaction and Hierarchy of Patterns - Int. J. Mod. Phys. B1, 51 (1987) , 1987 .

[54]  David Burshtein,et al.  Nondirect convergence radius and number of iterations of the Hopfield associative memory , 1994, IEEE Trans. Inf. Theory.

[55]  Jan M. Rabaey,et al.  Classification and Recall With Binary Hyperdimensional Computing: Tradeoffs in Choice of Density and Mapping Characteristics , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[56]  Nikita Lyamin,et al.  Dependable MAC Layer Architecture Based on Holographic Data Representation Using Hyper-Dimensional Binary Spatter Codes , 2012, MACOM.

[57]  Rasmus Pagh,et al.  Set similarity search beyond MinHash , 2017, STOC.

[58]  David Willshaw,et al.  On setting unit thresholds in an incompletely connected associative net Network: Comput , 1993 .

[59]  Dimche Kostadinov,et al.  Fast content identification in high-dimensional feature spaces using Sparse Ternary Codes , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[60]  Baldi,et al.  Number of stable points for spin-glasses and neural networks of higher orders. , 1987, Physical review letters.

[61]  V. Braitenberg.  Cell Assemblies in the Cerebral Cortex , 1978 .

[62]  Y. Ahmet Sekercioglu,et al.  Holographic Graph Neuron: A Bioinspired Architecture for Pattern Processing , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[63]  Alexandr Andoni,et al.  Optimal Hashing-based Time-Space Trade-offs for Approximate Near Neighbors , 2016, SODA.

[64]  Matthias Löwe,et al.  On the capacity of an associative memory model based on neural cliques , 2015 .

[65]  John Robinson,et al.  Statistical analysis of the dynamics of a sparse associative memory , 1992, Neural Networks.

[66]  D. Amit,et al.  Statistical mechanics of neural networks near saturation , 1987 .

[67]  A Kartashov,et al.  Quality and efficiency of retrieval for Willshaw-like autoassociative networks. II. Recognition , 1995 .

[68]  W. Kinzel.  Learning and pattern recognition in spin glass models , 1985 .

[69]  E. Gardner.  The space of interactions in neural network models , 1988 .

[70]  Amin Karbasi,et al.  Iterative Learning and Denoising in Convolutional Neural Associative Memories , 2013, ICML.

[71]  David Van Brackle,et al.  Vector Representation for Sub-Graph Encoding to Resolve Entities , 2016 .

[72]  Toshiki Kindo,et al.  Hierarchical Concept Formation in Associative Memory Composed of Neuro-window Elements , 1996, Neural Networks.

[73]  Alexander V. Goltsev,et al.  An assembly neural network for texture segmentation , 1996, Neural Networks.

[74]  N Brunel,et al.  Slow stochastic Hebbian learning of classes of stimuli in a recurrent neural network. , 1998, Network.

[75]  Kanter.  Potts-glass models of neural networks. , 1988, Physical review. A, General physics.

[76]  Matthias Löwe,et al.  A Comparative Study of Sparse Associative Memories , 2015 .

[77]  D. A. Rachkovskii,et al.  Time of searching for similar binary vectors in associative memory , 2006 .

[78]  James A. Anderson,et al.  A theory for the recognition of items from short memorized lists , 1973 .

[79]  Marius Usher,et al.  A neural model of the dynamic activation of memory , 1993, Biological Cybernetics.

[80]  Nikolai Amosov.  Modeling of thinking and the mind , 1967 .

[81]  Vincent Gripon,et al.  Finding All Matches in a Database using Binary Neural Networks , 2017 .

[82]  Richard Cole,et al.  Dictionary matching and indexing with errors and don't cares , 2004, STOC '04.

[83]  E. Gardner.  Multiconnected neural network models , 1987 .

[84]  Alexander A. Frolov,et al.  Informational Capacity and Recall Quality in Sparsely Encoded Hopfield-like Neural Network: Analytical Approaches and Computer Simulation , 1997, Neural Networks.

[85]  Gregory L. Murphy,et al.  Psychological concepts in a parallel system , 1986 .

[86]  Evgeny Osipov,et al.  Recognizing Permuted Words with Vector Symbolic Architectures: A Cambridge Test for Machines , 2016, BICA.

[87]  Alexander V. Goltsev,et al.  Modular neural networks with Hebbian learning rule , 2009, Neurocomputing.

[88]  Sompolinsky,et al.  Willshaw model: Associative memory with sparse coding and low firing rates. , 1990, Physical review. A, Atomic, molecular, and optical physics.