Recent Advances in Physical Reservoir Computing: A Review

Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing system consists of a reservoir for mapping inputs into a high-dimensional space and a readout for pattern analysis from the high-dimensional states in the reservoir. The reservoir is fixed and only the readout is trained with a simple method such as linear regression and classification. Thus, the major advantage of reservoir computing compared to other recurrent neural networks is fast learning, resulting in low training cost. Another advantage is that the reservoir without adaptive updating is amenable to hardware implementation using a variety of physical systems, substrates, and devices. In fact, such physical reservoir computing has attracted increasing attention in diverse fields of research. The purpose of this review is to provide an overview of recent advances in physical reservoir computing by classifying them according to the type of the reservoir. We discuss the current issues and perspectives related to physical reservoir computing, in order to further expand its practical applications and develop next-generation machine learning systems.

[1]  Eduardo D. Sontag,et al.  Computational Aspects of Feedback in Neural Circuits , 2006, PLoS Comput. Biol..

[2]  Serge Massar,et al.  Brain-Inspired Photonic Signal Processor for Generating Periodic Patterns and Emulating Chaotic Systems , 2017 .

[3]  Claudio Gallicchio,et al.  Deep reservoir computing: A critical experimental analysis , 2017, Neurocomputing.

[4]  Helmut Hauser,et al.  Towards a theoretical foundation for morphological computation with compliant bodies , 2011, Biological Cybernetics.

[5]  Darwin G. Caldwell,et al.  Timing-based control via echo state network for soft robotic arm , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[6]  Piotr Antonik Application of FPGA to Real‐Time Machine Learning: Hardware Reservoir Computers and Software Image Processing , 2018 .

[7]  Bozhkov Lachezar,et al.  Echo State Network , 2017, Encyclopedia of Machine Learning and Data Mining.

[8]  Brad Hutchings,et al.  FPGA-based stochastic neural networks-implementation , 1994, Proceedings of IEEE Workshop on FPGA's for Custom Computing Machines.

[9]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[10]  Steve M. Potter,et al.  Input Separability in Living Liquid State Machines , 2011, ICANNGA.

[11]  Jens Bürger,et al.  Variation-tolerant Computing with Memristive Reservoirs , 2013, 2013 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[12]  Robert Rosenbaum,et al.  A model of reward-modulated motor learning with parallelcortical and basal ganglia pathways , 2018, ArXiv.

[13]  U. Frey,et al.  A CMOS-based microelectrode array for interaction with neuronal cultures , 2007, Journal of Neuroscience Methods.

[14]  H. Seo,et al.  A reservoir of time constants for memory traces in cortical neurons , 2011, Nature Neuroscience.

[15]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[16]  Romain Modeste Nguimdo,et al.  Simultaneous Computation of Two Independent Tasks Using Reservoir Computing Based on a Single Photonic Nonlinear Node With Optical Feedback , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Lambert Schomaker,et al.  A neural oscillator-network model of temporal pattern generation , 1992 .

[18]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[19]  John A. Stankovic,et al.  Real-time computing , 1992 .

[20]  Stefan J. Kiebel,et al.  Re-visiting the echo state property , 2012, Neural Networks.

[21]  Benjamin Schrauwen,et al.  Design and control of compliant tensegrity robots through simulation and hardware validation , 2014, Journal of The Royal Society Interface.

[22]  Peter Ford Dominey,et al.  Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing , 2009, Brain and Language.

[23]  Daniel Brunner,et al.  Conditions for reservoir computing performance using semiconductor lasers with delayed optical feedback. , 2017, Optics express.

[24]  A. Lansner,et al.  Neurocognitive Architecture of Working Memory , 2015, Neuron.

[25]  Nathan McDonald,et al.  Reservoir computing & extreme learning machines using pairs of cellular automata rules , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[26]  Serge Massar,et al.  Parallel photonic reservoir computing using frequency multiplexing of neurons , 2016, ArXiv.

[27]  Bryant T. Wysocki,et al.  Design and analysis of neuromemristive echo state networks with limited-precision synapses , 2015, 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA).

[28]  Gouhei Tanaka,et al.  Analysis on Characteristics of Multi-Step Learning Echo State Networks for Nonlinear Time Series Prediction , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[29]  Peter Ford Dominey,et al.  Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure of language in the infant , 2000 .

[30]  Sandhya Samarasinghe,et al.  Neural Networks for Applied Sciences and Engineering: From Fundamentals to Complex Pattern Recognition , 2006 .

[31]  José Carlos Príncipe,et al.  Analysis and Design of Echo State Networks , 2007, Neural Computation.

[32]  Peter Ford Dominey,et al.  Recurrent temporal networks and language acquisition—from corticostriatal neurophysiology to reservoir computing , 2013, Front. Psychol..

[33]  Doreen Schweizer,et al.  Cellular Automata And Complexity Collected Papers , 2016 .

[34]  Toshiyuki Yamane,et al.  Waveform Classification by Memristive Reservoir Computing , 2017, ICONIP.

[35]  B. Schrauwen,et al.  Isolated word recognition with the Liquid State Machine: a case study , 2005, Inf. Process. Lett..

[36]  Michael B. Matthews,et al.  Approximating nonlinear fading-memory operators using neural network models , 1993 .

[37]  Christiam F. Frasser,et al.  Reservoir Computing Hardware with Cellular Automata , 2018, ArXiv.

[38]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[39]  Benjamin Schrauwen,et al.  Optoelectronic Reservoir Computing , 2011, Scientific Reports.

[40]  Antonius M J VanDongen,et al.  Short-Term Memory in Networks of Dissociated Cortical Neurons , 2013, The Journal of Neuroscience.

[41]  Benjamin Schrauwen,et al.  Compact hardware liquid state machines on FPGA for real-time speech recognition , 2008, Neural Networks.

[42]  Miguel C. Soriano,et al.  Photonic delay systems as machine learning implementations , 2015, J. Mach. Learn. Res..

[43]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[44]  Bharadwaj S. Amrutur,et al.  Input coding for neuro-electronic hybrid systems , 2014, Biosyst..

[45]  K. Doya Complementary roles of basal ganglia and cerebellum in learning and motor control , 2000, Current Opinion in Neurobiology.

[46]  Subhrajit Roy,et al.  Liquid State Machine With Dendritically Enhanced Readout for Low-Power, Neuromorphic VLSI Implementations , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[47]  Juan-Pablo Ortega,et al.  Reservoir Computing Universality With Stochastic Inputs , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Jacques-Olivier Klein,et al.  Spatio-temporal learning with arrays of analog nanosynapses , 2017, 2017 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[49]  Yang Yi,et al.  A deep learning based approach for analog hardware implementation of delayed feedback reservoir computing system , 2018, 2018 19th International Symposium on Quality Electronic Design (ISQED).

[50]  Wolfgang Maass,et al.  Liquid State Machines: Motivation, Theory, and Applications , 2010 .

[51]  Özgür Yilmaz,et al.  Reservoir Computing using Cellular Automata , 2014, ArXiv.

[52]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[53]  David Soto,et al.  Neural basis of non-conscious visual working memory , 2014, NeuroImage.

[54]  Miguel C. Soriano,et al.  Digital Implementation of a Single Dynamical Node Reservoir Computer , 2015, IEEE Transactions on Circuits and Systems II: Express Briefs.

[55]  Paul R. Prucnal,et al.  Recent progress in semiconductor excitable lasers for photonic spike processing , 2016 .

[56]  Benjamin Schrauwen,et al.  Toward optical signal processing using photonic reservoir computing. , 2008, Optics express.

[57]  José Carlos Príncipe,et al.  Liquid state machines and cultured cortical networks: The separation property , 2009, Biosyst..

[58]  Ben Jones,et al.  Is there a Liquid State Machine in the Bacterium Escherichia Coli? , 2007, 2007 IEEE Symposium on Artificial Life.

[59]  Michiel Hermans,et al.  Random Pattern and Frequency Generation Using a Photonic Reservoir Computer with Output Feedback , 2017, Neural Processing Letters.

[60]  Nicholas Soures,et al.  Robustness of a memristor based liquid state machine , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[61]  Jie Qin,et al.  Recognition of the optical packet header for two channels utilizing the parallel reservoir computing based on a semiconductor ring laser , 2018 .

[62]  Han Ju,et al.  Spatiotemporal Memory Is an Intrinsic Property of Networks of Dissociated Cortical Neurons , 2015, The Journal of Neuroscience.

[63]  Peter Ford Dominey,et al.  Cortico-striatal function in sentence comprehension: Insights from neurophysiology and modeling , 2009, Cortex.

[64]  Benjamin Schrauwen,et al.  The body as a reservoir: locomotion and sensing with linear feedback , 2011 .

[65]  Loris,et al.  Numerical demonstration of neuromorphic computing with photonic crystal cavities , 2018 .

[66]  Christof Teuscher,et al.  Memristor-based reservoir computing , 2012, 2012 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[67]  Michael Rabadi,et al.  Kernel Methods for Machine Learning , 2015 .

[68]  Joni Dambre,et al.  Using Digital Masks to Enhance the Bandwidth Tolerance and Improve the Performance of On-Chip Reservoir Computing Systems , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[69]  Tao Li,et al.  Behavior switching using reservoir computing for a soft robotic arm , 2012, 2012 IEEE International Conference on Robotics and Automation.

[70]  Abigail Morrison,et al.  Liquid computing on and off the edge of chaos with a striatal microcircuit , 2014, Front. Comput. Neurosci..

[71]  Juan-Pablo Ortega,et al.  Echo state networks are universal , 2018, Neural Networks.

[72]  Ingo Fischer,et al.  Reconfigurable semiconductor laser networks based on diffractive coupling. , 2015, Optics letters.

[73]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[74]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[75]  Masakazu Aono,et al.  A theoretical and experimental study of neuromorphic atomic switch networks for reservoir computing , 2013, Nanotechnology.

[76]  Thomas Serre,et al.  A Theory of Object Recognition: Computations and Circuits in the Feedforward Path of the Ventral Stream in Primate Visual Cortex , 2005 .

[77]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[78]  Josep L. Rosselló,et al.  Stochastic hardware implementation of Liquid State Machines , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[79]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[80]  Jonathan Dong,et al.  Scaling Up Echo-State Networks With Multiple Light Scattering , 2016, 2018 IEEE Statistical Signal Processing Workshop (SSP).

[81]  Seung Hwan Lee,et al.  Reservoir computing using dynamic memristors for temporal information processing , 2017, Nature Communications.

[82]  Henry Markram,et al.  On the computational power of circuits of spiking neurons , 2004, J. Comput. Syst. Sci..

[83]  Damien Querlioz,et al.  Neuromorphic computing with nanoscale spintronic oscillators , 2017, Nature.

[84]  Dimitris Syvridis,et al.  Micro ring resonators as building blocks for an all-optical high-speed reservoir-computing bit-pattern-recognition system , 2013 .

[85]  Atsushi Uchida,et al.  Laser dynamical reservoir computing with consistency: an approach of a chaos mask signal. , 2016, Optics express.

[86]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[87]  Masakazu Aono,et al.  Self-organization and Emergence of Dynamical Structures in Neuromorphic Atomic Switch Networks , 2019, Handbook of Memristor Networks.

[88]  Richard F. Lyon,et al.  A computational model of filtering, detection, and compression in the cochlea , 1982, ICASSP.

[89]  A. Odlyzko,et al.  Algebraic properties of cellular automata , 1984 .

[90]  Gunnar Tufte,et al.  Towards making a cyborg: A closed-loop reservoir-neuro system , 2017, ECAL.

[91]  Leon O. Chua,et al.  Fading memory and the problem of approximating nonlinear operators with volterra series , 1985 .

[92]  Rik Van de Walle,et al.  Real-Time Reservoir Computing Network-Based Systems for Detection Tasks on Visual Contents , 2015, 2015 7th International Conference on Computational Intelligence, Communication Systems and Networks.

[93]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[94]  Paul R. Prucnal,et al.  Progress in neuromorphic photonics , 2017 .

[95]  Joni Dambre,et al.  Reward-Modulated Hebbian Plasticity as Leverage for Partially Embodied Control in Compliant Robotics , 2015, Front. Neurorobot..

[96]  Johannes Schemmel,et al.  Edge of Chaos Computation in Mixed-Mode VLSI - A Hard Liquid , 2004, NIPS.

[97]  Andrew Katumba,et al.  A Multiple-Input Strategy to Efficient Integrated Photonic Reservoir Computing , 2017, Cognitive Computation.

[98]  Chrisantha Fernando,et al.  Pattern Recognition in a Bucket , 2003, ECAL.

[99]  Peter Petre,et al.  Neuromorphic mixed-signal circuitry for Asynchronous Pulse Processing , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[100]  Benjamin Schrauwen,et al.  Memristor Models for Machine Learning , 2014, Neural Computation.

[101]  Christof Teuscher,et al.  Computational Capabilities of Random Automata Networks for Reservoir Computing , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[102]  Wolfgang Maass,et al.  Emergence of complex computational structures from chaotic neural networks through reward-modulated Hebbian learning. , 2014, Cerebral cortex.

[103]  Qian Wang,et al.  Liquid state machine based pattern recognition on FPGA with firing-activity dependent power gating and approximate computing , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[104]  Chan H. See,et al.  Reconfigurable neurons - making the most of configurable logic blocks (CLBs) , 2015, 2015 Internet Technologies and Applications (ITA).

[105]  Yu Jin,et al.  Numerical Simulation and Experiment on Optical Packet Header Recognition Utilizing Reservoir Computing Based on Optoelectronic Feedback , 2017, IEEE Photonics Journal.

[106]  J. Albus A Theory of Cerebellar Function , 1971 .

[107]  Michiel Hermans,et al.  Optoelectronic Systems Trained With Backpropagation Through Time , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[108]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[109]  Haibo He,et al.  Distributive Dynamic Spectrum Access Through Deep Reinforcement Learning: A Reservoir Computing-Based Approach , 2018, IEEE Internet of Things Journal.

[110]  Audrius V. Avizienis,et al.  Emergent Criticality in Complex Turing B‐Type Atomic Switch Networks , 2012, Advanced materials.

[111]  Cory Merkel,et al.  Design and Analysis of a Neuromemristive Reservoir Computing Architecture for Biosignal Processing , 2016, Front. Neurosci..

[112]  Serge Massar,et al.  FPGA Implementation of Reservoir Computing with Online Learning , 2015 .

[113]  Jonas Degrave,et al.  Developing an embodied gait on a compliant quadrupedal robot , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[114]  Jens Bürger,et al.  Computational Capacity and Energy Consumption of Complex Resistive Switch Networks , 2015, ArXiv.

[115]  Dianhui Wang,et al.  Randomness in neural networks: an overview , 2017, WIREs Data Mining Knowl. Discov..

[116]  Geert Morthier,et al.  Experimental demonstration of reservoir computing on a silicon photonics chip , 2014, Nature Communications.

[117]  Michiel Hermans,et al.  Embodiment of Learning in Electro-Optical Signal Processors , 2016, Physical review letters.

[118]  Jeff Hasty,et al.  Distributed Classifier Based on Genetically Engineered Bacterial Cell Cultures , 2014, ACS synthetic biology.

[119]  Henry Markram,et al.  Fading memory and kernel properties of generic cortical microcircuit models , 2004, Journal of Physiology-Paris.

[120]  Helmut Hauser,et al.  The role of feedback in morphological computation with compliant bodies , 2012, Biological Cybernetics.

[121]  Stefano Nichele,et al.  Deep Reservoir Computing Using Cellular Automata , 2017, ArXiv.

[122]  Nima Dehghani,et al.  A Computational Perspective of the Role of the Thalamus in Cognition , 2018, Neural Computation.

[123]  Gunnar Tufte,et al.  Reservoir computing with a chaotic circuit , 2017, ECAL.

[124]  Hitoshi Kubota,et al.  Macromagnetic Simulation for Reservoir Computing Utilizing Spin Dynamics in Magnetic Tunnel Junctions , 2018, Physical Review Applied.

[125]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[126]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[127]  Jochen Triesch,et al.  Seeing [u] aids vocal learning: Babbling and imitation of vowels using a 3D vocal tract model, reinforcement learning, and reservoir computing , 2015, 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[128]  Risto Miikkulainen,et al.  Reservoir Computing , 2017, Encyclopedia of Machine Learning and Data Mining.

[129]  J.J. Steil,et al.  Backpropagation-decorrelation: online recurrent learning with O(N) complexity , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[130]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[131]  Serge Massar,et al.  Fully analogue photonic reservoir computer , 2016, Scientific Reports.

[132]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[133]  Benjamin Schrauwen,et al.  Locomotion Without a Brain: Physical Reservoir Computing in Tensegrity Structures , 2013, Artificial Life.

[134]  Helmut Hauser,et al.  A soft body as a reservoir: case studies in a dynamic model of octopus-inspired soft robotic arm , 2013, Front. Comput. Neurosci..

[135]  Jonas Degrave,et al.  Morphological Properties of Mass–Spring Networks for Optimal Locomotion Learning , 2017, Front. Neurorobot..

[136]  Benjamin Krueger,et al.  Magnetic Skyrmion as a Nonlinear Resistive Element: A Potential Building Block for Reservoir Computing , 2017, 1702.04298.

[137]  Danilo P. Mandic,et al.  Quaternion-Valued Echo State Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[138]  Stefano Nichele,et al.  Reservoir Computing Using Nonuniform Binary Cellular Automata , 2017, Complex Syst..

[139]  L. Abbott,et al.  From fixed points to chaos: Three models of delayed discrimination , 2013, Progress in Neurobiology.

[140]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[141]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[142]  Razvan Pascanu,et al.  A neurodynamical model for working memory , 2011, Neural Networks.

[143]  Dhireesha Kudithipudi,et al.  Memristive Reservoir Computing Architecture for Epileptic Seizure Detection , 2014, BICA.

[144]  Benjamin Schrauwen,et al.  Realization of a passive compliant robot dog , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[145]  Christof Teuscher,et al.  Memcapacitive reservoir computing , 2017, 2017 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[146]  A. Thomas,et al.  Memristor-based neural networks , 2013 .

[147]  M. Rapoport,et al.  The role of the cerebellum in cognition and behavior: a selective review. , 2000, The Journal of neuropsychiatry and clinical neurosciences.

[148]  Yasuo Kuniyoshi,et al.  Environmental and Structural Effects on Physical Reservoir Computing with Tensegrity , 2017 .

[149]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[150]  M Lakshmanan,et al.  The fascinating world of the Landau–Lifshitz–Gilbert equation: an overview , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[151]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[152]  José Carlos Príncipe,et al.  Special issue on echo state networks and liquid state machines , 2007, Neural Networks.

[153]  Jochen J. Steil,et al.  Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning , 2007, Neural Networks.

[154]  Yiannis Demiris,et al.  Iterative temporal learning and prediction with the sparse online echo state gaussian process , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[155]  Peng Li,et al.  Performance and robustness of bio-inspired digital liquid state machines: A case study of speech recognition , 2017, Neurocomputing.

[156]  Gouhei Tanaka,et al.  Reservoir Computing With Spin Waves Excited in a Garnet Film , 2018, IEEE Access.

[157]  Toshiyuki Yamane,et al.  Spatially Arranged Sparse Recurrent Neural Networks for Energy Efficient Associative Memory , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[158]  Laurent Larger,et al.  High-Speed Photonic Reservoir Computing Using a Time-Delay-Based Architecture: Million Words per Second Classification , 2017 .

[159]  Benjamin Schrauwen,et al.  Reservoir Computing with Stochastic Bitstream Neurons , 2005 .

[160]  Tadashi Yamazaki,et al.  The cerebellum as a liquid state machine , 2007, Neural Networks.

[161]  Jan Danckaert,et al.  Constructing optimized binary masks for reservoir computing with delay systems , 2014, Scientific Reports.

[162]  Damien Rontani,et al.  Chaotic dynamics in a macrospin spin-torque nano-oscillator with delayed feedback , 2017, Applied Physics Letters.

[163]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[164]  Miguel C. Soriano,et al.  Minimal approach to neuro-inspired information processing , 2015, Front. Comput. Neurosci..

[165]  Junfei Qiao,et al.  Growing Echo-State Network With Multiple Subreservoirs , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[166]  Serge Massar,et al.  High performance photonic reservoir computer based on a coherently driven passive cavity , 2015, ArXiv.

[167]  Amir Hussain,et al.  Multilayered Echo State Machine: A Novel Architecture and Algorithm , 2017, IEEE Transactions on Cybernetics.

[168]  Hegui Zhu,et al.  Simultaneous recognition of two channels of optical packet headers utilizing reservoir computing subject to mutual-coupling optoelectronic feedback , 2018 .

[169]  Stefan C. Kremer,et al.  Recurrent Neural Networks , 2013, Handbook on Neural Information Processing.

[170]  Susan Stepney,et al.  Reservoir computing in materio: An evaluation of configuration through evolution , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[171]  Qian Wang,et al.  General-purpose LSM learning processor architecture and theoretically guided design space exploration , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[172]  Atsushi Uchida,et al.  Impact of input mask signals on delay-based photonic reservoir computing with semiconductor lasers. , 2018, Optics express.

[173]  Bin Wang,et al.  FPGA based spike-time dependent encoder and reservoir design in neuromorphic computing processors , 2016, Microprocess. Microsystems.

[174]  D. Nakano,et al.  Wave-based neuromorphic computing framework for brain-like energy efficiency and integration , 2015, 2015 IEEE 15th International Conference on Nanotechnology (IEEE-NANO).

[175]  Özgür Yilmaz,et al.  Machine Learning Using Cellular Automata Based Feature Expansion and Reservoir Computing , 2015, J. Cell. Autom..

[176]  Jens Bürger,et al.  Hierarchical composition of memristive networks for real-time computing , 2015, Proceedings of the 2015 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH´15).

[177]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[178]  Marc Haelterman,et al.  Virtualization of a Photonic Reservoir Computer , 2016, Journal of Lightwave Technology.

[179]  Daiju Nakano,et al.  Optoelectronic Reservoir Computing with VCSEL , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[180]  Antonio Politi,et al.  High-dimensional chaos in delayed dynamical systems , 1994 .

[181]  Jian Liu,et al.  Novel Spike based Reservoir Node Design with High Performance Spike Delay Loop , 2016, NANOCOM.

[182]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[183]  Miquel L. Alomar,et al.  Low-cost hardware implementation of Reservoir Computers , 2014, 2014 24th International Workshop on Power and Timing Modeling, Optimization and Simulation (PATMOS).

[184]  Peng Li,et al.  Online Adaptation and Energy Minimization for Hardware Recurrent Spiking Neural Networks , 2018, ACM J. Emerg. Technol. Comput. Syst..

[185]  B. Schrauwen,et al.  BSA, a fast and accurate spike train encoding scheme , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[186]  L Pesquera,et al.  Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. , 2012, Optics express.

[187]  Romain Modeste Nguimdo,et al.  Reducing the phase sensitivity of laser-based optical reservoir computing systems. , 2016, Optics express.

[188]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[189]  Joni Dambre,et al.  Efficient simulation of optical nonlinear cavity circuits , 2015 .

[190]  Mantas Lukosevicius,et al.  A Practical Guide to Applying Echo State Networks , 2012, Neural Networks: Tricks of the Trade.

[191]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[192]  Li Fang,et al.  All-optical reservoir computer based on saturation of absorption. , 2014, Optics express.

[193]  Peter Ford Dominey,et al.  Reservoir Computing Properties of Neural Dynamics in Prefrontal Cortex , 2016, PLoS Comput. Biol..

[194]  Serge Massar,et al.  All-optical Reservoir Computing , 2012, Optics express.

[195]  Hiroya Nakao,et al.  Phase reduction approach to synchronisation of nonlinear oscillators , 2016, 1704.03293.

[196]  Keisuke Fujii,et al.  Boosting Computational Power through Spatial Multiplexing in Quantum Reservoir Computing , 2018, Physical Review Applied.

[197]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[198]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[199]  Toshiyuki Yamane,et al.  Exploiting Heterogeneous Units for Reservoir Computing with Simple Architecture , 2016, ICONIP.

[200]  Jan Danckaert,et al.  Delay-Based Reservoir Computing: Noise Effects in a Combined Analog and Digital Implementation , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[201]  Philippe Vincent-Lamarre,et al.  Driving reservoir models with oscillations: a solution to the extreme structural sensitivity of chaotic networks , 2016, Journal of Computational Neuroscience.

[202]  Eris Chinellato,et al.  Which model to use for the Liquid State Machine? , 2009, 2009 International Joint Conference on Neural Networks.

[203]  Yang Yi,et al.  Analog hardware implementation of spike-based delayed feedback reservoir computing system , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[204]  Daiju Nakano,et al.  Polymer Waveguide-Based Reservoir Computing , 2017, ICONIP.

[205]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .

[206]  Gouhei Tanaka,et al.  Reservoir Computing with Untrained Convolutional Neural Networks for Image Recognition , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[207]  Indranil Saha,et al.  journal homepage: www.elsevier.com/locate/neucom , 2022 .

[208]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[209]  Adonis Bogris,et al.  High-speed all-optical pattern recognition of dispersive Fourier images through a photonic reservoir computing subsystem. , 2015, Optics letters.

[210]  Qian Wang,et al.  Energy efficient parallel neuromorphic architectures with approximate arithmetic on FPGA , 2017, Neurocomputing.

[211]  R. Williams,et al.  How We Found The Missing Memristor , 2008, IEEE Spectrum.

[212]  Nicholas Soures,et al.  Digital neuromorphic design of a Liquid State Machine for real-time processing , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[213]  Benjamin Schrauwen,et al.  Connectivity, Dynamics, and Memory in Reservoir Computing with Binary and Analog Neurons , 2010, Neural Computation.

[214]  M. C. Soriano,et al.  Advances in photonic reservoir computing , 2017 .

[215]  Grzegorz M. Wójcik,et al.  Liquid state machine and its separation ability as function of electrical parameters of cell , 2007, Neurocomputing.

[216]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[217]  Toshiyuki Yamane,et al.  Photonic Reservoir Computing Based on Laser Dynamics with External Feedback , 2016, ICONIP.

[218]  Sarah Uvin,et al.  Low-Loss Photonic Reservoir Computing with Multimode Photonic Integrated Circuits , 2018, Scientific Reports.

[219]  S. Barry Cooper,et al.  Computability In Context: Computation and Logic in the Real World , 2009 .

[220]  G. F. Tremblay,et al.  The Prefrontal Cortex , 1989, Neurology.

[221]  Özgür Yilmaz,et al.  Symbolic Computation Using Cellular Automata-Based Hyperdimensional Computing , 2015, Neural Computation.

[222]  L.O. Chua,et al.  Memristive devices and systems , 1976, Proceedings of the IEEE.

[223]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[224]  Alireza Goudarzi,et al.  DNA Reservoir Computing: A Novel Molecular Computing Approach , 2013, DNA.

[225]  M M Merzenich,et al.  Temporal information transformed into a spatial code by a neural network with realistic properties , 1995, Science.

[226]  Benjamin Schrauwen,et al.  Parallel Reservoir Computing Using Optical Amplifiers , 2011, IEEE Transactions on Neural Networks.

[227]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[228]  Luis Pesquera,et al.  Reservoir Computing with an Ensemble of Time-Delay Reservoirs , 2017, Cognitive Computation.

[229]  Masanobu Inubushi,et al.  Reservoir Computing Beyond Memory-Nonlinearity Trade-off , 2017, Scientific Reports.

[230]  Josep L. Rosselló,et al.  FPGA-Based Stochastic Echo State Networks for Time-Series Forecasting , 2015, Comput. Intell. Neurosci..

[231]  Toshiyuki Yamane,et al.  Wave-Based Reservoir Computing by Synchronization of Coupled Oscillators , 2015, ICONIP.

[232]  Suman Datta,et al.  Computing with dynamical systems based on insulator-metal-transition oscillators , 2016, ArXiv.

[233]  Alois Knoll,et al.  Neuromorphic implementations of neurobiological learning algorithms for spiking neural networks , 2015, Neural Networks.

[234]  Helmut Hauser,et al.  Exploiting short-term memory in soft body dynamics as a computational resource , 2014, Journal of The Royal Society Interface.

[235]  Douglas J. Bakkum,et al.  Revealing neuronal function through microelectrode array recordings , 2015, Front. Neurosci..

[236]  Eduardo Ros,et al.  Modeling the Cerebellar Microcircuit: New Strategies for a Long-Standing Issue , 2016, Front. Cell. Neurosci..

[237]  Ying Chang,et al.  Optical packet header identification utilizing an all-optical feedback chaotic reservoir computing , 2016 .

[238]  Kanzaki Ryohei,et al.  Reservoir computing with dissociated neuronal culture , 2016 .

[239]  Helmut Hauser,et al.  Spine dynamics as a computational resource in spine-driven quadruped locomotion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[240]  L. Chua Memristor-The missing circuit element , 1971 .

[241]  Conrad D. James,et al.  A novel digital neuromorphic architecture efficiently facilitating complex synaptic response functions applied to liquid state machines , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[242]  M. C. Soriano,et al.  Information Processing Using Transient Dynamics of Semiconductor Lasers Subject to Delayed Feedback , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[243]  W. Singer,et al.  Distributed Fading Memory for Stimulus Properties in the Primary Visual Cortex , 2009, PLoS biology.

[244]  Peter Ford Dominey,et al.  Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing , 2013, PloS one.

[245]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[246]  Yong Zhang,et al.  A Digital Liquid State Machine With Biologically Inspired Learning and Its Application to Speech Recognition , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[247]  Michiel Hermans,et al.  Online Training of an Opto-Electronic Reservoir Computer Applied to Real-Time Channel Equalization , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[248]  Susan Stepney,et al.  Evolving Carbon Nanotube Reservoir Computers , 2016, UCNC.

[249]  Fang Liu,et al.  Integrated photonic reservoir computing based on hierarchical time-multiplexing structure , 2014, 2015 Conference on Lasers and Electro-Optics (CLEO).

[250]  H. Jaeger,et al.  Unconventional Information Processing Systems , Novel Hardware : A Tour d ’ Horizon , 2017 .

[251]  Stuart A. Wolf,et al.  Spintronics : A Spin-Based Electronics Vision for the Future , 2009 .

[252]  Laurent Larger,et al.  Photonic nonlinear transient computing with multiple-delay wavelength dynamics. , 2012, Physical review letters.

[253]  Dan Wang,et al.  Prediction performance of reservoir computing system based on a semiconductor laser subject to double optical feedback and optical injection. , 2018, Optics express.

[254]  Peter Ford Dominey Complex sensory-motor sequence learning based on recurrent state representation and reinforcement learning , 1995, Biological Cybernetics.

[255]  Tao Li,et al.  Information processing via physical soft body , 2015, Scientific Reports.

[256]  George Bourianoff,et al.  Potential implementation of reservoir computing models based on magnetic skyrmions , 2017, 1709.08911.

[257]  Ingo Fischer,et al.  High-Speed Optical Vector and Matrix Operations Using a Semiconductor Laser , 2013, IEEE Photonics Technology Letters.

[258]  Benjamin Schrauwen,et al.  An overview of reservoir computing: theory, applications and implementations , 2007, ESANN.

[259]  Oliver Obst,et al.  Nano-scale reservoir computing , 2013, 2013 IEEE International Conference on Communications Workshops (ICC).

[260]  Dhireesha Kudithipudi,et al.  Reconfigurable Digital Design of a Liquid State Machine for Spatio-Temporal Data , 2016, NANOCOM.

[261]  Miguel C. Soriano,et al.  Reservoir computing with a single time-delay autonomous Boolean node , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[262]  L. Larger,et al.  Optoelectronic reservoir computing: tackling noise-induced performance degradation. , 2013, Optics express.

[263]  Xiao Yang,et al.  Investigations of the staircase memristor model and applications of memristor-based local connections , 2016 .

[264]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[265]  Benjamin Schrauwen,et al.  Nanophotonic Reservoir Computing With Photonic Crystal Cavities to Generate Periodic Patterns , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[266]  M. C. Soriano,et al.  A Unified Framework for Reservoir Computing and Extreme Learning Machines based on a Single Time-delayed Neuron , 2015, Scientific Reports.

[267]  Jihan Zhu,et al.  FPGA Implementations of Neural Networks - A Survey of a Decade of Progress , 2003, FPL.

[268]  Yiran Chen,et al.  Hardware implementation of echo state networks using memristor double crossbar arrays , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[269]  Lambert Schomaker Simulation and recognition of handwriting movements: a vertical approach to modeling human motor behavior , 1991 .

[270]  Kevin G. Kirby,et al.  The Neurodynamics Of Context Reverberation Learning , 1990, [1990] Proceedings of the Twelfth Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[271]  Helmut Hauser,et al.  Morphological computation-based control of a modular, pneumatically driven, soft robotic arm , 2018, Adv. Robotics.

[272]  WangQian,et al.  Energy efficient parallel neuromorphic architectures with approximate arithmetic on FPGA , 2017 .

[273]  Laurent Larger,et al.  Reinforcement Learning in a large scale photonic Recurrent Neural Network , 2017, Optica.

[274]  Kenji Doya,et al.  Recurrent networks: supervised learning , 1998 .

[275]  Julien Sylvestre,et al.  Computing with networks of nonlinear mechanical oscillators , 2017, PloS one.

[276]  Laurent Larger,et al.  Tutorial: Photonic Neural Networks in Delay Systems , 2018, Journal of Applied Physics.