Fast IDS Computing System Method and its Memristor Crossbar-based Hardware Implementation

Active Learning Method (ALM) is one of the powerful tools in soft computing that is inspired by human brain capabilities in processing complicated information. ALM, which is in essence an adaptive fuzzy learning method, models a Multi-Input Single-Output (MISO) system with several Single-Input Single-Output (SISO) subsystems. Ink Drop Spread (IDS) operator, which is the main processing engine of this method, extracts useful features from the data without complicated computations and provides stability and convergence as well. Despite great performance of ALM in applications such as classification, clustering, and modelling, an efficient hardware implementation has remained a challenging problem. Large amount of memory required to store the information of IDS planes as well as the high computational cost of the IDS computing system are two main barriers to ALM becoming more popular. In this paper, a novel learning method is proposed based on the idea of IDS, but with a novel approach that eliminates the computational cost of IDS operator. Unlike traditional approaches, our proposed method finds functions to describe the IDS plane that eliminates the need for large amount of memory to a great extent. Narrow Path and Spread, which are two main features used in the inference engine of ALM, are then extracted from IDS planes with minimum amount of memory usage and power consumption. Our proposed algorithm is fully compatible with memristor-crossbar implementation that leads to a significant decrease in the number of required memristors (from O(n^2) to O(3n)). Simpler algorithm and higher speed make our algorithm suitable for applications where real-time process, low-cost and small implementation are paramount. Applications in clustering and function approximation are provided, which reveals the effective performance of our proposed algorithm.

[1]  Farnood Merrikh-Bayat,et al.  Memristor Crossbar-Based Hardware Implementation of the IDS Method , 2010, IEEE Transactions on Fuzzy Systems.

[2]  R. Waser,et al.  Nanoionics-based resistive switching memories. , 2007, Nature materials.

[3]  Saeed Bagheri Shouraki,et al.  Pattern analysis by active learning method classifier , 2014, J. Intell. Fuzzy Syst..

[4]  Nakaji Honda,et al.  Acquisition of control knowledge of nonholonomic system by Active Learning Method , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[5]  Dalibor Biolek,et al.  SPICE modeling of memristive, memcapacitative and meminductive systems , 2009, 2009 European Conference on Circuit Theory and Design.

[6]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[7]  Lotfi A. Zadeh,et al.  Fuzzy logic, neural networks, and soft computing , 1993, CACM.

[8]  Rene Preusker,et al.  Application of the Active Learning Method for the estimation of geophysical variables in the Caspian Sea from satellite ocean colour observations , 2007 .

[9]  Chia-Feng Juang,et al.  A Type-2 Self-Organizing Neural Fuzzy System and Its FPGA Implementation , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Hesam Sagha,et al.  Actor-critic-based ink drop spread as an intelligent controller , 2013 .

[11]  Saeed Bagheri Shouraki,et al.  A novel hardware implementation of IDS method , 2009, IEICE Electron. Express.

[12]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[13]  Saeed Bagheri Shouraki,et al.  A novel fuzzy approach to modeling and control and its hardware implementation based on brain functionality and specifications , 2000 .

[14]  Masayuki Murakami,et al.  A high performance IDS processing unit for a new fuzzy-based modeling , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[15]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[16]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  L.O. Chua,et al.  Memristive devices and systems , 1976, Proceedings of the IEEE.

[18]  Samiha Mourad,et al.  Digital logic implementation in memristor-based crossbars , 2009, 2009 International Conference on Communications, Circuits and Systems.

[19]  L. Chua Memristor-The missing circuit element , 1971 .

[20]  Bernabé Linares-Barranco,et al.  Spiking neuro-fuzzy clustering system and its memristor crossbar based implementation , 2014, Microelectron. J..

[21]  Ennio Mingolla,et al.  From Synapses to Circuitry: Using Memristive Memory to Explore the Electronic Brain , 2011, Computer.

[22]  Saeed Bagheri Shouraki,et al.  A novel pipeline architecture of replacing Ink Drop Spread , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[23]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[24]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[25]  Farnood Merrikh-Bayat,et al.  Mixed analog-digital crossbar-based hardware implementation of sign–sign LMS adaptive filter , 2011 .

[26]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[27]  Kyungmin Kim,et al.  Memristor-based fine resolution programmable resistance and its applications , 2009, 2009 International Conference on Communications, Circuits and Systems.

[28]  M. Dehghani,et al.  Real-Time IDS Using Reinforcement Learning , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[29]  Blaise Mouttet,et al.  Proposal for Memristors in Signal Processing , 2008, NanoNet.

[30]  Nakaji Honda,et al.  Simulation of brain learning process through a novel fuzzy hardware approach , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[31]  Bernabé Linares-Barranco,et al.  On neuromorphic spiking architectures for asynchronous STDP memristive systems , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[32]  Farnood Merrikh-Bayat,et al.  Memristor-based circuits for performing basic arithmetic operations , 2010, WCIT.

[33]  Massimiliano Di Ventra,et al.  Practical Approach to Programmable Analog Circuits With Memristors , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[34]  Nakaji Honda,et al.  Fuzzy Interpretation of Human Intelligence , 1999, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[35]  S.B. Shouraki,et al.  Genetic Ink Drop Spread , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[36]  Masayuki Murakami,et al.  A study on the modeling ability of the IDS method: A soft computing technique using pattern-based information processing , 2007, Int. J. Approx. Reason..

[37]  Saeed Bagheri Shouraki,et al.  An Optimal Hardware Implementation for Active Learning Method Based on Memristor Crossbar Structures , 2014, IEEE Systems Journal.

[38]  Massimiliano Di Ventra,et al.  Memristive model of amoeba learning. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.