Artificial neural networks: a review of commercial hardware

Artificial neural networks (ANN) became a common solution for a wide variety of problems in many fields, such as control and pattern recognition to name but a few. Many solutions found in these and other ANN fields have reached a hardware implementation phase, either commercial or with prototypes. The most frequent solution for the implementation of ANN consists of training and implementing the ANN within a computer. Nevertheless this solution might be unsuitable because of its cost or its limited speed. The implementation might be too expensive because of the computer and too slow when implemented in software. In both cases dedicated hardware can be an interesting solution. The necessity of dedicated hardware might not imply building the hardware since in the last two decades several commercial hardware solutions that can be used in the implementation have reached the market. Unfortunately not every integrated circuit will fit the needs: some will use lower precision, some will implement only certain types of networks, some don't have training built in and the information is not easy to find. This article is confined to reporting the commercial chips that have been developed specifically for ANN, leaving out other solutions. This option has been made because most of the other solutions are based on cards which are built either with these chips, Digital Signal Processors or Reduced Instruction Set Computers.

[1]  Jan N. H. Heemskerk Overview of neural hardware , 1995 .

[2]  Mark A. Holler,et al.  VLSI Implementations of Learning and Memory Systems: A Review , 1990, NIPS 1990.

[3]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[4]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Clark S. Lindsey,et al.  Review of hardware neural networks: A User's perspective , 1994 .

[6]  Paolo Ienne,et al.  Digital systems for neural networks , 1995, Defense + Commercial Sensing.

[7]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[8]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[9]  Mikael Taveniku,et al.  A reconfigurable SIMD computer for artificial neural networks , 1995 .

[10]  Alexandre Mota,et al.  Comparison between different Control Strategies using Neural Networks , 2001 .

[11]  Raúl Rojas,et al.  Hardware for Neural Networks , 1996 .

[12]  Heinrich Klar,et al.  Digital Neurohardware: Principles and Perspectives , 1998 .

[13]  E. van Keulen,et al.  Neural network hardware performance criteria , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[14]  Joshua Alspector,et al.  Experimental Evaluation of Learning in a Neural Microsystem , 1991, NIPS.

[15]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[16]  Clark S. Lindsey,et al.  Survey of neural network hardware , 1995, SPIE Defense + Commercial Sensing.