A massively parallel implementation of pattern classifiers on SIMD and MIMD architectures

Parallel multi-layer classifier architectures with an increasing hierarchical order have offered much flexibility in design to deal with a wide variety of properties. The model of pipeline processing is especially appropriate for realising such architectures. This has provided hierarchical classifiers a distinct advantage in real-time applications to cope with the important demand for high operating speed, in addition to a potentially better classification performance. An example application of a cascaded form of the BWS and FWS networks, both of which are representatives of the array memory based statistical classifier is described in this paper. As with most pipelined architectures, the complex interactions between successive processing layers of the cascaded network represent a major drawback, and they impose performance bottlenecks which challenge the use of a highly parallel realisation of the classifier. This paper describes an efficient data parallel implementation of the BWS-FWS. For completeness, a brief review of the multi-layer classifiers is first presented. The new algorithm for combining the BWS and FWS networks is described and implemented on two distributed memory processor arrays, the MasPar MP-1 and a network of transputers. An analysis of the performance obtained is also presented.<<ETX>>

[1]  Lawrence R. Rabiner,et al.  Isolated word recognition using a two-pass pattern recognition approach , 1981, ICASSP.

[2]  Michael C. Fairhurst,et al.  Parallel multi-layer classifier architectures of increasing hierarchical order , 1993, Pattern Recognit. Lett..

[3]  Michael C. Fairhurst,et al.  Performance comparisons in hierarchical architectures for memory network pattern classifiers , 1986, Pattern Recognit. Lett..

[4]  Michael C. Fairhurst,et al.  A two-layer memory network architecture for a pattern classifier , 1983, Pattern Recognit. Lett..

[5]  Michael Fairhurst,et al.  Configuration selection for two-layer memory network pattern classifiers , 1985 .

[6]  W. Daniel Hillis,et al.  Data parallel algorithms , 1986, CACM.

[7]  Tom Blank,et al.  The MasPar MP-1 architecture , 1990, Digest of Papers Compcon Spring '90. Thirty-Fifth IEEE Computer Society International Conference on Intellectual Leverage.

[8]  W. W. Bledsoe,et al.  Pattern recognition and reading by machine , 1959, IRE-AIEE-ACM '59 (Eastern).

[9]  K. P. Lam,et al.  A machine independent approach to parallel algorithm design on image computation , 1990, IEEE TENCON'90: 1990 IEEE Region 10 Conference on Computer and Communication Systems. Conference Proceedings.

[10]  Michael C. Fairhurst,et al.  Stabilisation of error-rate performance in frequency-weighted memory network pattern classifiers , 1989, Pattern Recognit. Lett..

[11]  W. W. Bledsoe,et al.  Improved Memory Matrices for the n-Tuple Pattern Recognition Method , 1962, IRE Trans. Electron. Comput..

[12]  King-Sun Fu,et al.  Automated classification of nucleated blood cells using a binary tree classifier , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  S. F. Reddaway DAP—a distributed array processor , 1973, ISCA 1973.

[14]  L. Rabiner,et al.  A two-pass pattern-recognition approach to isolated word recognition , 1981, The Bell System Technical Journal.

[15]  Kong-Peng Lam,et al.  Novel Technique To Combine Bws And Fws Classifiers , 1993 .