Efficient implementation of Gaussian Mixture Models using vote count circuit

Vote count (VC) is a fast search algorithm originally designed for similarity search on large scale data set. VC can be efficiently implemented using simple modification to the Random Access Memory (RAM) or other memory structures such as NOR or NAND Flash memory, such that the search complexity reduces to O(1) regardless of the dimensionality of data or the size of the data set. This paper proposes a low complexity implementation for the posterior probability calculation of Gaussian Mixture Models (GMM) using the VC circuit. The performance of the proposed implementation is evaluated in terms of both accuracy of the posterior probability calculation, and classification error rate if GMM is used as a classifier.

[1]  Getao Liang,et al.  ARITHMETIC LOGIC UNIT ARCHITECTURES WITH DYNAMICALLY DEFINED PRECISION , 2015 .

[2]  Yu Rongshan,et al.  High-performance, very low power content-based search engine , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[3]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[4]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[5]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[6]  Douglas A. Reynolds,et al.  Robust text-independent speaker identification using Gaussian mixture speaker models , 1995, IEEE Trans. Speech Audio Process..

[7]  Mark J. F. Gales,et al.  The Application of Hidden Markov Models in Speech Recognition , 2007, Found. Trends Signal Process..

[8]  Ton Kalker,et al.  A Highly Robust Audio Fingerprinting System , 2002, ISMIR.

[9]  Amine Bermak,et al.  An Efficient Digital VLSI Implementation of Gaussian Mixture Models-Based Classifier , 2006, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[10]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[11]  Haim H. Permuter,et al.  A study of Gaussian mixture models of color and texture features for image classification and segmentation , 2006, Pattern Recognit..

[12]  Amir F. Atiya,et al.  Estimating the Posterior Probabilities Using the K-Nearest Neighbor Rule , 2005, Neural Computation.

[13]  Samy Bengio,et al.  User authentication via adapted statistical models of face images , 2006, IEEE Transactions on Signal Processing.

[14]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[15]  Jean-Daniel Boissonnat,et al.  Proceedings of the twentieth annual symposium on Computational geometry , 2004, SoCG 2004.

[16]  Adrian E. Raftery,et al.  Model-based clustering and data transformations for gene expression data , 2001, Bioinform..

[17]  Wenyu Jiang,et al.  An Algorithm and Hardware Design for Very Fast Similarity Search in High Dimensional Space , 2010, 2010 IEEE International Conference on Granular Computing.

[18]  George Tzanetakis,et al.  Musical genre classification of audio signals , 2002, IEEE Trans. Speech Audio Process..