Implementation of HMM based automatic video classification algorithm on the embedded platform

This paper deals with the implementation of HMM based video classification algorithm using color feature vector on the open source BeagleBoard mobile platform. To simplify the development of video IO interfaces to the processor running the algorithm, we first choose the BeagleBoard-xM, a low-cost, low-power, portable computer with a Cortex-A8 processor with a speed of 1GHz. The algorithm uses color feature vector with HMM as a classifier to classify videos into different genres. Video classification task can be often treated as a primary step for many other applications including data organization and maintenance, search, retrieval and so on. Most of the existing work includes only implementations on general purpose processors which are inadequate to meet the performance requirements of machine vision applications. For mobile platforms, the algorithms need to be implemented on embedded hardware to meet the requirements like size, power, cost etc. Various optimization techniques such as key frame extraction and feature extraction that are carried out to allow the execution of the algorithm are discussed. It further leads to efficient video browsing and retrieval strategies on mobile platforms. Experimental results obtained from the implementation of the video classification task on the ARM- based computing platform BeagleBoard-xM, showed that the classification efficiency of 89.33% was achieved.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  Ary Setijadi Prihatmanto,et al.  Design and implementation audio processing in Angstrom beagleboard , 2013, 2013 Joint International Conference on Rural Information & Communication Technology and Electric-Vehicle Technology (rICT & ICeV-T).

[3]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[4]  David S. Doermann,et al.  Identifying sports videos using replay, text, and camera motion features , 1999, Electronic Imaging.

[5]  Katie Roberts-Hoffman,et al.  ARM Cortex-A 8 vs . Intel Atom : Architectural and Benchmark Comparisons , .

[6]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[7]  J. Fan,et al.  Semantic video classification and feature subset selection under context and concept uncertainty , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[8]  Tsuhan Chen,et al.  Audio Feature Extraction and Analysis for Scene Segmentation and Classification , 1998, J. VLSI Signal Process..

[9]  Sung Wook Baik,et al.  Weighting low level frame difference features for key frame extraction using Fuzzy comprehensive evaluation and indirect feedback relevance mechanism , 2011 .

[10]  Charles A. Poynton,et al.  A technical introduction to digital video , 1996 .

[11]  Diane J. Cook,et al.  Automatic Video Classification: A Survey of the Literature , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  Jacques Facon,et al.  Fast Hue-Preserving Histogram Equalization Methods For Color Image Contrast Enhancement , 2012 .

[13]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .