Human Activity Recognition Using Mixture of Gaussians and Pair-wise Oriented Local Binary Pattern

Tracking and recognizing human activities from video is a very challenging task in the field of Computer Vision. In this paper, we aim to recognize human activities by coping with the existing challenges. At first, the background and the foreground of images in videos are detected using the mixture of Gaussian distributions and the binary silhouette images are obtained. We propose a feature descriptor named Pair-wise Oriented Local Binary Pattern (POLBP) and an improved version of DLBP feature descriptor for images. POLBP is capable of encoding more information than intensity differences of LBP by incorporating orientation information with the intensity difference. This Pair-wise Oriented Local Binary Pattern (POLBP) extracts local orientation information from binary silhouette images. These feature vectors are sent to Support Vector Machine (SVM) classifier for classification. The proposed method has been used in the area of Human Activity Recognition (HAR) and the result of recognition rate is very encouraging.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[3]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Shuang Wang,et al.  A Review on Human Activity Recognition Using Vision-Based Method , 2017, Journal of healthcare engineering.

[5]  Cordelia Schmid,et al.  A Spatio-Temporal Descriptor Based on 3D-Gradients , 2008, BMVC.

[6]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Md. Mahmudul Hasan,et al.  Human activity recognition based on Gaussian mixture model and directive local binary pattern , 2016, 2016 2nd International Conference on Electrical, Computer & Telecommunication Engineering (ICECTE).

[8]  Thomas B. Moeslund,et al.  Introduction to Video and Image Processing , 2012, Undergraduate Topics in Computer Science.

[9]  Jake K. Aggarwal,et al.  Spatio-temporal Depth Cuboid Similarity Feature for Activity Recognition Using Depth Camera , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .