Ballet E-learning using fuzzy set induced posture recognition by piece-wise linear approximation of connected components

Abstract The paper proposes a novel strategy of ballet e-learning for novices in remote areas. The present work is concerned with a training dataset of thirty four different ballet postures, obtained from images of trained dancers. A four-step procedure is primarily followed to extract features from the training images describing a specific posture p. First, the acquired images of K trained dancers of a specific posture p are pre-processed. The connected components (CCs) of the pre-processed images are then identified, followed by piece-wise linear approximation of their respective boundaries. After that, the internal angles of the polygonal boundary are used to characterize features of the given posture. This is repeated for all images of K trained dancers, all performing the given posture p. The merit of the paper lies in recasting the problem of selecting the CC boundary points for polygonal approximation as an optimization problem. The inter-subject uncertainty observed in the feature values extracted from the pre-processed images of a large number of experts/trained dancers, all executing the same posture p, here has been modeled by Gaussian fuzzy membership curve. The class of an unknown posture (obtained from the image of a novice) is determined by computing the support of each known posture class to the given unknown postural expression. The class with the maximum support (above a pre-defined threshold value) is declared as the conqueror. Experiments undertaken reveal that the accuracy of recognizing an unknown ballet posture of a novice, captured by a stereo camera, by the proposed stratagem is as high as 91.23%.

[1]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[2]  Kin Fun Li,et al.  A multimedia tennis instruction system: tracking and classifying swing motions , 2013, Int. J. Space Based Situated Comput..

[3]  Joachim Hornegger,et al.  Gesture recognition with a Time-Of-Flight camera , 2008, Int. J. Intell. Syst. Technol. Appl..

[4]  Keechul Jung,et al.  Recognition-based gesture spotting in video games , 2004, Pattern Recognit. Lett..

[5]  M Buscema,et al.  Back propagation neural networks. , 1998, Substance use & misuse.

[6]  Ralf Salomon,et al.  Gesture recognition for virtual reality applications using data gloves and neural networks , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[7]  Pratyusha Rakshit,et al.  Artificial Bee Colony induced multi-objective optimization in presence of noise , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[8]  Amy LaViers,et al.  Automatic Sequencing of Ballet Poses , 2011, IEEE Robotics & Automation Magazine.

[9]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[10]  Petros Maragos,et al.  Morphological skeleton representation and coding of binary images , 1984, IEEE Trans. Acoust. Speech Signal Process..

[11]  Samiul Monir,et al.  Rotation and scale invariant posture recognition using Microsoft Kinect skeletal tracking feature , 2012, 2012 12th International Conference on Intelligent Systems Design and Applications (ISDA).

[12]  S. Deans The Radon Transform and Some of Its Applications , 1983 .

[13]  David C. Hogg,et al.  An efficient method for contour tracking using active shape models , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[14]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[16]  Sriparna Saha,et al.  Topomorphological approach to automatic posture recognition in ballet dance , 2015, IET Image Process..

[17]  Ranjan Sahoo Rashmi,et al.  Navigational Path Planning of Multi-Robot using Honey Bee Mating Optimization Algorithm (HBMO) , 2011 .

[18]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[19]  Nabil Zerrouki,et al.  Automatic Classification of Human Body Postures Based on the Truncated SVD , 2014 .

[20]  Shigeki Yokoi,et al.  Automatic composition and simulation system for ballet sequences , 2006, 2006 International Conference on Cyberworlds.

[21]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[22]  Marc Van Droogenbroeck,et al.  Fast computation of morphological operations with arbitrary structuring elements , 1996, Pattern Recognit. Lett..

[23]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[24]  Sriparna Saha,et al.  A novel approach to posture recognition of ballet dance , 2014, 2014 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT).

[25]  Pratyusha Rakshit,et al.  Non-dominated Sorting Bee Colony optimization in the presence of noise , 2016, Soft Comput..

[26]  Chia-Feng Juang,et al.  Vision-based human body posture recognition using support vector machines , 2012, 4th International Conference on Awareness Science and Technology.

[27]  Tatsushi Tokuyasu,et al.  Training system for endoscopic surgery with haptic guide function and augmented reality , 2015, Int. J. Space Based Situated Comput..

[28]  Gang Qian,et al.  Dance posture recognition using wide-baseline orthogonal stereo cameras , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[29]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[30]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Hyun Gook Kang,et al.  Human body posture recognition with discrete cosine transform , 2016, 2016 International Conference on Big Data and Smart Computing (BigComp).

[32]  P. Scott,et al.  The geometries of 3-manifolds , 1983 .

[33]  Hanan Samet,et al.  Connected Component Labeling Using Quadtrees , 1981, JACM.

[34]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[35]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[36]  Lei Yang,et al.  An improved Sobel edge detection , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[37]  Tung-Po Lin,et al.  The Power Mean and the Logarithmic Mean , 1974 .

[38]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[39]  Leif E. Peterson K-nearest neighbor , 2009, Scholarpedia.

[40]  Suphakant Phimoltares,et al.  Posture recognition invariant to background, cloth textures, body size, and camera distance using morphological geometry , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[41]  Duc Truong Pham,et al.  A modified bees algorithm and a statistics-based method for tuning its parameters , 2012, J. Syst. Control. Eng..

[42]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems , 2007, IFSA.

[43]  Pratyusha Rakshit,et al.  Adaptive Firefly Algorithm for nonholonomic motion planning of car-like system , 2013, 2013 IEEE Congress on Evolutionary Computation.

[45]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[46]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[47]  Shan Suthaharan,et al.  Support Vector Machine , 2016 .