Combine Approach for Speech and Gesture Recognition

Gesture and Speech based human Computer interaction is attractive attention across various areas such as pattern recognition, computer vision. Thus kind of research areas find many kind of application in Multimodal HCI, Robotics control, Sign language recognition. This paper presents head and hand Gesture as well as Speech recognition system for human computer interaction (HCI).This kind of vision based system can show the capability of computer. Which understand and responding to the hand and head gesture also for Speech in form of sentence. This recognition system consists of two main modules namely 1.Gesture recognition 2.Speech recognition, Gesture recognition consists of various phases. i. image capturing, ii. Feature extraction of gesture iii. Gesture modeling (Direction, Position, generalized), 2.Speech recognition consists of various phases i. taking voice signals ii. Spectral coding iii. Unit matching (BMU) iv. Lexical decoding v. syntactic, semantic analysis. Compared with many existing algorithms for gesture and speech recognition.

[1]  Nikos Papamarkos,et al.  A New Technique for Hand Gesture Recognition , 2006, 2006 International Conference on Image Processing.

[2]  Jagdish Lal Raheja,et al.  Principal Component Analysis for Gesture Recognition Using SystemC , 2009, 2009 International Conference on Advances in Recent Technologies in Communication and Computing.

[3]  Eung-Joo Lee,et al.  Hand Gesture Recognition Using Neural Network , 2007 .

[4]  Yu Shi,et al.  Developing a smart camera for gesture recognition in HCI applications , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[5]  Wayne H. Ward,et al.  Speech recognition , 1997 .

[6]  T. Martin McGinnity,et al.  Object recognition based on tactile form perception , 2011, 2011 IEEE Workshop on Robotic Intelligence In Informationally Structured Space.

[7]  Chengdong Wu,et al.  Dynamic hand gesture recognition using motion trajectories and key frames , 2010, 2010 2nd International Conference on Advanced Computer Control.

[8]  Chetan A. Burande,et al.  Advanced recognition techniques for human computer interaction , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[9]  Kostas Karpouzis,et al.  SOMM: Self organizing Markov map for gesture recognition , 2010, Pattern Recognit. Lett..

[10]  Jong Kyoung Kim,et al.  Speech recognition , 1983, 1983 IEEE International Solid-State Circuits Conference. Digest of Technical Papers.

[11]  Jagdish Lal Raheja,et al.  Real-Time Robotic Hand Control Using Hand Gestures , 2010, 2010 Second International Conference on Machine Learning and Computing.

[12]  Tamer Shanableh,et al.  Spatio-Temporal Feature-Extraction Techniques for Isolated Gesture Recognition in Arabic Sign Language , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  G.R.S. Murthy,et al.  Hand gesture recognition using neural networks , 2010, 2010 IEEE 2nd International Advance Computing Conference (IACC).