Web Browser Control Using EMG Based Sub Vocal Speech Recognition

Subvocal electromyogram (EMG) signal classification is used to control a modified web browser interface. Recorded surface signals from the larynx and sublingual areas below the jaw are filtered and transformed into features using a complex dual quad tree wavelet transform. Feature sets for six subvocally pronounced control words, 10 digits, 17 vowel phonemes and 23 consonant phonemes are trained using a scaled conjugate gradient neural network. The subvocal signals are classified and used to initiate web browser queries through a matrix based alphabet coding scheme. Hyperlinks on web pages returned by the browser are numbered sequentially and queried using digits only. Classification methodology, accuracy, and feasibility for scale up to real world human machine interface tasks are discussed in the context of vowel and consonant recognition accuracy.

[1]  Glenn E. Prescott,et al.  Wavelet Transform Speech Recognition Using Vector Quantization, Dynamic Time Warping And Artificial , 1994 .

[2]  Chuck,et al.  Sub Auditory Speech Recognition based on EMG/EPG Signals , 2022 .

[3]  A. R. Lurii︠a︡,et al.  Basic Problems of Neurolinguistics , 1976 .

[4]  Minyue Fu,et al.  The use of wavelet transforms in phoneme recognition , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[5]  P. A. Parker,et al.  Improving myoelectric signal classification using wavelet packets and principal components analysis , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[6]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[7]  Peter Norvig,et al.  Bioelectric Control of a 757 Class High Fidelity Aircraft Simulation , 2000 .

[8]  B. Hudgins,et al.  Hidden Markov model classification of myoelectric signals in speech , 2001, IEEE Engineering in Medicine and Biology Magazine.

[9]  L.J. Trejo,et al.  Multimodal neuroelectric interface development , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Alex Acero,et al.  Spoken Language Processing: A Guide to Theory, Algorithm and System Development , 2001 .

[11]  Nick Kingsbury,et al.  The dual-tree complex wavelet transform: a new technique for shift invariance and directional filters , 1998 .

[12]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  D. F. Lovely,et al.  Myo-electric signals to augment speech recognition , 2001, Medical and Biological Engineering and Computing.