Spoken language identification based on optimised genetic algorithm–extreme learning machine approach

The determination and classification of a recognized spoken language based on certain contents and datasets is known as the process of language identification (LID). The common process in carrying out LID entails the mandatory processing of data which enables the extraction of the necessary features for the process. The extraction involves a mature process whereby the development of the standard LID features have been conducted much earlier by means of a mel-frequency cepstral coefficients, shifted delta cepstral, Gaussian mixture model and i-vector-based framework. Despite that, improvement or rather optimisation still needs to be done on the learning process based on the extracted features so as to obtain all the knowledge embedded within them. The classification and regression analysis can benefit tremendously from the use of the extreme learning machine (ELM) which is a particularly effective and useful learning model for training a single-hidden layer neural network. However, owing to the randomly selected weights embedded in the input’s hidden layers, the model’s learning process is rendered to be ineffective or not optimised in its entirety. In this study, the ELM is employed as the learning model for LID due to the standard feature extraction. In addition, this study proposes a new optimised genetic algorithm (OGA) with three different selection criteria (i.e., roulette wheel, K-tournament and random) to select the appropriate initial weights and biases of the input hidden layer of the ELM, thereby minimising the classification error and improving the general performance of the ELM for LID. Results show the excellent performance of the proposed OGA–ELM with three different selection criteria, namely, roulette wheel, K-tournament and random, with the highest accuracies of 99.50%, 100% and 99.38%, respectively.

[1]  Musatafa Abbas Abbood Albadr,et al.  Extreme learning machine: A review , 2017 .

[2]  Yuan Lan,et al.  An extreme learning machine approach for speaker recognition , 2012, Neural Computing and Applications.

[3]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[4]  Zhiyong Yang,et al.  A novel algorithm with differential evolution and coral reef optimization for extreme learning machine training , 2016, Cognitive Neurodynamics.

[5]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[6]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[7]  Jayanna Kanchikere,et al.  An efficient face recognition system based on hybrid optimized KELM , 2019, Multimedia Tools and Applications.

[8]  Ryan Hafen,et al.  Speech information retrieval: a review , 2012, Multimedia Systems.

[9]  Fahad Taha Al-Dhief,et al.  Spoken language identification based on the enhanced self-adjusting extreme learning machine approach , 2018, PloS one.

[10]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[11]  Jia Liu,et al.  Regularized minimum class variance extreme learning machine for language recognition , 2015, EURASIP J. Audio Speech Music. Process..

[12]  R. Thangarajan,et al.  RTS-ELM: an approach for saliency-directed image segmentation with ripplet transform , 2019, Pattern Analysis and Applications.

[13]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  Grégoire Lefebvre,et al.  Recognizing Human Actions based on Extreme Learning Machines , 2016, VISIGRAPP.

[16]  J. Gonzalez-Dominguez,et al.  Language Identification in Short Utterances Using Long Short-Term Memory (LSTM) Recurrent Neural Networks , 2016, PloS one.

[17]  Geoffrey Zweig,et al.  LSTM time and frequency recurrence for automatic speech recognition , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[18]  Bing Liu,et al.  Manifold regularized extreme learning machine , 2015, Neural Computing and Applications.

[19]  Pradipta Kishore Dash,et al.  Comparison of modified teaching–learning-based optimization and extreme learning machine for classification of multiple power signal disturbances , 2015, Neural Computing and Applications.

[20]  Yunpeng Ma,et al.  A Kind of Parameters Self-adjusting Extreme Learning Machine , 2016, Neural Processing Letters.

[21]  Jie Tian,et al.  Mathematical method in optical molecular imaging , 2014, Science China Information Sciences.

[22]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[23]  Victor Parada,et al.  Automatic Combination of Operators in a Genetic Algorithm to Solve the Traveling Salesman Problem , 2015, PloS one.

[24]  Chakchai So-In,et al.  Histogram equalized deep PCA with ELM classification for expressive face recognition , 2018, 2018 International Workshop on Advanced Image Technology (IWAIT).

[25]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[26]  Marghny H. Mohamed,et al.  Rules extraction from constructively trained neural networks based on genetic algorithms , 2011, Neurocomputing.

[27]  Jia Xu,et al.  Extreme learning machines: new trends and applications , 2014, Science China Information Sciences.

[28]  Alexandros Iosifidis,et al.  Graph Embedded Extreme Learning Machine , 2016, IEEE Transactions on Cybernetics.

[29]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[30]  Lirong Dai,et al.  Deep Bottleneck Features for Spoken Language Identification , 2014, PloS one.

[31]  Sazali Yaacob,et al.  Improved Emotion Recognition Using Gaussian Mixture Model and Extreme Learning Machine in Speech and Glottal Signals , 2015 .

[32]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[33]  Vishal Gupta,et al.  A Survey of Language Identification Techniques and Applications , 2014 .

[34]  Magnus Westerlund,et al.  Using extreme learning machine for intrusion detection in a big data environment , 2014, AISec '14.

[35]  Norliza Mohd. Noor,et al.  A novel extreme learning machine-based cryptography system , 2016, Secur. Commun. Networks.

[36]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Chengpeng Bi,et al.  Deterministic local alignment methods improved by a simple genetic algorithm , 2010, Neurocomputing.

[38]  Dong Yu,et al.  Speech emotion recognition using deep neural network and extreme learning machine , 2014, INTERSPEECH.

[39]  Feilong Cao,et al.  A study on effectiveness of extreme learning machine , 2011, Neurocomputing.