Improvement of Variant Adaptable LSTM Trained With Metaheuristic Algorithms for Healthcare Analysis

Recently, the population of the world has increased along with health problems. Diabetes mellitus disease as an example causes issues to the health of many patients globally. The task of this chapter is to develop a dynamic and intelligent decision support system for patients with different diseases, and it aims at examining machine-learning techniques supported by optimization techniques. Artificial neural networks have been used in healthcare for several decades. Most research works utilize multilayer layer perceptron (MLP) trained with back propagation (BP) learning algorithm to achieve diabetes mellitus classification. Nonetheless, MLP has some drawbacks, such as, convergence, which can be slow; local minima can affect the training process. It is hard to scale and cannot be used with time series data sets. To overcome these drawbacks, long short-term memory (LSTM) is suggested, which is a more advanced form of recurrent neural networks. In this chapter, adaptable LSTM trained with two optimizing algorithms instead of the back propagation learning algorithm is presented. The optimization algorithms are biogeography-based optimization (BBO) and genetic algorithm (GA). Dataset is collected locally and another benchmark dataset is used as well. Finally, the datasets fed into adaptable models; LSTM with BBO (LSTMBBO) and LSTM with GA (LSTMGA) for classification purposes. The experimental and testing results are compared and they are promising. This system helps physicians and doctors to provide proper health treatment for patients with diabetes mellitus.

[1]  Kotaro Hirasawa,et al.  A brainlike learning system with supervised, unsupervised, and reinforcement learning , 2008 .

[2]  Uwe Meyer-Bäse,et al.  Artificial implementation of auditory neurons: A comparison of biologically motivated models and a new transfer function oriented model , 1997, Biological Cybernetics.

[3]  George C. Anastassopoulos,et al.  Genetic algorithm pruning of probabilistic neural networks in medical disease estimation , 2011, Neural Networks.

[4]  Jürgen Schmidhuber,et al.  Discovering Neural Nets with Low Kolmogorov Complexity and High Generalization Capability , 1997, Neural Networks.

[5]  Jocelyn Sietsma,et al.  Creating artificial neural networks that generalize , 1991, Neural Networks.

[6]  M. Gomes,et al.  Temporal changes in the diagnosis of type 1 diabetes by diabetic ketoacidosis in Brazil: A nationwide survey , 2012, Diabetic medicine : a journal of the British Diabetic Association.

[7]  Kunihiko Fukushima,et al.  Artificial vision by multi-layered neural networks: Neocognitron and its advances , 2013, Neural Networks.

[8]  César Hervás-Martínez,et al.  An alternative approach for neural network evolution with a genetic algorithm: Crossover by combinatorial optimization , 2006, Neural Networks.

[9]  Murali S. Shanker,et al.  Using Neural Networks To Predict the Onset of Diabetes Mellitus , 1996, J. Chem. Inf. Comput. Sci..

[10]  Hyeyoung Park,et al.  Part 2: Multilayer perceptron and natural gradient learning , 2009, New Generation Computing.

[11]  Mang-Hui Wang,et al.  Extension neural network-type 2 and its applications , 2005, IEEE Transactions on Neural Networks.

[12]  Takatoshi Nagai,et al.  Artificial neural networks estimate the contribution of taste neurons to coding , 2000, Physiology & Behavior.

[13]  Kostantin P. Nikolic,et al.  Stochastic Search Algorithms for Identification, Optimization, and Training of Artificial Neural Networks , 2015, Adv. Artif. Neural Syst..

[14]  Kazuyuki Murase,et al.  A new algorithm to design compact two-hidden-layer artificial neural networks , 2001, Neural Networks.

[15]  Tarik A. Rashid,et al.  A Hybrid of Artificial Bee Colony, Genetic Algorithm, and Neural Network for Diabetic Mellitus Diagnosing , 2018, ARO-The Scientific Journal of Koya University.

[16]  Malinda Peeples,et al.  Hypoglycemia Prediction Using Machine Learning Models for Patients With Type 2 Diabetes , 2014, Journal of diabetes science and technology.

[17]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Satvir Singh,et al.  Yagi-Uda Antenna Design Optimization for Maximum Gain using different BBO Migration Variants , 2012 .

[19]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[20]  R C Atkinson,et al.  Effects of short-term memory contents on short-and long-term memory searches , 1973, Memory & cognition.

[21]  Janez Bester,et al.  Introduction to the Artificial Neural Networks , 2011 .

[22]  Jinglu Hu,et al.  A Brain-like Learning System with Supervised, Unsupervised and Reinforcement Learning , 2006 .

[23]  S. Gharibzadeh,et al.  The chaotic nature of temper in humans: a long short-term memory recurrent neural network model. , 2006, Medical hypotheses.

[24]  Raj Aggarwal,et al.  Artificial neural networks in power systems. I. General introduction to neural computing , 1997 .

[25]  David J. Hand,et al.  Measuring classifier performance: a coherent alternative to the area under the ROC curve , 2009, Machine Learning.