Initial Optimal Parameters of Artificial Neural Network and Support Vector Regression

This paper presents architecture of backpropagation Artificial Neural Network (ANN) and Support Vector Regression (SVR) models in supervised learning process for cement demand dataset. This study aims to identify the effectiveness of each parameter of mean square error (MSE) indicators for time series dataset. The study varies different random sample in each demand parameter in the network of ANN and support vector function as well. The variations of percent datasets from activation function, learning rate of sigmoid and purelin, hidden layer, neurons, and training function should be applied for ANN. Furthermore, SVR is varied in kernel function, lost function and insensitivity to obtain the best result from its simulation. The best results of this study for ANN activation function is Sigmoid. The amount of data input is 100% or 96 of data, 150 learning rates, one hidden layer, trinlm training function, 15 neurons and 3 total layers. The best results for SVR are six variables that run in optimal condition, kernel function is linear, loss function is ౬-insensitive, and insensitivity was 1. The better results for both methods are six variables. The contribution of this study is to obtain the optimal parameters for specific variables of ANN and SVR .

[1]  Bai Shan,et al.  Application of online SVR on the dynamic liquid level soft sensing , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[2]  Martin T. Hagan,et al.  Neural networks for control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[3]  Budi Santosa,et al.  DATA MINING : Teknik Pemanfaatan Data untuk Keperluan Bisnis , 2011 .

[4]  Rini Akmeliawati,et al.  Support vector regression based friction modeling and compensation in motion control system , 2012, Eng. Appl. Artif. Intell..

[5]  Pituk Bunnoon.  Electricity Peak Load Demand using De-noising Wavelet Transform integrated with Neural Network Methods , 2016 .

[6]  Sakesun Suthummanon,et al.  ANN, ARIMA and MA timeseries model for forecasting in cement manufacturing industry: Case study at lafarge cement Indonesia — Aceh , 2014, 2014 International Conference of Advanced Informatics: Concept, Theory and Application (ICAICTA).

[7]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[8]  B. Schölkopf,et al.  Asymptotically Optimal Choice of ε-Loss for Support Vector Machines , 1998 .

[9]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[10]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[11]  S. Suhartono,et al.  Forecasting Tourism Data Using Neural Networks - Multiscale Autoregressive Model , 2011 .

[12]  Mustafa Inalli,et al.  Modeling a ground-coupled heat pump system by a support vector machine , 2008 .

[13]  Harris Drucker,et al.  Support vector machines for spam categorization , 1999, IEEE Trans. Neural Networks.

[14]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[15]  I A Basheer,et al.  Artificial neural networks: fundamentals, computing, design, and application. , 2000, Journal of microbiological methods.

[16]  Sakesun Suthummanon,et al.  Forecasting Determinant of Cement Demand in Indonesia with Artificial Neural Network , 2015 .

[17]  Deepthi Gurram,et al.  A Predictive Model for Mining Opinions of an Educational Database Using Neural Networks , 2015 .

[18]  Stephen José Hanson,et al.  Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area? , 2004, NeuroImage.

[19]  Ben-Hdech Adil,et al.  Hybrid Method HVS-MRMR for Variable Selection in Multilayer Artificial Neural Network Classifier , 2017 .