Extreme Learning Machine

We first design the Auto Associative Extreme Learning Machine (AAELM) as an auto associative version of the ELM and then propose a single class classifier based on Auto Associative Extreme Learning Factory (AAELF), which is an ensemble of several AAELMs. The ensemble was necessitated because the results of AAELM are extremely sensitive to the random weights of the connections between input and hidden layers. The proposed architecture is tested on bankruptcy prediction datasets namely Spanish banks, Turkish banks, UK banks; UK Credit dataset and phishing dataset. It turns out that AAELF outperforms past works that included many binary and single class classifiers. It is concluded that AAELF is an effective single class classifier in classifying highly unbalanced datasets or datasets where the positive class is totally missing.

[1]  Kyung-shik Shin,et al.  An application of support vector machines in bankruptcy prediction model , 2005, Expert Syst. Appl..

[2]  Vadlamani Ravi,et al.  Soft computing system for bank performance prediction , 2008, Appl. Soft Comput..

[3]  Vadlamani Ravi,et al.  Soft computing based imputation and hybrid data and text mining: The case of predicting the severity of phishing alerts , 2012, Expert Syst. Appl..

[4]  Sadia Afroz,et al.  PhishZoo : An Automated Web Phishing Detection Approach Based on Profiling and Fuzzy Matching , 2009 .

[5]  Vadlamani Ravi,et al.  Particle Swarm Optimization Trained Auto Associative Neural Networks Used as Single Class Classifier , 2012, SEMCCO.

[6]  Ignacio Olmeda,et al.  Hybrid Classifiers for Financial Multicriteria Decision Making: The Case of Bankruptcy Prediction , 1997 .

[7]  Serpil Canbas,et al.  Prediction of commercial bank failure via multivariate statistical analysis of financial structures: The Turkish case , 2005, Eur. J. Oper. Res..

[8]  Kar Yan Tam,et al.  Neural network models and the prediction of bank bankruptcy , 1991 .

[9]  Chee Kheong Siew,et al.  Can threshold networks be trained directly? , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[10]  Ramesh Sharda,et al.  A neural network model for bankruptcy prediction , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[11]  Ronen Feldman,et al.  Book Reviews: The Text Mining Handbook: Advanced Approaches to Analyzing Unstructured Data by Ronen Feldman and James Sanger , 2008, CL.

[12]  Jonathan N. Crook,et al.  Credit Scoring and Its Applications , 2002, SIAM monographs on mathematical modeling and computation.

[13]  Andrew H. Sung,et al.  Detection of Phishing Attacks: A Machine Learning Approach , 2008, Soft Computing Applications in Industry.

[14]  Vadlamani Ravi,et al.  Detecting phishing e-mails using text and data mining , 2012, 2012 IEEE International Conference on Computational Intelligence and Computing Research.

[15]  Fadi A. Thabtah,et al.  Intelligent phishing detection system for e-banking using fuzzy data mining , 2010, Expert Syst. Appl..

[16]  Hongming Zhou,et al.  Credit risk evaluation with extreme learning machine , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[17]  Amir Herzberg,et al.  TrustBar: Protecting (even Naïve) Web Users from Spoofing and Phishing Attacks , 2004 .

[18]  P. Ravikumar,et al.  Bankruptcy Prediction in Banks by an Ensemble Classifier , 2006, 2006 IEEE International Conference on Industrial Technology.

[19]  Xi Chen,et al.  Assessing the severity of phishing attacks: A hybrid data mining approach , 2011, Decis. Support Syst..

[20]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[21]  Chee Kheong Siew,et al.  Extreme learning machine: RBF network case , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[22]  Vadlamani Ravi,et al.  Modified Great Deluge Algorithm based Auto Associative Neural Network for Bankruptcy Prediction in Banks , 2007 .

[23]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[24]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[25]  Michalis Faloutsos,et al.  PhishDef: URL names say it all , 2010, 2011 Proceedings IEEE INFOCOM.

[26]  Melody Y. Kiang,et al.  Predicting Bank Failures: A neural network approach , 1990, Appl. Artif. Intell..

[27]  Peter L. Bartlett,et al.  The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network , 1998, IEEE Trans. Inf. Theory.

[28]  James A. Ohlson.  FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .

[29]  Wei Wu,et al.  Evolutionary Fuzzy Extreme Learning Machine for Mammographic Risk Analysis , 2011 .

[30]  Dianhui Wang,et al.  Protein sequence classification using extreme learning machine , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[31]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[32]  Rebel A. Cole,et al.  A CAMEL Rating's Shelf Life , 1995 .

[33]  Sureswaran Ramadass,et al.  Evolving Fuzzy Neural Network for Phishing Emails Detection , 2012 .

[34]  Vadlamani Ravi,et al.  Bankruptcy Prediction in Banks by Fuzzy Rule Based Classifier , 2007, 2006 1st International Conference on Digital Information Management.

[35]  J. Koenderink.  Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[36]  M.A.H. Farquad,et al.  Credit Scoring Using PCA-SVM Hybrid Model , 2011 .

[37]  E. Mine Cinar,et al.  Neural Networks: A New Tool for Predicting Thrift Failures , 1992 .

[38]  Sungzoon Cho,et al.  Bankruptcy prediction for credit risk using an auto-associative neural network in Korean firms , 2003, 2003 IEEE International Conference on Computational Intelligence for Financial Engineering, 2003. Proceedings..

[39]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[40]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[41]  M. S. Vijaya,et al.  Efficient prediction of phishing websites using supervised learning algorithms , 2012 .

[43]  Fergus Toolan,et al.  Phishing detection using classifier ensembles , 2009, 2009 eCrime Researchers Summit.

[44]  Mingxing He,et al.  An efficient phishing webpage detector , 2011, Expert Syst. Appl..

[45]  John C. Mitchell,et al.  Client-Side Defense Against Web-Based Identity Theft , 2004, NDSS.

[46]  Vadlamani Ravi,et al.  A Semi-Online Training Algorithm for the Radial Basis Function Neural Networks: Applications to Bankruptcy Prediction in Banks , 2008 .

[47]  M. Beynon,et al.  Variable precision rough set theory and data discretisation: an application to corporate failure prediction , 2001 .

[48]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  Michel Ballings,et al.  Kernel Factory: An ensemble of kernel machines , 2013, Expert Syst. Appl..

[50]  Gordon V. Karels,et al.  Multivariate Normality and Forecasting of Business Bankruptcy , 1987 .