Enhanced credit card fraud detection based on attention mechanism and LSTM deep model

As credit card becomes the most popular payment mode particularly in the online sector, the fraudulent activities using credit card payment technologies are rapidly increasing as a result. For this end, it is obligatory for financial institutions to continuously improve their fraud detection systems to reduce huge losses. The purpose of this paper is to develop a novel system for credit card fraud detection based on sequential modeling of data, using attention mechanism and LSTM deep recurrent neural networks. The proposed model, compared to previous studies, considers the sequential nature of transactional data and allows the classifier to identify the most important transactions in the input sequence that predict at higher accuracy fraudulent transactions. Precisely, the robustness of our model is built by combining the strength of three sub-methods; the uniform manifold approximation and projection (UMAP) for selecting the most useful predictive features, the Long Short Term Memory (LSTM) networks for incorporating transaction sequences and the attention mechanism to enhance LSTM performances. The experimentations of our model give strong results in terms of efficiency and effectiveness.

[1]  Ekrem Duman,et al.  A cost-sensitive decision tree approach for fraud detection , 2013, Expert Syst. Appl..

[2]  M. Ufuk Çaglayan,et al.  Hybrid approaches for detecting credit card fraud , 2017, Expert Syst. J. Knowl. Eng..

[3]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[4]  Yoshua Bengio,et al.  Attention-Based Models for Speech Recognition , 2015, NIPS.

[5]  VENKATA RATNAM GANJI Credit card fraud detection using anti-k nearest neighbor algorithm , 2012 .

[6]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[7]  Gianluca Bontempi,et al.  Learned lessons in credit card fraud detection from a practitioner perspective , 2014, Expert Syst. Appl..

[8]  Xiao Qin,et al.  LOMA: A local outlier mining algorithm based on attribute relevance analysis , 2017, Expert Syst. Appl..

[9]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[10]  Siddhartha Bhattacharyya,et al.  Data mining for credit card fraud: A comparative study , 2011, Decis. Support Syst..

[11]  Michael Granitzer,et al.  Sequence classification for credit-card fraud detection , 2018, Expert Syst. Appl..

[12]  Cesare Alippi,et al.  Credit Card Fraud Detection: A Realistic Modeling and a Novel Learning Strategy , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Mohammad Kazem Akbari,et al.  Credit cards fraud detection by negative selection algorithm on hadoop (To reduce the training time) , 2013, The 5th Conference on Information and Knowledge Technology.

[14]  Mehreen Sirshar,et al.  A Survey on Application of Data Mining Techniques; ItâÂÂs Proficiency In Fraud Detection of Credit Card , 2018 .

[15]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[16]  Lai Guan Ng,et al.  Dimensionality reduction for visualizing single-cell data using UMAP , 2018, Nature Biotechnology.

[17]  Abhinav Srivastava,et al.  Credit Card Fraud Detection Using Hidden Markov Model , 2008, IEEE Transactions on Dependable and Secure Computing.

[18]  Vili Podgorelec,et al.  Swarm Intelligence Algorithms for Feature Selection: A Review , 2018, Applied Sciences.

[19]  Simon Padgett,et al.  About the Association of Certified Fraud Examiners and the Report to the Nations on Occupational Fraud and Abuse , 2015 .

[20]  Bouabid El Ouahidi,et al.  NOVEL LEARNING STRATEGY BASED ON GENETIC PROGRAMMING FOR CREDIT CARD FRAUD DETECTION IN BIG DATA , 2019, Proceedings of the International Conferences Big Data Analytics, Data Mining and Computational Intelligence 2019; and Theory and Practice in Modern Computing 2019.

[21]  Nitesh V. Chawla,et al.  Using HDDT to avoid instances propagation in unbalanced and evolving data streams , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[22]  Jon T. S. Quah,et al.  Real Time Credit Card Fraud Detection using Computational Intelligence , 2007, 2007 International Joint Conference on Neural Networks.

[23]  Monique Snoeck,et al.  APATE: A novel approach for automated credit card transaction fraud detection using network-based extensions , 2015, Decis. Support Syst..

[24]  Kate Smith-Miles,et al.  A Comprehensive Survey of Data Mining-based Fraud Detection Research , 2010, ArXiv.

[25]  Saeedeh Momtazi,et al.  Ensemble of deep sequential models for credit card fraud detection , 2020, Appl. Soft Comput..

[26]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[27]  Richard L. Schmoyer,et al.  Mining multi-dimensional data for decision support , 1999, Future Gener. Comput. Syst..

[28]  Anazida Zainal,et al.  Fraud detection system: A survey , 2016, J. Netw. Comput. Appl..

[29]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction , 2018, ArXiv.

[30]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[31]  Venu Govindaraju,et al.  Feature Selection Using Cooperative Game Theory and Relief Algorithm , 2013, KICSS.

[32]  Gregory Vaughan,et al.  Efficient big data model selection with applications to fraud detection , 2020 .

[33]  Reid A. Johnson,et al.  Calibrating Probability with Undersampling for Unbalanced Classification , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[34]  R. Lakshmi,et al.  Minimal infrequent pattern based approach for mining outliers in data streams , 2015, Expert Syst. Appl..

[35]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[36]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[37]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[38]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection , 2018, J. Open Source Softw..

[39]  Vipin Kumar,et al.  Anomaly Detection for Discrete Sequences: A Survey , 2012, IEEE Transactions on Knowledge and Data Engineering.

[40]  Janusz Kacprzyk,et al.  Knowledge, Information and Creativity Support Systems: Recent Trends, Advances and Solutions , 2016, Advances in Intelligent Systems and Computing.

[41]  Emad A. Mohammed,et al.  Supervised Machine Learning Algorithms for Credit Card Fraudulent Transaction Detection: A Comparative Study , 2018, 2018 IEEE International Conference on Information Reuse and Integration (IRI).

[42]  Björn E. Ottersten,et al.  Cost Sensitive Credit Card Fraud Detection Using Bayes Minimum Risk , 2013, 2013 12th International Conference on Machine Learning and Applications.

[43]  Priyanka Kumari,et al.  Analysis of Credit Card Fraud Detection Using Fusion Classifiers , 2018, Advances in Intelligent Systems and Computing.

[44]  Tatsuya Minegishi,et al.  Proposal of Credit Card Fraudulent Use Detection by Online-type Decision Tree Construction and Verification of Generality , 2013 .

[45]  Jayesh Chaudhary,et al.  A Survey on Credit Card Fraud Detection Using Machine Learning , 2018, 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI).

[46]  Jaroslav Zendulka,et al.  Constrained Classification of Large Imbalanced Data by Logistic Regression and Genetic Algorithm , 2013 .

[47]  Asha RB,et al.  Credit card fraud detection using artificial neural network , 2021, Global Transitions Proceedings.

[48]  Yuri Lawryshyn,et al.  Improving Credit Card Fraud Detection using a Meta- Classification Strategy , 2012 .

[49]  Maumita Bhattacharya,et al.  Intelligent Financial Fraud Detection: A Comprehensive Review , 2015 .

[50]  Frédéric Oblé,et al.  Combining unsupervised and supervised learning in credit card fraud detection , 2019, Inf. Sci..

[51]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[52]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[53]  Djamila Aouada,et al.  Feature engineering strategies for credit card fraud detection , 2016, Expert Syst. Appl..

[54]  Yiying Tong,et al.  EVOLUTIONARY DE RHAM-HODGE METHOD. , 2019, Discrete and continuous dynamical systems. Series B.

[55]  Ekrem Duman,et al.  Detecting credit card fraud by Modified Fisher Discriminant Analysis , 2015, Expert Syst. Appl..

[56]  Vadlamani Ravi,et al.  Credit Card Fraud Detection using Big Data Analytics: Use of PSOAANN based One-Class Classification , 2016, ICIA.

[57]  Bouabid El Ouahidi,et al.  Credit Card Fraud Detection Model Based on LSTM Recurrent Neural Networks , 2021, Journal of Advances in Information Technology.

[58]  Gianluca Bontempi,et al.  Streaming active learning strategies for real-life credit card fraud detection: assessment and visualization , 2018, International Journal of Data Science and Analytics.