Automated bank cheque verification using image processing and deep learning methods

Automated bank cheque verification using image processing is an attempt to complement the present cheque truncation system, as well as to provide an alternate methodology for the processing of bank cheques with minimal human intervention. When it comes to the clearance of the bank cheques and monetary transactions, this should not only be reliable and robust but also save time which is one of the major factor for the countries having large population. In order to perform the task of cheque verification, we developed a tool which acquires the cheque leaflet key components, essential for the task of cheque clearance using image processing and deep learning methods. These components include the bank branch code, cheque number, legal as well as courtesy amount, account number, and signature patterns. our innovation aims at benefiting the banking system by re-innovating the other competent cheque-based monetary transaction system which requires automated system intervention. For this research, we used institute of development and research in banking technology (IDRBT) cheque dataset and deep learning based convolutional neural networks (CNN) which gave us an accuracy of 99.14% for handwritten numeric character recognition. It resulted in improved accuracy and precise assessment of the handwritten components of bank cheque. For machine printed script, we used MATLAB in-built OCR method and the accuracy achieved is satisfactory (97.7%) also for verification of Signature we have used Scale Invariant Feature Transform (SIFT) for extraction of features and Support Vector Machine (SVM) as classifier, the accuracy achieved for signature verification is 98.10%.

[1]  Neha Bhadwal,et al.  Smart Border Surveillance System using Wireless Sensor Network and Computer Vision , 2019, 2019 International Conference on Automation, Computational and Technology Management (ICACTM).

[2]  Fumitaka Kimura,et al.  Recognition of English Multi-oriented Characters , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Anakkapon Saenthon,et al.  Comparison the training methods of neural network for English and Thai character recognition , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[5]  Gregory Cohen,et al.  EMNIST: an extension of MNIST to handwritten letters , 2017, CVPR 2017.

[6]  Ashok A. Ghatol,et al.  Combined DWT-DCT digital Watermarking Technique Software Used for CTS of Bank , 2014, 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT).

[7]  Prateek Agrawal,et al.  Bank Cheque Validation Using Image Processing , 2019 .

[8]  Chomtip Pornpanomchai,et al.  Logo recognition system , 2015, 2015 International Computer Science and Engineering Conference (ICSEC).

[9]  Huimin Lu,et al.  A shadow removal method for tesseract text recognition , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[10]  Alberto Del Bimbo,et al.  Context-Dependent Logo Matching and Recognition , 2013, IEEE Transactions on Image Processing.

[11]  João Rogério Caldas Pinto,et al.  Hybrid neural models for automatic handwritten digits recognition , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[12]  Hui Jia,et al.  Features Extraction and Matching of Binocular Image Based on SIFT Algorithm , 2018, 2018 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS).

[13]  William A. Barrett,et al.  Segmentation and Stitching Improves Handwriting Recognition on Datasets with Few Samples , 2018, 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR).

[14]  Yang Li,et al.  Cell image segmentation based on an improved watershed algorithm , 2015, 2015 8th International Congress on Image and Signal Processing (CISP).

[15]  Kartika Gunadi,et al.  The Application of Deep Convolutional Denoising Autoencoder for Optical Character Recognition Preprocessing , 2017, 2017 International Conference on Soft Computing, Intelligent System and Information Technology (ICSIIT).

[16]  Jija Das Gupta,et al.  Handwritten words recognition for legal amounts of bank cheques in English script , 2015, 2015 Eighth International Conference on Advances in Pattern Recognition (ICAPR).

[17]  M Harikrishnan,et al.  Cheque Image Security Enhancement in Online Banking , 2018, 2018 Second International Conference on Inventive Communication and Computational Technologies (ICICCT).

[18]  Ashok A. Ghatol,et al.  An integration of SVD digital image watermarking with AES technique for copyright protection and security of bank cheque image , 2016, 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I).

[19]  Hirotomo Aso,et al.  Character pattern extraction from colorful documents with complex backgrounds , 2002, Object recognition supported by user interaction for service robots.

[20]  Ganapati Panda,et al.  Gestalt configural superiority effect: A complexity paradigm for handwritten numeral recognition , 2015, 2015 Eighth International Conference on Advances in Pattern Recognition (ICAPR).

[21]  A. V. Mityakov,et al.  Application of modern architectures of deep neural networks for solving practical problems , 2017, 2017 XX IEEE International Conference on Soft Computing and Measurements (SCM).

[22]  K. P. Soman,et al.  Optical Character Recognition for English and Tamil Using Support Vector Machines , 2009, 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies.

[23]  Vishu Madaan,et al.  Predicting Ayurveda-Based Constituent Balancing in Human Body Using Machine Learning Methods , 2020, IEEE Access.

[24]  P. N. Vasambekar,et al.  Signature recognition on bank cheques using ANN , 2016, 2016 IEEE International WIE Conference on Electrical and Computer Engineering (WIECON-ECE).

[25]  Masayuki Okamoto,et al.  Removal of Background Patterns and Signatures for Magnetic Ink Character Recognition of Checks , 2012, 2012 10th IAPR International Workshop on Document Analysis Systems.

[26]  S. Karthikeyan,et al.  Enhancing logo matching and recognition using local features , 2014, International Conference on Information Communication and Embedded Systems (ICICES2014).

[27]  Feriel Boudamous,et al.  Off-line handwritten signature identification using histogram of templates and artificial immune recognition system , 2017, 2017 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B).

[28]  Soubhik Das,et al.  Supervised machine learning in intelligent character recognition of handwritten and printed nameplate , 2017, 2017 International Conference on Advances in Computing, Communication and Control (ICAC3).

[29]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[30]  Yansen Zhou,et al.  Research and improvement of a multi-pattern matching algorithm based on double hash , 2017, 2017 3rd IEEE International Conference on Computer and Communications (ICCC).

[31]  Omkar Sunil Joshi,et al.  Parallelized Advanced Rabin-Karp Algorithm for String Matching , 2017, 2017 International Conference on Computing, Communication, Control and Automation (ICCUBEA).

[32]  Ming Chen,et al.  Grab Cut Image Segmentation Based on Image Region , 2018, 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC).

[33]  Anca Ignat,et al.  Handwritten Digit Recognition Using Rotations , 2016, 2016 18th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC).

[34]  Fumitaka Kimura,et al.  Recognition of Words from Legal Amounts of Indian Bank Cheques , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[35]  Gregory Cohen,et al.  EMNIST: Extending MNIST to handwritten letters , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[36]  Robert Sabourin,et al.  Meta-Learning for Fast Classifier Adaptation to New Users of Signature Verification Systems , 2019, IEEE Transactions on Information Forensics and Security.

[37]  Miguel Angel Ferrer-Ballester,et al.  Static and Dynamic Synthesis of Bengali and Devanagari Signatures , 2018, IEEE Transactions on Cybernetics.

[38]  Robert H. Yolken,et al.  Anti-Gluten Immune Response following Toxoplasma gondii Infection in Mice , 2012, PloS one.

[39]  Zhe Li,et al.  Fast Logo Detection and Recognition in Document Images , 2010, 2010 20th International Conference on Pattern Recognition.

[40]  Robert Sabourin,et al.  Characterizing and Evaluating Adversarial Examples for Offline Handwritten Signature Verification , 2019, IEEE Transactions on Information Forensics and Security.

[41]  Sourabh S. Shenoy,et al.  SWIFT-A Performance Accelerated Optimized String Matching Algorithm for Nvidia GPUs , 2016, 2016 15th International Symposium on Parallel and Distributed Computing (ISPDC).

[42]  Mohsen Soryani,et al.  From machine generated to handwritten character recognition; a deep learning approach , 2017, 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[43]  Prateek Agrawal,et al.  Optimisation of Image Fusion using Feature Matching Based on SIFT and RANSAC , 2016 .

[44]  Harneet Singh,et al.  A Proposed Approach for Character Recognition Using Document Analysis with OCR , 2018, 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS).

[45]  Jianqing Zhu,et al.  Handwritten numeral recognition using multi-task learning , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[46]  Cheng Chen,et al.  A General Approach for Handwritten Digits Segmentation Using Spectral Clustering , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[47]  C. N. Liu,et al.  An Experimental Investigation of a Mixed-Font Print Recognition System , 1966, IEEE Trans. Electron. Comput..

[48]  Francesco Camastra,et al.  Cursive Character Challenge: a New Database for Machine Learning and Pattern Recognition , 2006 .

[49]  Wenfeng Wu,et al.  TV logo recognition based on luminance variance , 2012 .

[50]  Wesley E. Dickinson,et al.  A Character-Recognition Study , 1960, IBM J. Res. Dev..

[51]  Garrison W. Cottrell,et al.  Color-to-Grayscale: Does the Method Matter in Image Recognition? , 2012, PloS one.

[52]  Francesco Camastra,et al.  Offline Cursive Character Challenge: a New Benchmark for Machine Learning and Pattern Recognition Algorithms. , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[53]  Rolf Ingold,et al.  Optical Font Recognition Using Typographical Features , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Reena Kharat,et al.  Recognition of cursive English handwritten characters , 2017, 2017 International Conference on Trends in Electronics and Informatics (ICEI).

[55]  Ratko Grbić,et al.  Improving optical character recognition performance for low quality images , 2017, 2017 International Symposium ELMAR.

[56]  Dejan Stefanovic,et al.  Optical Character Recognition on images with colorful background , 2018, 2018 IEEE 8th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[57]  Amit Choudhary,et al.  Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN) , 2020, Sensors.

[58]  Steven J. Simske,et al.  Automated Optimization of Void Pantograph Settings , 2011 .

[59]  H. Kaur,et al.  Analysis and Synthesis of an Ant Colony Optimization Technique for Image Edge Detection , 2012, 2012 International Conference on Computing Sciences.

[60]  Reena Kharat,et al.  Character Recognition for Cursive English Handwriting to Recognize Medicine Name from Doctor's Prescription , 2017, 2017 International Conference on Computing, Communication, Control and Automation (ICCUBEA).

[61]  Soumen Bag,et al.  Differentiating Pen Inks in Handwritten Bank Cheques Using Multi-layer Perceptron , 2017, PReMI.

[62]  Feng Wanli,et al.  A vehicle license plate recognition algorithm in night based on HSV , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[63]  Nirmal Kundu,et al.  An automated handwritten signature detection approach for e-security purposes , 2017, 2017 Third International Conference on Science Technology Engineering & Management (ICONSTEM).

[64]  Julian Fiérrez,et al.  Human-Assisted Signature Recognition Based on Comparative Attributes , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[65]  Dharmendra Sharma,et al.  Multiple Classification Using SVM Based Multi Knowledge Based System , 2017 .

[66]  Mehran Yazdi,et al.  Persian logo recognition using local binary patterns , 2017, 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[67]  George Nagy,et al.  Self-corrective character recognition system , 1966, IEEE Trans. Inf. Theory.

[68]  Julian Fiérrez,et al.  Humans in the loop: Study of semi-automatic signature recognition based on attributes , 2017, 2017 International Carnahan Conference on Security Technology (ICCST).

[69]  Tieniu Tan,et al.  Font Recognition Based on Global Texture Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Paul P. Wang,et al.  Machine recognition of printed Chinese characters via transformation algorithms , 1973, Pattern Recognit..

[71]  H. K. Singh,et al.  Impact of information technology on Indian banking services , 2012, 2012 1st International Conference on Recent Advances in Information Technology (RAIT).

[72]  M. K. Chavan,et al.  Symbolic Representation Model for Off-Line Signature Verification , 2018, 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT).

[73]  Avinash Shivdas,et al.  Green banking initiatives: A review of Indian banking sector , 2017, 2017 International Conference on Technological Advancements in Power and Energy ( TAP Energy).

[74]  Mohammad Abu Yousuf,et al.  Handwritten Courtesy Amount and Signature Recognition on Bank Cheque using Neural Network , 2015 .

[75]  Nuran Dogru,et al.  Signature recognition by using SIFT and SURF with SVM basic on RBF for voting online , 2017, 2017 International Conference on Engineering and Technology (ICET).

[76]  Nitin N. Patil,et al.  A comparative study of various methods for offline signature verification , 2014, 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT).

[77]  Anna Epishkina,et al.  Handwritten signature attributes for its verification , 2018, 2018 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus).