Analogizing time complexity of KNN and CNN in recognizing handwritten digits

Handwritten identification of digit, analysis of pattern has been a major area of research in the field of character recognition. Several models are formed by changing various values of weights when applied through the neural network. The paper analyzes the study of time complexity in two different algorithms KNN and CNN. The K-Nearest Neighbor Algorithm is used as a classifier capable of computing the Euclidean distance between data set input images. The dataset is fetched for training through neural network contains various (28 × 28) pixel size images and therefore, our first layer of neural network contains 784 neurons as input. We will analyze these images by varying values so as to obtain output layer of our network 10 neurons, each neuron if fixed gives any output between 0 to 9. After reading in data appropriately from MNIST and testing it on Gaussian distribution, KNN classifier then presented the result with Python tool. So, to avoid such a long waiting another algorithm Convolutional Neural Networks has been used. CNN has been implemented on Keras including Tensorflow and produces accuracy. It is then shown that KNN and CNN perform competitively with their respective algorithm on this dataset, while CNN produces high accuracy than KNN and hence chosen as a better approach.

[1]  Shohreh Kasaei,et al.  Persian handwritten digit recognition by random forest and convolutional neural networks , 2015, 2015 9th Iranian Conference on Machine Vision and Image Processing (MVIP).

[2]  Peter Kulchyski and , 2015 .

[3]  Xuan Yang MDig : Multi-digit Recognition using Convolutional Nerual Network on Mobile , 2015 .

[4]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[5]  Chayaporn Kaensar A Comparative Study on Handwriting Digit Recognition Classifier Using Neural Network, Support Vector Machine and K-Nearest Neighbor , 2013 .

[6]  Vijayan K. Asari,et al.  Handwritten Bangla Digit Recognition Using Deep Learning , 2017, ArXiv.

[7]  Yogesh,et al.  Fruit defect detection based on speeded up robust feature technique , 2016, 2016 5th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO).

[8]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[9]  Haider A. Alwzwazy,et al.  Handwritten Digit Recognition Using Convolutional Neural Networks , 2016 .

[10]  Faisal Tehseen Shah,et al.  Handwritten Digit Recognition Using Image Processing and Neural Networks , 2007, World Congress on Engineering.

[11]  Surbhi Mishra,et al.  Online and offline character recognition: A survey , 2016, 2016 International Conference on Communication and Signal Processing (ICCSP).

[12]  Kusum Gupta,et al.  Handwritten Digit Recognition using various Neural Network Approaches , 2015 .

[13]  Mohammad Imrul Jubair,et al.  A Simplified Method for Handwritten Character Recognition from Document Image , 2012 .

[14]  Akshi Kumar,et al.  Handwritten Digit Recognition Using Deep Learning , 2017 .

[15]  Ismail M. Keshta,et al.  Handwritten Digit Recognition based on Output-Independent Multi-Layer Perceptrons , 2017 .

[16]  Xiaohui Xie,et al.  Handwritten Hangul recognition using deep convolutional neural networks , 2014, International Journal on Document Analysis and Recognition (IJDAR).