A Study of Computer Vision Techniques for Currency Recognition on Mobile Phone for the Visually Impaired

Currency recognition is a challenging task in computer vision. Various Image processing methods and artificial intelligence techniques have been employed to handle this. We have studied various currency recognition applications employing different keypoint detection, keypoint extraction and keypoint matching approaches. In this paper we also present a study of some recent computer vision techniques like BRIEF, ORB, FAST, AGAST, BRISK, FREAK and earlier techniques like SURF, SIFT. The mobile based currency recognition applications discussed here are meant to support visually impaired and blind users. Mobile devices are ubiquitous and come with a built in camera having a fair resolution. Currency note images captured by blind users can have several failings: images of the notes may not be ideally aligned/oriented; there can be scale changes due to variation of distance from camera; illumination changes can also lead to differences in images. There is also the possibility of a cluttered background in the image, or the note being partially occluded, folded, worn and/or wrinkled, etc. This paper illustrates computer vision techniques employed till now and studies new improved techniques which can be used in their place. These new methods offer several advantages for efficient currency note recognition in mobile applications. We have also studied blind users’ needs and expectations from such applications and how researchers have developed variety of touch screen utilities like Braille keyboard, food product identification, and indoor navigation applications. Also, our in person visit to an NGO for blind helped us to understand their special needs from touch screen mobile devices. This visit has really motivated and has enriched our work in correct way. Keywords— Currency note recognition, Computer Vision, Visually impaired blind users, Assistive mobile phone applications-FREAK, BRISK, SURF, SIFT

[1]  Xu Liu,et al.  A camera phone based currency reader for the visually impaired , 2008, Assets '08.

[2]  Michael Teutsch,et al.  Evaluation of binary keypoint descriptors , 2013, 2013 IEEE International Conference on Image Processing.

[3]  Ioannis A. Kakadiaris,et al.  Mobile User Authentication Using Statistical Touch Dynamics Images , 2014, IEEE Transactions on Information Forensics and Security.

[4]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[5]  Karol Matusiak,et al.  Object recognition in a mobile phone application for visually impaired users , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[6]  A.R. Chowdhury,et al.  Bangladeshi banknote recognition by neural network with axis symmetrical masks , 2007, 2007 10th international conference on computer and information technology.

[7]  Stavros Papastavrou,et al.  Blind-folded recognition of bank notes on the mobile phone , 2010, SIGGRAPH '10.

[8]  João Ascenso,et al.  Evaluation of low-complexity visual feature detectors and descriptors , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[9]  Lakshminarayanan Subramanian,et al.  Exchanging cash with no fear: A fast mobile money reader for the blind , 2012 .

[10]  Jan-Michael Frahm,et al.  Comparative Evaluation of Binary Features , 2012, ECCV.

[11]  Lakshminarayanan Subramanian,et al.  Recognizing currency bills using a mobile phone: an assistive aid for the visually impaired , 2011, UIST '11 Adjunct.

[12]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[13]  Christian Schneider,et al.  Feature based Face Localization and Recognition on Mobile Devices , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[14]  Lakshminarayanan Subramanian,et al.  Mobile Accessibility Tools for the Visually Impaired , 2012 .

[15]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[16]  Joaquim A. Jorge,et al.  Blind people and mobile touch-based text-entry: acknowledging the need for different flavors , 2011, ASSETS.

[17]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[18]  W. A. Clarke,et al.  Identification of facial features on android platforms , 2013, 2013 IEEE International Conference on Industrial Technology (ICIT).

[19]  Xiaodong Yang,et al.  Robust and Effective Component-Based Banknote Recognition for the Blind , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[21]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[22]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[23]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Erin Brady,et al.  Visual challenges in the everyday lives of blind people , 2013, CHI.

[25]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).