Medication Identification Aid for Visually Impaired Patients

One of the most challenges that Visually Impaired patients face in their daily life activities is linked to drug identification, and there are not sufficient special pharmaceuticals services provided to help them in identifying the different medications they use as reported by a research conducted in Saudi Arabia [3]. This make them depend on the help of people with normal vision around them, or develop their own systems like identifying a medicine by its odor or putting medication boxes with similar shapes in different places. The difficulty that visually impaired patients find in identifying their medication boxes may lead them to take wrong medications sometimes. This may highly affect their health, especially if they are suffering from a chronic disease and need to follow their medications regularly. There are some solutions for helping such patients in identifying their medication boxes like barcode or Near Field Communication (NFC) readers. The existing solutions are either unaffordable, require carrying additional devices, or difficult to use. Developing and designing more usable and accessible software solutions for visually impaired users became possible with the technologies such as computer vision. In this paper, we have focused on leveraging of the possibility offered by this field to develop a system that enables the patients to identify their medication without the need of any equipment other than their mobile phones. After developing our proposed system, we have evaluated its usability and accessibility with visually impaired users, and then presented the results and discussed some limitations and potential future works.

[1]  D. Lowe,et al.  Fast Matching of Binary Features , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[2]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[3]  Ian L. Bailey,et al.  Visual Impairment: An Overview , 1990 .

[4]  Aquiles M. F. Burlamaqui,et al.  Visual identification of medicine boxes using features matching , 2012, 2012 IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS) Proceedings.

[5]  D. Pascolini,et al.  Global estimates of visual impairment: 2010 , 2011, British Journal of Ophthalmology.

[6]  Apirak Hoonlor,et al.  UCap: A crowdsourcing application for the visually impaired and blind persons on Android smartphone , 2015, 2015 International Computer Science and Engineering Conference (ICSEC).

[7]  Mari Ervasti,et al.  Touch- and audio-based medication management service concept for vision impaired older people , 2011, 2011 IEEE International Conference on RFID-Technologies and Applications.

[8]  Meredith Ringel Morris,et al.  Investigating the appropriateness of social network question asking as a resource for blind users , 2013, CSCW.

[9]  Ellen Yi-Luen Do,et al.  Helping Hands versus ERSP Vision: Comparing Object Recognition Technologies for the Visually Impaired , 2011, HCI.

[10]  Amy Loutfi,et al.  Fast Matching of Binary Descriptors for Large-Scale Applications in Robot Vision , 2016 .

[11]  Rex B. Kline,et al.  Usability measurement and metrics: A consolidated model , 2006, Software Quality Journal.

[12]  Hammam A. Alshazly,et al.  Image Features Detection, Description and Matching , 2016 .

[13]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[14]  M. Isomursu,et al.  Medication management support for vision impaired elderly: Scenarios and technological possibilities , 2009, 2009 2nd International Symposium on Applied Sciences in Biomedical and Communication Technologies.

[15]  Jeffrey P. Bigham,et al.  VizWiz: nearly real-time answers to visual questions , 2010, W4A.

[16]  Salim Ullah,et al.  RFAIDE — An RFID based navigation and object recognition assistant for visually impaired people , 2011, 2011 7th International Conference on Emerging Technologies.

[17]  Basma Y Kentab,et al.  Exploring medication use by blind patients in Saudi Arabia. , 2015, Saudi pharmaceutical journal : SPJ : the official publication of the Saudi Pharmaceutical Society.

[18]  Ravi Kuber,et al.  An empirical study examining medication management among individuals with visual impairments , 2016, Universal Access in the Information Society.