SelfLens: A Portable Tool to Facilitate All People in Getting Information on Food Items

Independently selecting food items while shopping, or storing and cooking food items correctly can be a very difficult task for people with special needs. Product labels on food packaging contain an ever-increasing amount of information, which can also be in a variety of languages. The amount of information and also the features of the text can make it difficult or impossible to read, in particular for those with visual impairments or the elderly. Several tools or applications are available on the market or have been proposed to support this type of activity (e.g. barcode or QR code reading), but they are limited and may require the user to have specific digital skills. Moreover, repeatedly using an application to read the label contents can require numerous steps on a touch-screen, and consequently be time-consuming. In this work, a portable tool is proposed to support people in reading the contents of labels and acquiring additional information, while they are using the item at home or shopping at the supermarket. The aim of our study is to propose a simple portable assistive technology tool which 1) can be used by anyone, regardless of their digital personal skills 2) does not require a smartphone or complex device, 3) is a low-cost solution for the user.

[1]  Priya Narasimhan,et al.  Trinetra: Assistive Technologies for Grocery Shopping for the Blind , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[2]  Diego López-de-Ipiña,et al.  BlindShopping: Enabling Accessible Shopping for Visually Impaired People through Mobile Technologies , 2011, ICOST.

[3]  Narayanan Vijaykrishnan,et al.  The Third Eye: A Shopping Assistant for the Visually Impaired , 2017, CHI Extended Abstracts.

[4]  Barbara Leporini,et al.  Home Automation for an Independent Living: Investigating the Needs of Visually Impaired People , 2018, W4A.

[5]  A. Piotrowska,et al.  Food shopping, sensory determinants of food choice and meal preparation by visually impaired people. Obstacles and expectations in daily food experiences , 2017, Appetite.

[6]  Vladimir Kulyukin,et al.  Accessible Shopping Systems for Blind and Visually Impaired Individuals: Design Requirements and the State of the Art , 2010, The Open Rehabilitation Journal.

[7]  N. Sugandhi,et al.  A low cost smart shopping facilitator for visually impaired , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[8]  John Nicholson,et al.  ShopTalk: Independent Blind Shopping Through Verbal Route Directions and Barcode Scans , 2009 .

[9]  Vladimir A. Kulyukin,et al.  Robot-assisted shopping for the blind: issues in spatial cognition and product selection , 2008, Intell. Serv. Robotics.

[10]  Pedro Furtado,et al.  Overview of assistive technologies for the blind: Navigation and shopping , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[11]  Diego López-de-Ipiña,et al.  Indoor Navigation and Product Recognition for Blind People Assisted Shopping , 2011, IWAAL.

[12]  Mary Beth Rosson,et al.  Constructing a holistic view of shopping with people with visual impairment: a participatory design approach , 2017, Universal Access in the Information Society.