SelfLens: A Personal Assistive Technology to Support the Independence of People with Special Needs in Reading Information on Food Items

Grocery shopping or handling food items (e.g. packets, boxes, etc.) can be a very difficult task for people with special needs. Object labels may contain much information that can be difficult to read because the data shown is a lot, and the text is difficult to read by many people. Blind people are unable to get that information autonomously, and many sighted persons (e.g. elderly people and visually-impaired) may have a lot of difficulty in reading labels. Several tools or applications are available on the market or have been proposed in the literature to support this type of activity (e.g. barcode or QR code reading), but they are limited and may require specific skills by the user. Moreover, repeatedly using an application to read label contents or to get additional information on a product can require numerous actions on a touch-screen device. This can make their use inaccessible or unusable for many users, especially while shopping or cooking. In this work, a portable tool is proposed to support people in simply reading the contents of labels and getting additional information, while they are at home or at the shop. Our study aims to propose a portable assistive technology which can be used by everyone both at home and in the shopping, independently from the personal skills and without requiring no smartphone or complex device, and that is a low-cost solution for the user. Such a product could be very useful for the people independence in a period like that one we are living due to the lockdown required by the Covid-19 situation.

[1]  Vladimir A. Kulyukin,et al.  Robot-assisted shopping for the blind: issues in spatial cognition and product selection , 2008, Intell. Serv. Robotics.

[2]  Mary Beth Rosson,et al.  Constructing a holistic view of shopping with people with visual impairment: a participatory design approach , 2017, Universal Access in the Information Society.

[3]  Rahul Singh,et al.  Innovative Affordances for Blind Smartphone Users: A Qualitative Study , 2016 .

[4]  Hend Suliman Al-Khalifa Utilizing QR Code and Mobile Phones for Blinds and Visually Impaired People , 2008, ICCHP.

[5]  Pedro Furtado,et al.  Overview of assistive technologies for the blind: Navigation and shopping , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[6]  Thorsten Schwarz,et al.  Accessible EPUB: Making EPUB 3 Documents Universal Accessible , 2018, ICCHP.

[7]  Narayanan Vijaykrishnan,et al.  The Third Eye: A Shopping Assistant for the Visually Impaired , 2017, CHI Extended Abstracts.

[8]  Vladimir Kulyukin,et al.  Accessible Shopping Systems for Blind and Visually Impaired Individuals: Design Requirements and the State of the Art , 2010, The Open Rehabilitation Journal.

[9]  Barbara Leporini,et al.  Home Automation for an Independent Living: Investigating the Needs of Visually Impaired People , 2018, W4A.

[10]  Diego López-de-Ipiña,et al.  BlindShopping: Enabling Accessible Shopping for Visually Impaired People through Mobile Technologies , 2011, ICOST.

[11]  John Nicholson,et al.  ShopTalk: Independent Blind Shopping Through Verbal Route Directions and Barcode Scans , 2009 .

[12]  Diego López-de-Ipiña,et al.  Indoor Navigation and Product Recognition for Blind People Assisted Shopping , 2011, IWAAL.

[13]  Priya Narasimhan,et al.  Trinetra: Assistive Technologies for Grocery Shopping for the Blind , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[14]  Barbara Leporini,et al.  Accessibility of Android-Based Mobile Devices: A Prototype to Investigate Interaction with Blind Users , 2012, ICCHP.

[15]  A. Piotrowska,et al.  Food shopping, sensory determinants of food choice and meal preparation by visually impaired people. Obstacles and expectations in daily food experiences , 2017, Appetite.