Tele-assistance system for the blinds using Video-call with remote scene construction

Video-call applications may not be originally designed to accommodate the blinds since they are not the main target users. However, this kind of application can be utilized as a tele-assistance solution for the assistants to help the blind navigate or perform any task that require sight. We field tested a popular Video-call application, Line, by blind users while communicating with their assistants for help in various tasks and found several drawbacks that must be overcome in order to make the application usable by the two parties. In this work, we focus on the fact that blind users lack the capability to video necessary frames that their assistants must see in order to help the blinds with sight-demanded tasks. They, therefore, may have to take the video repeatedly by waving the camera rather randomly until necessary frames appear. We propose an algorithm to construct scenes from remotely-recorded video frames that produce wide-angle or panoramic type of image, particularly for the assistants. This feature is integrated with our video-call system using WebRTC technology. Six assistant volunteers tested the proposed system by comparing it with existing video-call application and found 4.17 out of 5 satisfaction rate.

[1]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[2]  Jinjiang Li,et al.  Image stitch algorithm based on SIFT and MVSC , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[3]  Hiroshi Yamamoto,et al.  Web shopping support system for elderly people using WebRTC , 2014, 16th International Conference on Advanced Communication Technology.

[4]  M. Bouzit,et al.  Evaluation of RU-Netra - Tactile Feedback Navigation System For The Visually Impaired , 2006, 2006 International Workshop on Virtual Rehabilitation.

[5]  John Nicholson,et al.  RFID in robot-assisted indoor navigation for the visually impaired , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[6]  Sanjana Prasain,et al.  StopFinder: improving the experience of blind public transit riders with crowdsourcing , 2011, ASSETS.

[7]  Pawel Strumillo,et al.  Electronic interfaces aiding the visually impaired in environmental access, mobility and navigation , 2010, 3rd International Conference on Human System Interaction.

[8]  Jon Froehlich,et al.  Improving public transit accessibility for blind riders by crowdsourcing bus stop landmark locations with Google street view , 2013, ASSETS.

[9]  S. Chumkamon,et al.  A blind navigation system using RFID for indoor environments , 2008, 2008 5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[10]  Atiwong Suchato,et al.  Accessible Video-Call Application on Android for the Blind , 2016 .

[11]  Jeffrey P. Bigham,et al.  VizWiz: nearly real-time answers to visual questions , 2010, W4A.

[12]  Tetsuo Ono,et al.  CyARM: an alternative aid device for blind persons , 2005, CHI Extended Abstracts.

[13]  G. Ram Mohana Reddy,et al.  An Android GPS-Based Navigation Application For Blind , 2014, VINCI '14.

[14]  Simon Pietro Romano,et al.  On the seamless interaction between webRTC browsers and SIP-based conferencing systems , 2013, IEEE Communications Magazine.

[15]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[16]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[17]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[19]  James R. Marston,et al.  Personal Guidance System for People with Visual Impairment: A Comparison of Spatial Displays for Route Guidance , 2005, Journal of visual impairment & blindness.

[20]  Yvonne Coady,et al.  ABLE Transit: A Mobile Application for Visually Impaired Users to Navigate Public Transit , 2012, 2012 Seventh International Conference on Broadband, Wireless Computing, Communication and Applications.

[21]  Pawel Strumillo,et al.  A remote guidance system for the blind , 2010, The 12th IEEE International Conference on e-Health Networking, Applications and Services.

[22]  P M Panchal,et al.  A Comparison of SIFT and SURF , 2013 .

[23]  Jyri Rajamäki,et al.  LaureaPOP indoor navigation service for the visually impaired in a WLAN environment , 2007 .

[24]  Surapol Vorapatratorn,et al.  iSonar: an obstacle warning device for the totally blind , 2014 .

[25]  Bing Yang,et al.  Automatic Image Registration Based on Natural Characteristic Points and Global Homography , 2008, 2008 International Conference on Computer Science and Software Engineering.

[26]  Bo Yan,et al.  WebRTC-based video conferencing service for telehealth , 2014, Computing.

[27]  Shyan-Ming Yuan,et al.  A Video Conferencing System Based on WebRTC for Seniors , 2014, 2014 International Conference on Trustworthy Systems and their Applications.

[28]  Pawel Strumillo.  Electronic Systems Aiding Spatial Orientation and Mobility of the Visually Impaired , 2012 .