Wearable Vision Assistance System Based on Binocular Sensors for Visually Impaired Users

Blind or visually impaired people face special difficulties in daily life. With the advances in vision sensors and computer vision, the design of wearable vision assistance system is promising. In order to improve the life quality of the visually impaired group, a wearable system is proposed in this paper. Typically the performance of visual sensors is affected by a variety of complex factors in practice, resulting in a large number of noise and distortion. In this paper, we will creatively leverage image quality evaluation to select the captured images through vision sensors, which can ensure the input quality of scenes for the final identification system. First, we use binocular vision sensors to capture images in a fixed frequency and choose the informative ones based on stereo image quality assessment. Then the captured images will be sent to cloud for further computing. Specially, the detection and automatic result will be done for all the received images. Convolutional neural network based on big data will be used in this step. According to image analysis, the cloud computing can return the requested information for users, which can help them make a more reasonable decision in further action. Simulations and experiments show that the proposed method can solve the problem effectively. In addition, statistical results also demonstrate that wearable vision system can make visually impaired group more satisfied in visual needed situations.

[1]  Daniel Thalmann,et al.  A wearable system for mobility improvement of visually impaired people , 2007, The Visual Computer.

[2]  Bogdan Raducanu,et al.  New Opportunities for Computer Vision-Based Assistive Technology Systems for the Visually Impaired , 2014, Computer.

[3]  Andrea Cavallaro,et al.  Online Cross-Modal Adaptation for Audio–Visual Person Identification With Wearable Cameras , 2017, IEEE Transactions on Human-Machine Systems.

[4]  Roozbeh Jafari,et al.  Seamless Vision-assisted Placement Calibration for Wearable Inertial Sensors , 2017, ACM Trans. Embed. Comput. Syst..

[5]  Bartolomeo Montrucchio,et al.  Thresholds of Vision of the Human Visual System: Visual Adaptation for Monocular and Binocular Vision , 2015, IEEE Transactions on Human-Machine Systems.

[6]  Ja-Ling Wu,et al.  Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors , 2014, IEEE Transactions on Image Processing.

[7]  Weihua Sheng,et al.  Wearable Sensor-Based Behavioral Anomaly Detection in Smart Assisted Living Systems , 2015, IEEE Transactions on Automation Science and Engineering.

[8]  Lu Yu,et al.  Simulating binocular vision for no-reference 3D visual quality measurement. , 2015, Optics express.

[9]  Lorenzo Scalise,et al.  An Electromagnetic Sensor for the Autonomous Running of Visually Impaired and Blind Athletes (Part II: The Wearable Device) , 2017, Sensors.

[10]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[11]  Anderson Rocha,et al.  A Kinect-Based Wearable Face Recognition System to Aid Visually Impaired Users , 2017, IEEE Transactions on Human-Machine Systems.

[12]  Tien Yin Wong,et al.  Direct medical costs associated with Clinical and Health characteristics in visually impaired individuals in Singapore , 2015 .

[13]  B. Bengtsson,et al.  Visual impairment and vision‐related quality of life in the Early Manifest Glaucoma Trial after 20 years of follow‐up , 2015, Acta ophthalmologica.

[14]  Franco Lepore,et al.  Role of primary visual cortex in the binocular integration of plaid motion perception , 2005, The European journal of neuroscience.

[15]  R Fensli,et al.  Sensor Acceptance Model – Measuring Patient Acceptance of Wearable Sensors , 2008, Methods of Information in Medicine.

[16]  Narayanan Vijaykrishnan,et al.  The Third Eye: A Shopping Assistant for the Visually Impaired , 2017, CHI Extended Abstracts.

[17]  Petia Radeva,et al.  Toward Storytelling From Visual Lifelogging: An Overview , 2015, IEEE Transactions on Human-Machine Systems.

[18]  Taku Komura,et al.  A Deep Learning Framework for Character Motion Synthesis and Editing , 2016, ACM Trans. Graph..

[19]  Lorenzo Scalise,et al.  An Electromagnetic Sensor for the Autonomous Running of Visually Impaired and Blind Athletes (Part I: The Fixed Infrastructure) , 2017, Sensors.

[20]  E. Nemati,et al.  A wireless wearable ECG sensor for long-term applications , 2012, IEEE Communications Magazine.

[21]  Zhihan Lv,et al.  Stereoscopic image quality assessment method based on binocular combination saliency model , 2016, Signal Process..

[22]  Changhe Zhou,et al.  Binocular vision measurement using Dammann grating. , 2015, Applied optics.

[23]  Weisi Lin,et al.  Blind Image Quality Assessment for Stereoscopic Images Using Binocular Guided Quality Lookup and Visual Codebook , 2015, IEEE Transactions on Broadcasting.

[24]  Shengdong Zhao,et al.  ColorBless , 2015, ACM Trans. Comput. Hum. Interact..

[25]  Bo Hu,et al.  A Vision of IoT: Applications, Challenges, and Opportunities With China Perspective , 2014, IEEE Internet of Things Journal.

[26]  Yunde Jia,et al.  Vehicle Type Classification Using a Semisupervised Convolutional Neural Network , 2015, IEEE Transactions on Intelligent Transportation Systems.

[27]  Khaled M. Elleithy,et al.  Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions , 2017, Sensors.

[28]  Lui Sha,et al.  Toward Physiology-Aware DASH: Bandwidth-Compliant Prioritized Clinical Multimedia Communication in Ambulances , 2017, IEEE Transactions on Multimedia.

[29]  David A. Ross Wearable computers as a virtual environment interface for people with visual impairment , 2005, Virtual Reality.

[30]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[31]  Mei Yu,et al.  Monocular-binocular feature fidelity induced index for stereoscopic image quality assessment. , 2015, Applied optics.

[32]  Zhihan Lv,et al.  Quality assessment for virtual reality technology based on real scene , 2016, Neural Computing and Applications.

[33]  Aleksandr Ometov,et al.  Facilitating the Delegation of Use for Private Devices in the Era of the Internet of Wearable Things , 2017, IEEE Internet of Things Journal.

[34]  Yongkang Wong,et al.  Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition , 2011, CVPR 2011 WORKSHOPS.

[35]  Weilin Huang,et al.  Text-Attentional Convolutional Neural Network for Scene Text Detection , 2015, IEEE Transactions on Image Processing.

[36]  D. Pascolini,et al.  Global estimates of visual impairment: 2010 , 2011, British Journal of Ophthalmology.

[37]  Heiga Zen,et al.  Deep Learning for Acoustic Modeling in Parametric Speech Generation: A systematic review of existing techniques and future trends , 2015, IEEE Signal Processing Magazine.

[38]  Lui Sha,et al.  Data-Centered Runtime Verification of Wireless Medical Cyber-Physical System , 2017, IEEE Transactions on Industrial Informatics.

[39]  Hao Wang,et al.  Wearable Sensor Localization Considering Mixed Distributed Sources in Health Monitoring Systems , 2016, Sensors.

[40]  Fiona Rowe,et al.  Screening methods for post-stroke visual impairment: a systematic review , 2017, Disability and rehabilitation.

[41]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Baihua Li,et al.  A Fast Image Retrieval Method Designed for Network Big Data , 2017, IEEE Transactions on Industrial Informatics.

[43]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Wang Yi,et al.  Noninvasive and Continuous Blood Pressure Monitoring Using Wearable Body Sensor Networks , 2015, IEEE Intelligent Systems.

[45]  Jill L. King,et al.  Forced choice and ordinal discrete rating assessment of image quality: A comparison , 2009, Journal of Digital Imaging.

[46]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[47]  Lin Ma,et al.  Learning structure of stereoscopic image for no-reference quality assessment with convolutional neural network , 2016, Pattern Recognit..

[48]  David W. Murray,et al.  On the Choice and Placement of Wearable Vision Sensors , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[49]  Mark A. Georgeson,et al.  Contrast and lustre: A model that accounts for eleven different forms of contrast discrimination in binocular vision , 2016, Vision Research.

[50]  Xiaojun Cao,et al.  Ubiquitous WSN for Healthcare: Recent Advances and Future Prospects , 2014, IEEE Internet of Things Journal.

[51]  A E Fletcher,et al.  Prevalence of visual impairment in people aged 75 years and older in Britain: results from the MRC trial of assessment and management of older people in the community , 2002, The British journal of ophthalmology.