A vision-based technique for assisting visually impaired people and autonomous agents

The paper overviews a vision-based technique that can be instrumental in assisting visually impaired humans in their activities. This category includes both blind people and individuals unable (e.g. due to neural disabilities) to understand semantics of the perceived visual data. Alternatively, the technique can be used as a tool for autonomous agents (e.g. mobile robots) performing in complex environments. No model of the world is used, and the technique is equally suitable to both indoor and outdoor applications. From the machine vision perspective, the method consists in detecting nearly identical (i.e. photometric/geometric distortions and partial occlusions are allowed) fragments in images of unknown and unpredictable contents. The paper focuses on the machine vision aspects of the problem (theory, exemplary results, computational efficiency, etc.). The future development of actual systems assisting the handicapped is only preliminarily highlighted.

[1]  Hung-Khoon Tan,et al.  Near-Duplicate Keyframe Identification With Interest Point Matching and Pattern Learning , 2007, IEEE Transactions on Multimedia.

[2]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[3]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[4]  Duanduan Yang,et al.  A low-dimensional local descriptor incorporating TPS warping for image matching , 2010, Image Vis. Comput..

[5]  Nikolaos G. Bourbakis,et al.  An intelligent assistant for navigation of visually impaired people , 2001, Proceedings 2nd Annual IEEE International Symposium on Bioinformatics and Bioengineering (BIBE 2001).

[6]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[7]  Sazali Yaacob,et al.  Computer aided vision assistance for human blind , 2004, Integr. Comput. Aided Eng..

[8]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Chong-Wah Ngo,et al.  Scale-Rotation Invariant Pattern Entropy for Keypoint-Based Near-Duplicate Detection , 2009, IEEE Transactions on Image Processing.

[10]  Yan Ke,et al.  Efficient Near-duplicate Detection and Sub-image Retrieval , 2004 .

[11]  Lakhmi C. Jain,et al.  Innovations in Intelligent Image Analysis , 2011 .

[12]  Yu-Jin Zhang Semantic-based visual information retrieval , 2006 .

[13]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[14]  Mariusz Paradowski,et al.  Local Keypoints and Global Affine Geometry: Triangles and Ellipses for Image Fragment Matching , 2011 .