An application framework for measuring the performance of a visual servo control of a reaching task for the visually impaired

In this work, we propose a framework that can provide performance metrics with regards to the usability of an assistive device designed to provide visual servoing of a reaching task performed by a visually impaired individual. The framework provides a model and methodology from which performance metrics can be synthesized based on robotic manipular kinematics and an adaptation of Fitts' law for reaching task motions in a 3D environment. The purpose of which is to facilitate an understanding of how well the system's design accommodates the user's natural movement style when performing the reaching task. Use of advances in visual tracking techniques employing scale, view-point, and illumination invariant features are incorporated to allow for a further decoupling of the feature space from the joint-level control space.

[1]  Jagath Samarabandu,et al.  An Object Tracking and Visual Servoing System for the Visually Impaired , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[2]  Sunita Ram,et al.  The people sensor: a mobility aid for the visually impaired , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[3]  Alexei A. Efros,et al.  Discovering objects and their location in images , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  J. Zelek,et al.  A Stereo-vision System for the Visually Impaired , 2000 .

[5]  Rencheng Wang,et al.  An extending Fitts' Law for human upper limb performance evaluation , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Dimitris N. Metaxas,et al.  Human Motion Planning Based on Recursive Dynamics and Optimal Control Techniques , 2000, Proceedings Computer Graphics International 2000.

[8]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[9]  Josef Bigün.  Vision with direction - a systematic introduction to image processing and computer vision , 2006 .

[10]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[12]  Peter Corke,et al.  Visual Control of Robots: High-Performance Visual Servoing , 1996 .

[13]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  A. Murata,et al.  Proposal of two-dimensional effective target width in Fitts' law , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[16]  Nicola J. Ferrier,et al.  Achieving a Fitts law relationship for visual guided reaching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[18]  T. Lindeberg.  Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[19]  Tovi Grossman,et al.  Pointing at trivariate targets in 3D environments , 2004, CHI.

[20]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[21]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[23]  Shraga Shoval,et al.  Computerized obstacle avoidance systems for the blind and visually impaired , 2001 .

[24]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[25]  Andrew Zisserman,et al.  Efficient Visual Content Retrieval and Mining in Videos , 2004, PCM.

[26]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[27]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[28]  Chunxin Yang,et al.  An algorithm for simulating human arm movement considering the comfort level , 2005, Simul. Model. Pract. Theory.

[29]  Iwan Ulrich,et al.  The GuideCane-applying mobile robot technologies to assist the visually impaired , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[30]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[31]  Dimitris N. Metaxas,et al.  Human Motion Planning Based on Recursive Dynamics and Optimal Control Techniques , 2002 .

[32]  Pietro Perona,et al.  Evaluation of Features Detectors and Descriptors Based on 3D Objects , 2005, ICCV.

[33]  Simon Meers,et al.  A vision system for providing the blind with 3D colour perception of the environment , 2005 .

[34]  Lynne E. Parker,et al.  Current State of the Art in Distributed Autonomous Mobile Robotics , 2000 .