Object Recognition and Selection Method by Gaze Tracking and SURF Algorithm

The goal of this research is to make a robust camera vision system which can help those with disabilities of their hands and feet to select and control home appliances. The proposed method operates by object recognition and awareness of interest by gaze tracking. Our research is novel in the following three ways compared to previous research. First, in order to track the gaze position accurately, we designed a wearable eyeglasses type device for capturing the eye image using a near-infrared (NIR) camera and illuminators. Second, in order to achieve object recognition in the frontal view, which represents the facial gaze position in the real world, an additional wide view camera is attached to the wearable device. Third, for the rapid feature extraction of the objects in the wide view camera, we use the speeded-up robust features (SURF) algorithm, which is robust to deformations such as image rotation, scale changes, and occlusions. The experimental results showed that we obtained a gaze tracking error of only 1.98 degrees and successful matching results of object recognition.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  C. E. Johanson,et al.  Effects of phencyclidine, secobarbital and diazepam on eye tracking in rhesus monkeys , 2004, Psychopharmacology.

[3]  John Daugman,et al.  How iris recognition works , 2002, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Sheng-Wen Shih,et al.  A novel approach to 3-D gaze tracking using stereo cameras , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Myung Jin Chung,et al.  Non-intrusive eye gaze estimation without knowledge of eye pose , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[6]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[7]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[9]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Alastair G. Gale,et al.  A New Gaze-Based Interface for Environmental Control , 2007, HCI.

[11]  David G. Lowe,et al.  Multiclass Object Recognition with Sparse, Localized Features , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Roel Vertegaal,et al.  An eye for an eye: a performance evaluation comparison of the LC technologies and Tobii eye trackers , 2004, ETRA.

[13]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[14]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.