A new finger touch detection algorithm and prototype system architecture for pervasive bare-hand human computer interaction

This paper firstly proposes a new algorithm for finger touch detection based on front-projected vision-based table system. The algorithm, taking advantage of shadow information, can locate possible finger touch with low complexity. An adaptive structured light method is introduced to improve the precision of touch detection effectively. Secondly, we present a new prototype system architecture and corresponding hardware design for portable bare-hand human computer interaction (HCI). Experimental results show that the accuracy of touch detection of single finger and multi-finger is 98.3% and 92.6% respectively.

[1]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[2]  Douglas Lanman,et al.  Build your own 3D scanner: 3D photography for beginners , 2009, SIGGRAPH '09.

[3]  Edoardo Charbon,et al.  3D Hand Model Fitting for Virtual Keyboard System , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[4]  Heinz Hugli,et al.  Generation And Use Of Color Pseudo Random Sequences For Coding Structured Light In Active Ranging , 1989, Other Conferences.

[5]  Pranav Mistry.  ThirdEye: a technique that enables multiple viewers to see different content on a single display screen , 2009, SIGGRAPH ASIA '09.

[6]  Hafiz Adnan Habib,et al.  Real time mono vision gesture based virtual keyboard system , 2006, IEEE Transactions on Consumer Electronics.

[7]  Paolo Cignoni,et al.  A low cost 3D scanner based on structured light , 2001 .

[8]  I. Martinez,et al.  VHDL described finger tracking system for real-time human-machine interaction , 2008, 2008 International Conference on Signals and Electronic Systems.

[9]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..

[10]  Pattie Maes,et al.  SixthSense: a wearable gestural interface , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.