Transforming a Regular Screen Into a Touch Screen Using a Single Webcam

Nowadays, touch screens are widely used in many commercial devices. In this paper, we present an inexpensive Webcam-based touch screen system based on a simple and generic finger detection technique. Only a single Webcam and a regular screen are used to achieve this goal. By using the scene geometry and the camera model, we can determine the position of the finger on the screen. The technique we propose is simple and works well under various surrounding environments while the detecting method suits many finger colors and shapes. Our approach can also be used for realtime applications. Experimental results and practical applications are provided to ascertain the proposed method.

[1]  Guozhong Dai,et al.  Tracking of deformable human hand in real time as continuous input for gesture-based interaction , 2007, IUI '07.

[2]  Tien Dzung Nguyen,et al.  Implementation of webcam-based touchscreen , 2010, International Conference on Communications and Electronics 2010.

[3]  Masahiro Takatsuka,et al.  Initial evaluation of a bare-hand interaction technique for large displays using a webcam , 2009, EICS '09.

[4]  Dmitry O. Gorodnichy,et al.  Detection and tracking of pianist hands and fingers , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[5]  Wen Gao,et al.  A vision-based sign language recognition system using tied-mixture density HMM , 2004, ICMI '04.

[6]  Vincenzo Paciello,et al.  A Comparison Between Stereo-Vision Techniques for the Reconstruction of 3-D Coordinates of Objects , 2006, IEEE Transactions on Instrumentation and Measurement.

[7]  袁正,et al.  Infrared touch screen , 2009 .

[8]  Aristodemos Pnevmatikakis,et al.  A realtime mixed reality system for seamless interaction between real and virtual objects , 2008, DIMEA.

[9]  Ye Zhou,et al.  A Real-time Algorithm for Finger Detection in a Camera Based Finger-Friendly Interactive Board System , 2007 .

[10]  Sung Kwan Kang,et al.  Color Based Hand and Finger Detection Technology for User Interaction , 2008, 2008 International Conference on Convergence and Hybrid Information Technology.

[11]  Zhengyou Zhang,et al.  Visual Screen: Transforming an Ordinary Screen into a Touch Screen , 2000, MVA.

[12]  Jane Yung-jen Hsu,et al.  Gesture-based interaction for a magic crystal ball , 2007, VRST '07.

[13]  Ching-Hung Su,et al.  An efficient image retrieval based on HSV color space , 2011, 2011 International Conference on Electrical and Control Engineering.

[14]  W. Marsden.  I and J , 2012 .

[15]  Daeho Lee,et al.  Vision-based remote control system by motion detection and open finger counting , 2009, IEEE Transactions on Consumer Electronics.