Interacting with Digital Signage Using Hand Gestures

Digital signage is a very attractive medium for advertisement and general communications in public open spaces. In order to add interaction capabilities to digital signage displays, special considerations must be taken. For example, the signs' environment and placement might prevent direct access to conventional means of interaction, such as using a keyboard or a touch-sensitive screen. This paper describes a vision-based gesture recognition approach to interact with digital signage systems and discusses the issues faced by such systems. Using Haar-like features and the AdaBoosting algorithm, a set of hand gestures can be recognized in real-time and converted to gesture commands to control and manipulate the digital signage display. A demonstrative application using this gesture recognition interface is also depicted.

[1]  Qing Chen,et al.  Hand Gesture Recognition Using Haar-Like Features and a Stochastic Context-Free Grammar , 2008, IEEE Transactions on Instrumentation and Measurement.

[2]  Aditya Ramamoorthy,et al.  Recognition of dynamic hand gestures , 2003, Pattern Recognit..

[3]  Yuntao Cui,et al.  Appearance-Based Hand Sign Recognition from Intensity Image Sequences , 2000, Comput. Vis. Image Underst..

[4]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[5]  Lars Bretzner,et al.  Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[6]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[7]  Richard Bowden,et al.  A boosted classifier tree for hand shape detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[8]  Ying Wu,et al.  Nonstationary color tracking for vision-based human-computer interaction , 2002, IEEE Trans. Neural Networks.

[9]  John V. Harrison,et al.  An emerging marketplace for digital advertising based on amalgamated digital signage networks , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[10]  Surendra Ranganath,et al.  Gesture recognition via pose classification , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[13]  Shan Lu,et al.  Recognition of local features for camera-based sign language recognition system , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Stephen J. McKenna,et al.  A comparison of skin history and trajectory-based representation schemes for the recognition of user-specified gestures , 2004, Pattern Recognit..