Skin Color Based Hand and Finger Detection for Gesture Recognition in CCTV Surveillance

In this paper, we proposed the skin color based hand and finger detection technology for the gesture recognition in CCTV surveillance. The aim of this paper is to present the methodology for hand detection and propose the finger detection method. The detected hand and finger can be used to implement the non-contact mouse. This technology can be used to control the home devices such as home-theater and television. Skin color is used to segment the hand region from background and contour is extracted from the segmented hand. Analysis of contour gives us the location of finger tip in the hand. After detecting the location of the fingertip, this system tracks the fingertip by using only R channel alone, and in recognition of hand motions to apply differential image, such as the removal of useless image shows a robust side. We explain about experiment which relates in fingertip tracking and finger gestures recognition, and experiment result shows the accuracy above 96%.

[1]  Karl-Friedrich Kraiss,et al.  Extraction of 3D hand shape and posture from image sequences for sign language recognition , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[2]  Roger Cooper,et al.  An expanded, integrated model for determining audience exposure to television , 2009 .

[3]  Seung-Hwan Kim.  Study on Relationship of Channel-Selection-Type & Audiences in TV News , 2007 .

[4]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[5]  Influence of Exhibition Service Attributes on Customer's Satisfaction and Behavior Intention , 2009 .

[6]  Konstantinos G. P. Derpanis,et al.  A Review of Vision-Based Hand Gestures , 2004 .

[7]  Marianne Barrett.  The relationship of network affiliation change to prime time program ratings , 1999 .

[8]  Sung-Hwan Kim,et al.  Predicting the Virtual Temperature of Web-Blog Articles as a Measurement Tool for Online Popularity , 2011, 2011 IEEE 11th International Conference on Computer and Information Technology.

[9]  Ying Wu,et al.  Capturing articulated human hand motion: a divide-and-conquer approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Gary L. Frazier,et al.  Dealer Dependence Levels and Reciprocal Actions in a Channel of Distribution in a Developing Country , 1989 .

[11]  W. Leontief.  Quantitative Input and Output Relations in the Economic Systems of the United States , 1936 .

[12]  Mary Jo Bitner,et al.  Servicescapes: The Impact of Physical Surroundings on Customers and Employees: , 1992 .

[13]  J. Russell,et al.  A Description of the Affective Quality Attributed to Environments , 1980 .

[14]  Tosiyasu L. Kunii,et al.  Model-based analysis of hand posture , 1995, IEEE Computer Graphics and Applications.

[15]  Amit P. Sheth,et al.  Semantic analytics on social networks: experiences in addressing the problem of conflict of interest detection , 2006, WWW '06.

[16]  Douglas A. Ferguson,et al.  The World Wide Web as a Functional Alternative to Television , 2000 .

[17]  Dug-Chun Park.  Correlation between Genre and Image Expression Technique of TV Drama , 2009 .

[18]  Young-Kook Kim.  The Emotional Expression Character study of Utilizing Advertising Media , 2010 .

[19]  Jacob J. Wakshlag,et al.  A THEORY OF TELEVISION PROGRAM CHOICE , 1983 .

[20]  Christoforos Kachris,et al.  Configurable Transactional Memory , 2007 .

[21]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Jonathan Cohen,et al.  Television Viewing Preferences: Programs, Schedules, and the Structure of Viewing Choices Made by Israeli Adults , 2002 .

[23]  José Manuel Ferrández,et al.  Hand-based Interface for Augmented Reality , 2007, 15th Annual IEEE Symposium on Field-Programmable Custom Computing Machines (FCCM 2007).

[24]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[25]  Positioning and Price: Merging Theory, Strategy, and Tactics , 1991 .

[26]  Marcelo Knörich Zuffo,et al.  An experience using X3D for virtual cultural heritage , 2007, Web3D '07.

[27]  Hung-Yu Kao,et al.  Blog Popularity Mining Using Social Interconnection Analysis , 2010, IEEE Internet Computing.

[28]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[29]  Hwan-Gue Cho,et al.  Analysis and Visualization for Comment Messages of Internet Posts , 2009 .

[30]  Vijendran G. Venkoparao,et al.  Face Detection by using Skin Color Model based on One Class Classifier , 2006, 9th International Conference on Information Technology (ICIT'06).

[31]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[32]  Wolfgang Nejdl,et al.  Search strategies for scientific collaboration networks , 2005, P2PIR '05.

[33]  Ying Wu,et al.  Hand modeling, analysis and recognition , 2001, IEEE Signal Process. Mag..

[34]  Dimitris N. Metaxas,et al.  Toward Scalability in ASL Recognition: Breaking Down Signs into Phonemes , 1999, Gesture Workshop.

[35]  Ecosystem Configuration and its Structure of Cultural Contents -Focused on Busan International Motor Show- , 2010 .

[36]  Alan B. Albarran,et al.  Profile: An examination of television motivations and program preferences by Hispanics, blacks, and whites , 1993 .

[37]  Yan Wei,et al.  Application of Visualization Technology in Spatial Data Mining , 2010, 2010 International Conference on Computing, Control and Industrial Engineering.

[38]  Jung-Hyun Lee,et al.  User Preference Mining through Hybrid Collaborative Filtering and Content-Based Filtering in Recommendation System , 2004, IEICE Trans. Inf. Syst..

[39]  Christian Homburg,et al.  Applications of structural equation modeling in marketing and consumer research: A review , 1996 .

[40]  A. Waibel,et al.  MULTIMODAL HUMAN-COMPUTER INTERACTION , 1993 .

[41]  Mubarak Shah,et al.  Visual gesture recognition , 1994 .

[42]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Kristina Lerman,et al.  Social Information Processing in News Aggregation , 2007, IEEE Internet Computing.

[44]  Roland T. Chin,et al.  On image analysis by the methods of moments , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Yoshiaki Shirai,et al.  Real-time 3D hand posture estimation based on 2D appearance retrieval using monocular camera , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[46]  Bernardo A. Huberman,et al.  Predicting the popularity of online content , 2008, Commun. ACM.

[47]  James G. Webster,et al.  Audience Behavior in the New Media Environment , 1986 .

[48]  R.M. McElhaney,et al.  Algorithms for graphics and image processing , 1983, Proceedings of the IEEE.

[49]  Farid Boussaïd,et al.  On-chip skin detection for color CMOS imagers , 2003, Proceedings International Conference on MEMS, NANO and Smart Systems.

[50]  Isabel Gauthier,et al.  Are Greebles like faces? Using the neuropsychological exception to test the rule , 2004, Neuropsychologia.