Finger-Stylus for Non Touch-Enable Systems

Since computer was invented, people are using many devices to interact with computer. Initially there were keyboard, mouse etc. but with the advancement of technology, new ways are being discovered that are quite usual and natural to the humans like stylus, touch-enable systems. In the current age of technology, user is expected to touch the machine interface to give input. Hand gesture is such a way to interact with machines where natural bare hand is used to communicate without touching machine interface. It gives a feeling to user that he is interacting in natural way to some human, not with traditional machines. This paper presents a technique where user needs not to touch the machine interface to draw on screen. Here hand finger draws shapes on monitor like stylus, without touching the monitor. This method can be used in many applications including games. The finger was used as an input device that acts like paint-brush or finger-stylus and is used to make shapes in front of the camera. Fingertip extraction and motion tracking were done in Matlab with real time constraints. This work is an early attempt to replace stylus with the natural finger without touching screen.

[1]  Robert Y. Wang.  Practical color-based motion capture , 2011, SCA '11.

[2]  Takeo Kanade,et al.  DigitEyes: Vision-Based Human Hand Tracking , 1993 .

[3]  Ankit Chaudhary,et al.  ABHIVYAKTI: Hand Gesture recognition using Orientation histogram in different light conditions , 2011, IICAI.

[4]  Ankit Chaudhary,et al.  Intelligent Approaches to interact with Machines using Hand Gesture Recognition in Natural way: A Survey , 2011, ArXiv.

[5]  Ankit Chaudhary,et al.  A Survey on Hand Gesture Recognition in Context of Soft Computing , 2011 .

[6]  Michael I. Mandel,et al.  Visual Hand Tracking Using Nonparametric Belief Propagation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[8]  Michael J. Black,et al.  Analysis of gesture and action in technical talks for video indexing , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Michael Eisenberg,et al.  Paints, paper, and programs: first steps toward the computational sketchbook , 2009, TEI.

[10]  Suranga Nanayakkara,et al.  FingerDraw: more than a digital paintbrush , 2013, AH.

[11]  H. Stern,et al.  A gesture-based tool for sterile browsing of radiology images. , 2008, Journal of the American Medical Informatics Association : JAMIA.

[12]  Ankit Chaudhary,et al.  A Health Monitoring System for Elder and Sick Persons , 2013, ArXiv.

[13]  Bruce Gooch,et al.  ARTISTIC VISION : AUTOMATIC DIGITAL PAINTING USING COMPUTER VISION ALGORITHIMS , 2001 .

[14]  Ankit Chaudhary,et al.  Fingertip Detection: A Fast Method with Natural Hand , 2012, ArXiv.

[15]  Ankit Chaudhary,et al.  An ANN Based Approach to Calculate Robotic Fingers Positions , 2011, ACC.

[16]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[17]  Vladimir Pavlovic,et al.  A visual computing environment for very large scale biomolecular modeling , 1997, Proceedings IEEE International Conference on Application-Specific Systems, Architectures and Processors.

[18]  Ankit Chaudhary,et al.  An Efficient Real Time Method of Fingertip Detection , 2011, ArXiv.

[19]  Yoichi Sato,et al.  Fast tracking of hands and fingertips in infrared images for augmented desk interface , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[20]  Jovan Popovic,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH '09.

[21]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[22]  Ankit Chaudhary,et al.  Bent fingers' angle calculation using supervised ANN to control electro-mechanical robotic hand , 2013, Comput. Electr. Eng..

[23]  G.I.S. Ruas,et al.  Real-time video based finger spelling recognition system using low computational complexity Artificial Neural Networks , 2006, 2006 International Telecommunications Symposium.

[24]  Ankit Chaudhary,et al.  Automated switching system for skin pixel segmentation in varied lighting , 2012, 2012 19th International Conference on Mechatronics and Machine Vision in Practice (M2VIP).

[26]  H. M. Cooper,et al.  Sign language recognition : Generalising to more complex corpora , 2010 .

[27]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[28]  Shobhit Maheshwari,et al.  Hand gesture pointing location detection , 2014 .

[29]  Ankit Chaudhary,et al.  A Vision based Real Time System to Control Remote Robotic Hand Fingers , 2011 .

[30]  Hiroomi Hikawa,et al.  Real time gesture recognition system using posture classifier and Jordan recurrent neural network , 2011, The 2012 International Joint Conference on Neural Networks (IJCNN).