Tablet producers offer many utilities for their tablets to attract the users. The virtual keyboard based on camera can be such a utility in the near future. We have designed the strategy for an estimation of the finger positions in a virtual keyboard space and detection of clicking events. This strategy includes the processes: picture capturing, edge detection (finger contour detection), fingertip localization, fingertip tracing and click detection. A key step in the whole strategy is the exact localization of fingertip. In this article we describe in detail three proposed solutions to this task. The first algorithm is based on finding local maxima of the finger contours, and this maximum has to meet certain criteria. The second proposed method uses a curvature function calculated from a traced hand contour - a curvature function has the local maxima at the fingertips. The third method is based on angle between two vectors created from a traced hand contour - angle has a minimum at the point of fingertip. In our article we describe the principles of the three proposed methods as well as the practical experiences that we gained in real conditions.
[1]
Peter Shirley,et al.
Fundamentals of computer graphics
,
2018
.
[2]
Masatoshi Ishikawa,et al.
Fast finger tracking system for in-air typing interface
,
2009,
CHI Extended Abstracts.
[3]
John F. Canny,et al.
A Computational Approach to Edge Detection
,
1986,
IEEE Transactions on Pattern Analysis and Machine Intelligence.
[4]
Edoardo Charbon,et al.
A Virtual Keyboard Based on True-3D Optical Ranging
,
2005,
BMVC.
[5]
Frank E. Pollick,et al.
Using B-spline curves for hand recognition
,
2004,
ICPR 2004.
[6]
Y. Adajania,et al.
Virtual Keyboard Using Shadow Analysis
,
2010,
2010 3rd International Conference on Emerging Trends in Engineering and Technology.
[7]
Katsuhito Fujimoto,et al.
Gesture keyboard requiring only one camera
,
2011,
UIST '11 Adjunct.