Who dotted that 'i'?: context free user differentiation through pressure and tilt pen data

With the proliferation of tablet PCs and multi-touch computers, collaborative input on a single sketched surface is becoming more and more prevalent. The ability to identify which user draws a specific stroke on a shared surface is widely useful in a) security/forensics research, by effectively identifying a forgery, b) sketch recognition, by providing the ability to employ user-dependent recognition algorithms on a multi-user system, and c) multi-user collaborative systems, by effectively discriminating whose stroke is whose in a complicated diagram. To ensure an adaptive user interface, we cannot expect nor require that users will self-identify nor restrict themselves to a single pen. Instead, we prefer a system that can automatically determine a stroke's owner, even when strokes by different users are drawn with the same pen, in close proximity, and near in timing. We present the results of an experiment that shows that the creator of an individual pen strokes can be determined with high accuracy, without supra-stroke context (such as timing, pen-ID, nor location), and based solely on the physical mechanics of how these strokes are drawn (specifically, pen tilt, pressure, and speed). Results from free-form drawing data, including text and doodles, but not signature data, show that our methods differentiate a single stroke (such as that of a dot of an 'i') between two users at an accuracy of 97.5% and between ten users at an accuracy of 83.5%.

[1]  Christopher F. Herot Graphical input through machine recognition of sketches , 1976, SIGGRAPH '76.

[2]  Katherine M. Koppenhaver Forensic Document Examination , 2007 .

[3]  Emile H. L. Aarts,et al.  On-line signature verification with hidden Markov models , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[4]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[5]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[6]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[7]  Takashi Matsumoto,et al.  Effectiveness of Pen Pressure, Azimuth, and Altitude Features for Online Signature Verification , 2007, ICB.

[8]  Tracy Anne Hammond,et al.  Gesture Recognition Based on Manifold Learning , 2008, SSPR/SPR.

[9]  James A. Landay,et al.  "Those look similar!" issues in automating gesture design advice , 2001, PUI '01.

[10]  Thomas F. Stahovich,et al.  Sketch based interfaces: early processing for sketch understanding , 2001, PUI '01.

[11]  Anil K. Jain,et al.  On-line signature verification, , 2002, Pattern Recognit..

[12]  J. Shah,et al.  Collaborative Sketching (C-Sketch)--An Idea Generation Technique for Engineering Design. , 2001 .

[13]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..

[14]  Seiichiro Hangai,et al.  Improvement of On-line Signature Verification System Robust to Intersession Variability , 2002, Biometric Authentication.

[15]  V. S. Nalwa Automatic on-line signature verification , 1997 .

[16]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[17]  Jonas Richiardi,et al.  Local and global feature selection for on-line signature verification , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).