Improving Virtual Keyboards When All Finger Positions Are Known

Current virtual keyboards are known to be slower and less convenient than physical QWERTY keyboards because they simply imitate the traditional QWERTY keyboards on touchscreens. In order to improve virtual keyboards, we consider two reasonable assumptions based on the observation of skilled typists. First, the keys are already assigned to each finger for typing. Based on this assumption, we suggest restricting each finger to entering pre-allocated keys only. Second, non-touching fingers move in correlation with the touching finger because of the intrinsic structure of human hands. To verify of our assumptions, we conducted two experiments with skilled typists. In the first experiment, we statistically verified the second assumption. We then suggest a novel virtual keyboard using our observations. In the second experiment, we show that our suggested keyboard outperforms existing virtual keyboards.

[1]  Elaine Lawrence,et al.  Liquid Keyboard : An Ergonomic, Adaptive QWERTY Keyboard for Touchscreens and Surfaces , 2011 .

[2]  Kentaro Go,et al.  CATKey: Customizable and Adaptable Touchscreen Keyboard with Bubble Cursor-Like Visual Feedback , 2007, INTERACT.

[3]  Jeongmin Son,et al.  TapBoard: making a touch screen keyboard more touchable , 2013, CHI Extended Abstracts.

[4]  Katsuhito Fujimoto,et al.  Gesture keyboard requiring only one camera , 2011, UIST '11 Adjunct.

[5]  Dirk Wenig,et al.  HoverZoom: making on-screen keyboards more accessible , 2014, CHI Extended Abstracts.

[6]  T. Salthouse Effects of age and skill in typing. , 1984, Journal of experimental psychology. General.

[7]  Y. H. Chan Biostatistics 305. Multinomial logistic regression. , 2005, Singapore medical journal.

[8]  E. Charbon,et al.  A virtual keyboard system based on Multi-Level Feature Matching , 2008, 2008 Conference on Human System Interactions.

[9]  I. Scott MacKenzie,et al.  An empirical investigation of the novice experience with soft keyboards , 2001, Behav. Inf. Technol..

[10]  Stephen A. Brewster,et al.  Distal tactile feedback for text entry on tabletop computers , 2009, BCS HCI.

[11]  Stephen A. Brewster,et al.  Mobile phones as a tactile display for tabletop typing , 2011, ITS '11.

[12]  Steven Pemberton,et al.  CHI '97 Extended Abstracts on Human Factors in Computing Systems , 1997, CHI 1997.

[13]  I. Scott MacKenzie,et al.  The design and evaluation of a high-performance soft keyboard , 1999, CHI '99.

[14]  Tim Paek,et al.  Usability guided key-target resizing for soft keyboards , 2010, IUI '10.

[15]  Stephen Brewster,et al.  Distal tactile feedback for text entry on tabletop computers , 2009 .

[16]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[17]  Andrew Sears,et al.  Improving Touchscreen Keyboards: Design Issues and a Comparison with Other Devices , 1991, Interact. Comput..

[18]  I. Scott MacKenzie,et al.  Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric , 2003, CHI '03.

[19]  Daniel J. Wigdor,et al.  Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces , 2011, CHI.

[20]  Ben Shneiderman,et al.  Investigating touchscreen typing: the effect of keyboard size on typing speed , 1993, Behav. Inf. Technol..

[21]  Hyeonjoong Cho,et al.  Toward Designing a New Virtual Keyboard When All Finger Movements Are Known , 2015, CHI Extended Abstracts.

[22]  Meredith Ringel Morris,et al.  Experiences with and observations of direct-touch tabletops , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[23]  Buntarou Shizuki,et al.  Long-Term Study of a Software Keyboard That Places Keys at Positions of Fingers and Their Surroundings , 2013, HCI.

[24]  Koji Yatani,et al.  The 1line keyboard: a QWERTY layout in a single line , 2011, UIST '11.

[25]  D. Hosmer,et al.  Logistic Regression, Conditional , 2005 .

[26]  Jacob O. Wobbrock,et al.  Personalized input: improving ten-finger touchscreen typing through automatic adaptation , 2012, CHI.

[27]  Barbara S. Chaparro,et al.  Keyboard Performance: iPad Versus Netbook , 2010 .

[28]  T. Salthouse Anticipatory processing in transcription typing. , 1985, The Journal of applied psychology.

[29]  Helmut Krueger,et al.  Performance effects of reduced proprioceptive feedback on touch typists and casual users in a typing task , 1994, Behav. Inf. Technol..

[30]  Antti Oulasvirta,et al.  Improving accuracy in back-of-device multitouch typing: a clustering-based approach to keyboard updating , 2014, IUI.

[31]  Gerald Penn,et al.  Living with a Tabletop: Analysis and Observations of Long Term Office Use of a Multi-Touch Table , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[32]  T. Salthouse Perceptual, cognitive, and motoric aspects of transcription typing. , 1986, Psychological bulletin.

[33]  C. Kwak,et al.  Multinomial Logistic Regression , 2002, Nursing research.

[34]  Antti Oulasvirta,et al.  Sandwich keyboard: fast ten-finger typing on a mobile device with adaptive touch sensing on the back side , 2013, MobileHCI '13.

[35]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[36]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .