Does prediction really help in Marathi text input?: empirical analysis of a longitudinal study

As part of an ongoing standardization effort, we were asked to evaluate Marathi text input mechanisms on smartphones. We undertook a between-subject longitudinal evaluation of four existing keyboards with 153 novice users who participated for 31 sessions each, spread over 3--4 weeks. In this paper, we present the empirical results of the performance of these keyboards and discuss them with respect to their designs. We found that keyboards with logical layouts performed marginally better than keyboards with partially frequency-based layouts. Results also showed that users performed poorly on keyboards that have word prediction features in comparison with keyboards that don't have prediction features while typing Marathi. We speculate that this difference in performance is related to a "cognitive toll" that the users pay to use word prediction. We identify several directions for future research.

[1]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[2]  I. Scott MacKenzie,et al.  Gathering text entry metrics on android devices , 2011, CHI EA '11.

[3]  I. Scott MacKenzie,et al.  Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric , 2003, CHI '03.

[4]  Dinesh Katre.  Position Paper on "Cross-cultural Usability Issues of Bilingual (Hindi & English) Mobile Phones" , 2006 .

[5]  Tony McEnery,et al.  EMILLE, A 67-Million Word Corpus of Indic Languages: Data Collection, Mark-up and Harmonisation , 2002, LREC.

[6]  Anirudha Joshi,et al.  Corpus of Marathi Word Frequencies from Touch-Screen Devices Using Swarachakra Android Keyboard , 2014, IHCI.

[7]  Horabail S. Venkatagiri.  Efficiency of lexical prediction as a communication acceleration technique , 1993 .

[8]  Per Ola Kristensson,et al.  A versatile dataset for text entry evaluations based on genuine mobile emails , 2011, Mobile HCI.

[9]  Tom Page,et al.  Usability of text input interfaces in smartphones , 2013 .

[10]  Simon P. Levine,et al.  Modeling the speed of text entry with a word prediction interface , 1994 .

[11]  Jugal K. Kalita,et al.  Design and Evaluation of Soft Keyboards for Brahmic Scripts , 2013, TALIP.

[12]  Shumin Zhai,et al.  Foundational Issues in Touch-Surface Stroke Gesture Design - An Integrative Review , 2012, Found. Trends Hum. Comput. Interact..

[13]  Denis Anson,et al.  The Effects of Word Completion and Word Prediction on Typing Rates Using On-Screen Keyboards , 2006, Assistive technology : the official journal of RESNA.

[14]  I. Scott MacKenzie,et al.  A Study of Variations of QWERTY Soft Keyboards for Mobile Phones , 2013 .

[15]  Shumin Zhai,et al.  The word-gesture keyboard: reimagining keyboard interaction , 2012, CACM.

[16]  Anshuman Kumar,et al.  Saral : Devanagari Text input system in Mobile phones , 2009 .

[17]  Mark D. Dunlop,et al.  Predictive text entry methods for mobile phones , 2000, Personal Technologies.

[18]  Kumiko Tanaka-Ishii,et al.  Text Entry Systems: Mobility, Accessibility, Universality , 2007 .

[19]  I. Scott MacKenzie,et al.  Text Entry for Mobile Computing: Models and Methods,Theory and Practice , 2002, Hum. Comput. Interact..

[20]  Mark D. Dunlop,et al.  AdapTex: contextually adaptive text entry for mobiles , 2006, Mobile HCI.

[21]  S. Ghosh,et al.  Virtual keyboard design: State of the arts and research issues , 2010, 2010 IEEE Students Technology Symposium (TechSym).

[22]  Anirudha Joshi,et al.  A Protocol to Evaluate Virtual Keyboards for Indian Languages , 2015, IndiaHCI.

[23]  Gökhan Tür,et al.  Statistical Morphological Disambiguation for Agglutinative Languages , 2000, COLING.

[24]  I. Scott MacKenzie,et al.  Text entry using soft keyboards , 1999, Behav. Inf. Technol..

[25]  Kathleen F. McCoy,et al.  User Interaction with Word Prediction: The Effects of Prediction Quality , 2009, TACC.

[26]  Shumin Zhai,et al.  Both complete and correct?: multi-objective optimization of touchscreen keyboard , 2014, CHI.

[27]  D. Jeffery Higginbotham,et al.  Evaluation of keystroke savings across five assistive communication technologies , 1992 .

[28]  Manoj Kumar Sharma,et al.  Word Prediction System for Text Entry in Hindi , 2014, ACM Trans. Asian Lang. Inf. Process..

[29]  David Wells,et al.  Evaluating the Benefits of Displaying Word Prediction Lists on a Personal Digital Assistant at the Keyboard Level , 2009, Assistive technology : the official journal of RESNA.

[30]  Anirudha Joshi,et al.  Design and evaluation of Devanagari virtual keyboards for touch screen mobile phones , 2011, Mobile HCI.

[31]  Dhaval Joshi,et al.  Solving the great Indian text input puzzle: touch screen-based mobile text input design , 2011, Mobile HCI.

[32]  L. M. Po,et al.  Dynamic candidate keypad for stroke-based Chinese input method on touchscreen devices , 2011, 2011 IEEE Symposium on Computers & Informatics.

[33]  Anirudha Joshi,et al.  Keylekh: a keyboard for text entry in indic scripts , 2004, CHI EA '04.