Context-Aware Gestures for Mixed-Initiative Text Editing UIs

This is a pre-copyedited, author-produced PDF of an article accepted for publication in Interacting with computers following peer review. The version of record is available online at: http://dx.doi.org/10.1093/iwc/iwu019

[1]  Alejandro Héctor Toselli,et al.  Multimodal Computer-Assisted transcription of Text Images at Character-Level Interaction , 2012, Int. J. Pattern Recognit. Artif. Intell..

[2]  James Arvo,et al.  A Handwritting-Based Equation Editor , 1999, Graphics Interface.

[3]  Josep Lladós,et al.  A syntactic approach based on distortion-tolerant Adjacency Grammars and a spatial-directed parser to interpret sketched diagrams , 2010, Pattern Recognit..

[4]  David Goldberg,et al.  Stylus user interfaces for manipulating text , 1991, UIST '91.

[5]  Per Ola Kristensson,et al.  Text entry performance of state of the art unconstrained handwriting recognition: a longitudinal user study , 2009, CHI.

[6]  B. J. Fogg,et al.  Credibility and computing technology , 1999, CACM.

[7]  James D. Hollan,et al.  Papiercraft: A gesture-based command system for interactive paper , 2008, TCHI.

[8]  William Buxton,et al.  User learning and performance with marking menus , 1994, CHI '94.

[9]  James A. Landay,et al.  Visual similarity of pen gestures , 2000, CHI.

[10]  Per Ola Kristensson,et al.  Discrete and Continuous Shape Writing for Text Entry and Control , 2007 .

[11]  Yong Zhang,et al.  Hand-Drawn Face Sketch Recognition by Humans and a PCA-Based Algorithm for Forensic Applications , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Alejandro Héctor Toselli,et al.  Computer-assisted transcription of a historical botanical specimen book: organization and process overview , 2014, DATeCH '14.

[13]  Jean Paul Haton,et al.  A Syntactic Approach for Handwritten Mathematical Formula Recognition , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Gerhard Rigoll,et al.  On-line handwritten formula recognition using statistical methods , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[15]  Desney S. Tan,et al.  CueTIP: a mixed-initiative interface for correcting handwriting errors , 2006, UIST.

[16]  Lisa Anthony,et al.  A lightweight multistroke recognizer for user interface prototypes , 2010, Graphics Interface.

[17]  Frank K. Soong,et al.  Word graph based speech rcognition error correction by handwriting input , 2006, ICMI '06.

[18]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[19]  Patrick Baudisch,et al.  Design and analysis of delimiters for selection-action pen gesture phrases in scriboli , 2005, CHI.

[20]  I. Scott MacKenzie,et al.  A performance comparison of two handwriting recognizers , 1999, Interact. Comput..

[21]  Horst Bunke,et al.  The IAM-database: an English sentence database for offline handwriting recognition , 2002, International Journal on Document Analysis and Recognition.

[22]  Ravin Balakrishnan,et al.  The PadMouse: facilitating selection and spatial positioning for the non-dominant hand , 1998, CHI.

[23]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[24]  William Buxton,et al.  A marking based interface for collaborative writing , 1993, UIST '93.

[25]  Anil K. Jain,et al.  Template-based online character recognition , 2001, Pattern Recognit..

[26]  Alexander H. Waibel,et al.  Multimodal error correction for speech user interfaces , 2001, TCHI.

[27]  Alejandro Revuelta-Mart.  A Computer Assisted Speech Transcription System , 2012 .

[28]  Gordon Kurtenbach,et al.  The design and evaluation of marking menus , 1993 .

[29]  Horst Bunke,et al.  Using a Statistical Language Model to Improve the Performance of an HMM-Based Cursive Handwriting Recognition System , 2001, Int. J. Pattern Recognit. Artif. Intell..

[30]  Juan Miguel Vilar,et al.  Speech interaction in a multimodal tool for handwritten text transcription , 2011, ICMI '11.

[31]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[32]  David Goldberg,et al.  Touch-typing with a stylus , 1993, INTERCHI.

[33]  Lisa Anthony,et al.  $N-protractor: a fast and accurate multistroke recognizer , 2012, Graphics Interface.

[34]  Éric Anquetil,et al.  Continuous marking menus for learning cursive pen-based gestures , 2011, IUI '11.

[35]  Reiner Marzinkewitsch.  Operating computer algebra systems by handprinted input , 1991, ISSAC '91.

[36]  Luis A. Leiva,et al.  Interactive Predictive Parsing using a Web-based Architecture , 2010, NAACL.

[37]  Roy Rada,et al.  Interacting WITH Computers , 1989, Interact. Comput..

[38]  William Buxton,et al.  Issues in combining marking and direct manipulation techniques , 1991, UIST '91.

[39]  Alan C. Bovik,et al.  Microprocessor-based recognition of handprinted characters from a tablet input , 1988, Pattern Recognit..

[40]  Frederick Jelinek,et al.  Statistical methods for speech recognition , 1997 .

[41]  Shumin Zhai,et al.  Using strokes as command shortcuts: cognitive benefits and toolkit support , 2009, CHI.

[42]  A. Kosmala,et al.  ON-LINE HANDWRITTEN FORMULA RECOGNITION , 1999 .

[43]  Manfred K. Lang,et al.  Segmentation and recognition of symbols within handwritten mathematical expressions , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[44]  Francisco Montero Simarro,et al.  Multimodal interaction for information retrieval using natural language , 2013, Comput. Stand. Interfaces.

[45]  M. Thomason.  Interactive Pattern Recognition , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Frank K. Soong,et al.  Efficient handwriting correction of speech recognition errors with template constrained posterior (TCP) , 2008, INTERSPEECH.

[47]  Andy Cockburn,et al.  Analysing mouse and pen flick gestures , 2002, CHINZ '02.

[48]  Francisco Casacuberta,et al.  Improving On-line Handwritten Recognition using Translation Models in Multimodal Interactive Machine Translation , 2011, ACL.

[49]  B. Buxton.  The “Natural” Language Of Interaction: A Perspective On Non-Verbal Dialogues , 1989 .

[50]  Per Ola Kristensson,et al.  Parakeet: a continuous speech recognition system for mobile touch-screen devices , 2009, IUI.

[51]  Timothy S. Miller,et al.  Fluid inking: augmenting the medium of free-form inking with gestures , 2006, Graphics Interface.

[52]  Radu-Daniel Vatavu,et al.  Understanding the consistency of users' pen and finger stroke gesture articulation , 2013, Graphics Interface.

[53]  Alejandro Héctor Toselli,et al.  Evaluating an Interactive-Predictive Paradigm on Handwriting Transcription: A Case Study and Lessons Learned , 2011, 2011 IEEE 35th Annual Computer Software and Applications Conference.

[54]  Daniel B. Horn,et al.  Patterns of entry and correction in large vocabulary continuous speech recognition systems , 1999, CHI '99.

[55]  Alejandro Héctor Toselli Rossi,et al.  Study of different interactive editing operations in an assisted transcription system , 2011, ICMI '11.

[56]  Michele Risi,et al.  A Parsing Technique for Sketch Recognition Systems , 2004, 2004 IEEE Symposium on Visual Languages - Human Centric Computing.

[57]  Per Ola Kristensson,et al.  Continuous Recognition and Visualization of Pen Strokes and Touch-Screen Gestures , 2011, SBIM.

[58]  Masataka Goto,et al.  Speech repair: quick error correction just by using selection operation for speech input interfaces , 2005, INTERSPEECH.

[59]  Gilles Bailly,et al.  Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization , 2008, AVI '08.

[60]  Shumin Zhai,et al.  Modeling human performance of pen stroke gestures , 2007, CHI.

[61]  Gary Hardock.  Design issues for line driven text editing/annotation systems , 1991 .

[62]  Abigail Sellen,et al.  An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus , 1993, Hum. Comput. Interact..

[63]  Pascual Martínez-Gómez,et al.  On multimodal interactive machine translation using speech recognition , 2011, ICMI '11.

[64]  Alexander H. Waibel,et al.  Interactive error repair for an online handwriting interface , 1998, CHI Conference Summary.

[65]  Francisco Casacuberta,et al.  Improving on-line handwritten recognition in interactive machine translation , 2014, Pattern Recognit..

[66]  Ravin Balakrishnan,et al.  Simple vs. compound mark hierarchical marking menus , 2004, UIST '04.

[67]  V. Michael Powers.  Pen direction sequences in character recognition , 1973, Pattern Recognit..

[68]  James A. Landay,et al.  SATIN: a toolkit for informal ink-based applications , 2000, UIST '00.

[69]  José-Miguel Benedí,et al.  Interactive Predictive Parsing , 2009, IWPT.

[70]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[71]  Catherine G. Wolf,et al.  The Use of Hand-Drawn Gestures for Text Editing , 1987, Int. J. Man Mach. Stud..

[72]  Alejandro Héctor Toselli,et al.  Multimodal interactive transcription of text images , 2010, Pattern Recognit..

[73]  Yannis A. Dimitriadis,et al.  Towards an art based mathematical editor, that uses on-line handwritten symbol recognition , 1995, Pattern Recognit..

[74]  Claus Bahlmann,et al.  Online handwriting recognition with support vector machines - a kernel approach , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[75]  Francisco Casacuberta,et al.  Multimodal Interactive Pattern Recognition and Applications , 2011 .

[76]  Gang Wang,et al.  Multimodal error correction for continuous handwriting recognition in pen-based user interfaces , 2006, IUI '06.

[77]  Alejandro Héctor Toselli,et al.  Using Mouse Feedback in Computer Assisted Transcription of Handwritten Text Images , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[78]  Wenzhe Li,et al.  Using scribble gestures to enhance editing behaviors of sketch recognition systems , 2012, CHI Extended Abstracts.

[79]  Alejandro Héctor Toselli,et al.  Interactive multimodal transcription of text images using a web-based demo system , 2009, IUI.

[80]  Dean Rubine,et al.  The automatic recognition of gestures , 1992 .

[81]  Alejandro Héctor Toselli Rossi,et al.  Multimodal Interactive Handwritten Text Transcription , 2012, Series in Machine Perception and Artificial Intelligence.

[82]  David Goldberg,et al.  Touch-typing with a stylus (abstract) , 1993, CHI '93.

[83]  Luis A. Leiva,et al.  Error-proof, high-performance, and context-aware gestures for interactive text edition , 2013, CHI Extended Abstracts.

[84]  Francisco Casacuberta,et al.  Interactive machine translation using a web-based architecture , 2010, IUI '10.

[85]  M. E. Stevens.  Selected pattern recognition projects in Europe , 1968, Pattern Recognit..

[86]  Radu-Daniel Vatavu,et al.  Gestures as point clouds: a $P recognizer for user interface prototypes , 2012, ICMI '12.

[87]  Mary LaLomia.  User acceptance of handwritten recognition accuracy , 1994, CHI '94.

[88]  Geoffrey Leech,et al.  The tagged LOB Corpus : user's manual , 1986 .

[89]  Beat Signer,et al.  iGesture: A General Gesture Recognition Framework , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[90]  Francisco Casacuberta,et al.  An Interactive Machine Translation System with Online Learning , 2011, ACL.

[91]  M. Yüksel,et al.  A Ph.D. Thesis , 2014 .

[92]  Kumiko Tanaka-Ishii,et al.  Text Entry Systems: Mobility, Accessibility, Universality , 2007 .

[93]  Paul A. Viola,et al.  Corrective feedback and persistent learning for information extraction , 2006, Artif. Intell..

[94]  Yang Li,et al.  Protractor: a fast and accurate gesture recognizer , 2010, CHI.

[95]  Enrique Vidal,et al.  Multi-modal computer assisted speech transcription , 2010, ICMI-MLMI '10.

[96]  Olivier Bau,et al.  OctoPocus: a dynamic guide for learning gesture-based command sets , 2008, UIST '08.

[97]  Luis A. Leiva,et al.  Transcribing handwritten text images with a word soup game , 2012, CHI Extended Abstracts.

[98]  Ismael García-Varea,et al.  A Computer Assisted Speech Transcription System , 2012, EACL.

[99]  James A. Landay,et al.  Implications for a gesture design tool , 1999, CHI '99.

[100]  Ismael García-Varea,et al.  A multimodal interactive text generation system , 2010, ICMI-MLMI '10.

[101]  Nevin Mahmoud Darwish,et al.  Sketch recognition using particle swarm algorithms , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[102]  Sriganesh Madhvanath,et al.  Principal component analysis for online handwritten character recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..