Adaptive Language Modeling for Word Prediction

We present the development and tuning of a topic-adapted language model for word prediction, which improves keystroke savings over a comparable baseline. We outline our plans to develop and integrate style adaptations, building on our experience in topic modeling to dynamically tune the model to both topically and stylistically relevant texts.

[1]  Tonio Wandmacher,et al.  Methods to Integrate a Language Model with Semantic Information for a Word Prediction Component , 2007, EMNLP.

[2]  Ronald Rosenfeld,et al.  Using story topics for language model adaptation , 1997, EUROSPEECH.

[3]  Jianhua Li,et al.  Semantic knowledge in word completion , 2005, Assets '05.

[4]  Ronald Rosenfeld,et al.  Trigger-based language models: a maximum entropy approach , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Gregory W. Lesher,et al.  EFFECTS OF NGRAM ORDER AND TRAINING TEXT SIZE ON WORD PREDICTION , 1999 .

[6]  Xuedong Huang,et al.  Improved topic-dependent language modeling using information retrieval techniques , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[7]  Kathleen F. McCoy,et al.  Corpus studies in word prediction , 2007, Assets '07.

[8]  Slava M. Katz,et al.  Estimation of probabilities from sparse data for the language model component of a speech recognizer , 1987, IEEE Trans. Acoust. Speech Signal Process..

[9]  Lillian Lee,et al.  Measures of Distributional Similarity , 1999, ACL.

[10]  Alan F. Newell,et al.  The rôle of natural language processing in alternative and augmentative communication , 1998, Natural Language Engineering.

[11]  David Yarowsky,et al.  Dynamic Nonlocal Language Modeling via Hierarchical Topic-Based Adaptation , 1999, ACL.

[12]  Jerome R. Bellegarda.  Large vocabulary speech recognition with multispan statistical language models , 2000, IEEE Trans. Speech Audio Process..

[13]  Marco Baroni,et al.  Exploiting Long Distance Collocational Relations in Predictive Typing , 2003 .

[14]  Tonio Wandmacher,et al.  Training Language Models without Appropriate Language Resources: Experiments with an AAC System for Disabled People , 2006, LREC.

[15]  Gregory W. Lesher.  DOMAIN-SPECIFIC WORD PREDICTION FOR AUGMENTATIVE COMMUNICATION , 2001 .

[16]  Jean-Luc Gauvain,et al.  Language modeling for broadcast news transcription , 1999, EUROSPEECH.

[17]  Kathleen F. McCoy,et al.  Topic modeling in fringe word prediction for AAC , 2006, IUI '06.