Generating Feedback Reports for Adults Taking Basic Skills Tests

SkillSum is an Artificial Intelligence (AI) and Natural Language Generation (NLG) system that produces short feedback reports for people who are taking online tests which check their basic literacy and numeracy skills. In this paper, we describe the SkillSum system and application, focusing on three challenges which we believe are important ones for many systems which try to generate feedback reports from Web-based tests: choosing content based on very limited data, generating appropriate texts for people with varied levels of literacy and knowledge, and integrating the web-based system with existing assessment and support procedures.

[1]  Daniel Marcu,et al.  Building a Discourse-Tagged Corpus in the Framework of Rhetorical Structure Theory , 2001, SIGDIAL Workshop.

[2]  Robert Dale,et al.  Building Natural Language Generation Systems: Figures , 2000 .

[3]  Martin Chodorow,et al.  CriterionSM Online Essay Evaluation: An Application for Automated Evaluation of Student Essays , 2003, IAAI.

[4]  Siobhan Carey,et al.  Adult literacy in Britain , 1997 .

[5]  Sandra Williams,et al.  Natural Language Generation (NLG) of discourse relations for different reading levels , 2004 .

[6]  G. Meade.  Building a Discourse-Tagged Corpus in the Framework of Rhetorical Structure Theory , 2001 .

[7]  O. M.O.D.  ILEX: An Architecture for a Dynamic Hypertext Generation System , 2001 .

[8]  Ehud Reiter,et al.  Squibs and Discussions: Human Variation and Lexical Choice , 2002, CL.

[9]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[10]  E. Reiter,et al.  Acquiring Correct Knowledge for Natural Language Generation , 2011, J. Artif. Intell. Res..

[11]  Philip Kotler,et al.  Social Marketing: Improving the Quality of Life (2nd Edition) , 2003 .

[12]  Linda Mary McGuire.  Social marketing: Improving the quality of life (2nd edn) (P. Kotler, N. Roberto and N. Lee) , 2004 .

[13]  Benoit Lavoie,et al.  A Fast and Portable Realizer for Text Generation Systems , 1997, ANLP.

[14]  Ehud Reiter,et al.  Generating Readable Texts for Readers with Low Basic Skills , 2005, ENLG.

[15]  Ehud Reiter,et al.  Lessons from a failure: Generating tailored smoking cessation letters , 2003, Artif. Intell..

[16]  Philip Kotler,et al.  Social Marketing: Improving the Quality of Life , 2002 .

[17]  A. Fitzgibbon,et al.  Memories for life: Managing information over a human lifetime , 2004 .

[18]  Ehud Reiter,et al.  Deriving content selection rules from a corpus of non-naturally occurring documents for a novel NLG application , 2005 .

[19]  C. Perfetti.  Psycholinguistics and reading ability. , 1994 .