Project Deliverable Report D5.1 - Writing Support and Feedback Design

(for dissemination) This report is about the way to deliver relevant feedback to students’ written production, either for free texts (e.g., essays, syntheses, notes) or chat conversation, in order for the students to build knowledge. This report presents an overview and a selection of existing models, methods and resources for: 1) the automatic analysis of learner interactions using language technologies or social network analysis (Task 5.1) and 2) the automatic analysis of learner text (Task 5.2). Secondly, a proposition of the tools to be developed for the project is presented, with their possible scenarios of use.

[1]  A. Inkeles,et al.  International Encyclopedia of the Social Sciences. , 1968 .

[2]  Terry Winograd,et al.  Understanding natural language , 1974 .

[3]  V. Voloshinov.  Marxism and the philosophy of language , 1973 .

[4]  Leslie J. Briggs,et al.  Principles of Instructional Design , 1974 .

[5]  Michael Halliday,et al.  Cohesion in English , 1976 .

[6]  R. W. Kulhavy.  Feedback in Written Instruction , 1977 .

[7]  Ann L. Brown,et al.  Rating the Importance of Structural Units of Prose Passages: A Problem of Metacognitive Development. , 1977 .

[8]  J. Emig.  Writing as a Mode of Learning , 1977, Landmark Essays.

[9]  Jerry R. Hobbs,et al.  Pronoun resolution , 1977, SGAR.

[10]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[11]  Jerry R. Hobbs.  Resolving pronoun references , 1986 .

[12]  Linda Flower,et al.  The Dynamics of Composing : Making Plans and Juggling Constraints , 1980 .

[13]  Hayes.  identifying the organization of wi iiing processes , 1980 .

[14]  M. Bakhtin,et al.  The Dialogic Imagination: Four Essays , 1981 .

[15]  Ann L. Brown,et al.  Macrorules for summarizing texts: the development of expertise , 1983 .

[16]  Terry Winograd,et al.  Understanding computers and cognition , 1986 .

[17]  Robin R. Vallacher,et al.  What do people think they're doing? Action identification and human behavior. , 1987 .

[18]  Carl Pollard,et al.  A Centering Approach to Pronouns , 1987, ACL.

[19]  M. Scardamalia,et al.  The psychology of written composition , 1987 .

[20]  W. Kintsch.  The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[21]  T. Crooks.  The Impact of Classroom Evaluation Practices on Students , 1988 .

[22]  John V. Dempsey,et al.  A Taxonomy for the Timing of Feedback in Computer-Based Instruction. , 1988 .

[23]  Roy Rada,et al.  Development and application of a metric on semantic nets , 1989, IEEE Trans. Syst. Man Cybern..

[24]  Roy Rada,et al.  Ranking documents with a thesaurus , 1989, JASIS.

[25]  Michal Zellermayer,et al.  The study of teachers' written feedback to students' writing: changes in theoretical considerations and the expansion of research contexts , 1989 .

[26]  R. W. Kulhavy,et al.  Feedback in written instruction: The place of response certitude , 1989 .

[27]  D. Tannen.  Talking Voices: Repetition, Dialogue, and Imagery in Conversational Discourse , 1989 .

[28]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[29]  Michael Hoey,et al.  Patterns of Lexis In Text , 1991 .

[30]  Myoung-Ho Kim,et al.  Information Retrieval Based on Conceptual Distance in is-a Hierarchies , 1993, J. Documentation.

[31]  Michael E. Lesk,et al.  Enhancing the usability of text through computer delivery and formative evaluation: the superbook pr , 1993 .

[32]  William F. Brewer,et al.  The Role of Anomalous Data in Knowledge Acquisition: A Theoretical Framework and Implications for Science Instruction , 1993 .

[33]  Michael Sussna,et al.  Word sense disambiguation for free-text indexing using a massive semantic network , 1993, CIKM '93.

[34]  Martha Palmer,et al.  Verb Semantics and Lexical Selection , 1994, ACL.

[35]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[36]  R. T. Kellogg.  The Psychology of Writing , 1994 .

[37]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[38]  Scott Weinstein,et al.  Centering: A Framework for Modeling the Local Coherence of Discourse , 1995, CL.

[39]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[40]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[41]  Peter W. Foltz,et al.  Latent semantic analysis for text-based research , 1996 .

[42]  Marcia C. Linn,et al.  Cognition and Distance Learning , 1996, J. Am. Soc. Inf. Sci..

[43]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[44]  Gregory K. W. K. Chung,et al.  Methodological Approaches to Online Scoring of Essays. , 1997 .

[45]  D. Ferris.  The Influence of Teacher Commentary on Student Revision , 1997 .

[46]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[47]  David W. Conrath,et al.  Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy , 1997, ROCLING/IJCLCLP.

[48]  Breck Baldwin,et al.  CogNIAC: high precision coreference with limited knowledge and linguistic resources , 1997 .

[49]  Michael L. Littman,et al.  Automatic Cross-Language Retrieval Using Latent Semantic Indexing , 1997 .

[50]  Mary A. Mark,et al.  An Interview Reflection on “Intelligent Tutoring Goes to School in the Big City” , 2015, International Journal of Artificial Intelligence in Education.

[51]  Marti A. Hearst.  Text Tiling: Segmenting Text into Multi-paragraph Subtopic Passages , 1997, CL.

[52]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[53]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[54]  Susan T. Dumais,et al.  Inductive learning algorithms and representations for text categorization , 1998, CIKM '98.

[55]  K. Topping.  Peer Assessment Between Students in Colleges and Universities , 1998 .

[56]  Martin Chodorow,et al.  Combining local context and wordnet similarity for word sense identification , 1998 .

[57]  John Hale,et al.  A Statistical Approach to Anaphora Resolution , 1998, VLC@COLING/ACL.

[58]  Yiming Yang,et al.  Topic Detection and Tracking Pilot Study Final Report , 1998 .

[59]  Christiane Fellbaum,et al.  Combining Local Context and Wordnet Similarity for Word Sense Identification , 1998 .

[60]  Peter W. Foltz,et al.  The Measurement of Textual Coherence with Latent Semantic Analysis. , 1998 .

[61]  Dekang Lin,et al.  An Information-Theoretic Definition of Similarity , 1998, ICML.

[62]  Michael Strube,et al.  Never Look Back: An Alternative to Centering , 1998, COLING-ACL.

[63]  Arthur C. Graesser,et al.  The Foundations and Architecture of Autotutor , 1998, Intelligent Tutoring Systems.

[64]  Peter W. Foltz,et al.  Learning from text: Matching readers and texts by latent semantic analysis , 1998 .

[65]  Judith S. Donath,et al.  Chat circles , 1999, CHI '99.

[66]  Marco Rocha,et al.  Coreference resolution in dialogues in English and Portuguese , 1999, COREF@ACL.

[67]  Joel R. Tetreault.  Analysis of Syntax-Based Pronoun Resolution Methods , 1999, ACL.

[68]  Roy B. Clariana.  Differential Memory Effects for Immediate and Delayed Feedback: A Delta Rule Explanation of Feedback Timing Effects. , 1999 .

[69]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[70]  Claire Cardie,et al.  Noun Phrase Coreference as Clustering , 1999, EMNLP.

[71]  Timothy Koschmann,et al.  Toward a dialogic theory of learning: Bakhtin's contribution to understanding learning in settings of collaboration , 1999, CSCL.

[72]  PaK ivi TynjaK,et al.  Towards expert knowledge ? A comparison between a constructivist and a traditional learning environment in the university , 1999 .

[73]  Peter W. Foltz,et al.  Automated Essay Scoring: Applications to Educational Technology , 1999 .

[74]  R. Sternberg,et al.  The nature of cognition , 2000 .

[75]  Marc Smith,et al.  Conversation trees and threaded chats , 2000, CSCW '00.

[76]  Gerry Stahl,et al.  Developing Summarization Skills through the Use of LSA-Based Feedback , 2000, Interact. Learn. Environ..

[77]  Steven M. Drucker,et al.  The social life of small graphical chat spaces , 2000, CHI.

[78]  Kees van Deemter,et al.  On Coreferring: Coreference in MUC and Related Annotation Schemes , 2000, CL.

[79]  Anna Sfard,et al.  On Reform Movement and the Limits of Mathematical Discourse , 2000 .

[80]  W. Kintsch.  Metaphor comprehension: A computational theory , 2000, Psychonomic bulletin & review.

[81]  Arthur C. Graesser,et al.  Select-a-Kibitzer: A Computer Tool that Gives Meaningful Feedback on Student Compositions , 2000, Interact. Learn. Environ..

[82]  Benoît Lemaire,et al.  Free-Text Assessment in a Virtual Campus , 2000 .

[83]  Walter Kintsch,et al.  Predication , 2001, Cogn. Sci..

[84]  Gerhard Fischer,et al.  LIFELONG LEARNING AND ITS SUPPORT WITH NEW MEDIA , 2001 .

[85]  Hwee Tou Ng,et al.  A Machine Learning Approach to Coreference Resolution of Noun Phrases , 2001, CL.

[86]  Wim de Boer,et al.  Feedback for web-based assignments , 2001, J. Comput. Assist. Learn..

[87]  Benoît Lemaire,et al.  A System to Assess the Semantic Content of Student Essays , 2001 .

[88]  Peter D. Turney.  Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL , 2001, ECML.

[89]  Lars Kai Hansen,et al.  Signal Detection Using Ica: Application to Chat Room Topic Spotting , 2002 .

[90]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[91]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[92]  Marti A. Hearst,et al.  A Critique and Improvement of an Evaluation Metric for Text Segmentation , 2002, CL.

[93]  Eiman Elnahrawy,et al.  Log-Based Chat Room Monitoring Using Text Categorization: A Comparative Study , 2002 .

[94]  Joydeep Ghosh,et al.  Relationship-based clustering and cluster ensembles for high-dimensional data mining , 2002 .

[95]  Carl Bereiter,et al.  Education and Mind in the Knowledge Age , 2002 .

[96]  Benoît Lemaire,et al.  Using Production to Assess Learning: An ILE That Fosters Self-Regulated Learning , 2002, Intelligent Tutoring Systems.

[97]  Thomas K. Landauer,et al.  On the computational basis of learning and cognition: Arguments from LSA , 2002 .

[98]  Andrew McCallum,et al.  Toward Conditional Models of Identity Uncertainty with Application to Proper Noun Coreference , 2003, IIWeb.

[99]  Benoît Lemaire,et al.  Contextual Effects on Metaphor Comprehension: Experiment and Simulation , 2003 .

[100]  Essay Assessment with Latent Semantic Analysis , 2003 .

[101]  Benoît Lemaire,et al.  MODÈLES COGNITIFS ISSUS DE L'ANALYSE DE LA SÉMANTIQUE LATENTE , 2003 .

[102]  Joseph P. Magliano,et al.  Assessing Reading Skill With a Think-Aloud Procedure and Latent Semantic Analysis , 2003 .

[103]  Keith W. Thiede,et al.  Summarizing can improve metacomprehension accuracy , 2003 .

[104]  Claire Cardie,et al.  Bootstrapping Coreference Classifiers with Multiple Machine Learning Algorithms , 2003, EMNLP.

[105]  Ana Gabriela Maguitman,et al.  Topic Extraction and Extension to Support Concept Mapping , 2003, FLAIRS.

[106]  Salvatore Valenti,et al.  An Overview of Current Research on Automated Essay Grading , 2003, J. Inf. Technol. Educ..

[107]  Thomas L. Griffiths,et al.  Integrating Topics and Syntax , 2004, NIPS.

[108]  Young-Woo Seo,et al.  Text clustering for topic detection , 2004 .

[109]  R. Bangert-Drowns,et al.  The Effects of School-Based Writing-to-Learn Interventions on Academic Achievement: A Meta-Analysis , 2004 .

[110]  Virginie Zampa,et al.  Latent Semantic Analysis for User Modeling , 2004, Journal of Intelligent Information Systems.

[111]  Chaomei Chen,et al.  Mining the Web: Discovering knowledge from hypertext data , 2004, J. Assoc. Inf. Sci. Technol..

[112]  E. Mory.  Feedback research revisited. , 2004 .

[113]  Henry Tirri,et al.  Combining Topic Models and Social Networks for Chat Data Mining , 2004, IEEE/WIC/ACM International Conference on Web Intelligence (WI'04).

[114]  Alan F. Smeaton,et al.  SeLeCT: a lexical cohesion based news story segmentation system , 2004, AI Commun..

[115]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[116]  John D. Lafferty,et al.  Statistical Models for Text Segmentation , 1999, Machine Learning.

[117]  Tom Carey.  Commentary on: Koper, R. (2004). Use of the Semantic Web to Solve Some Basic Problems in Education , 2004 .

[118]  D. McNamara.  SERT: Self-Explanation Reading Training , 2004 .

[119]  Susan Gauch,et al.  ChatTrack: Chat Room Topic Detection Using Classification , 2004, ISI.

[120]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[121]  Andrew McCallum,et al.  Conditional Models of Identity Uncertainty with Application to Noun Coreference , 2004, NIPS.

[122]  Ellen Riloff,et al.  Unsupervised Learning of Contextual Role Knowledge for Coreference Resolution , 2004, NAACL.

[123]  Hiroyuki Kitagawa,et al.  A Comparative Study of Feature Vector-Based Topic Detection Schemes for Text Streams , 2005 .

[124]  M. Cole,et al.  Mind in society: The development of higher psychological processes. L. S. Vygotsky. , 1978 .

[125]  Dunja Mladenic,et al.  Semi-automatic Construction of Topic Ontologies , 2005, EWMF/KDO.

[126]  John M. Keller,et al.  Principles of instructional design, 5th edition , 2005 .

[127]  P. Dessus,et al.  L'enseignement en tant que supervision d'un environnement dynamique , 2005 .

[128]  Jennifer Wiley,et al.  Putting the Comprehension in Metacomprehension , 2005 .

[129]  A. Stocco,et al.  Syntactic comprehension in agrammatism: A computational model , 2005, Brain and Language.

[130]  Benoît Lemaire,et al.  Computational cognitive models of summarization assessment skills , 2005 .

[131]  Marian Petre,et al.  A Research Taxonomy for Latent Semantic Analysis- Based Educational Applications , 2005 .

[132]  Torsten Holmer,et al.  Explicit Referencing in Learning Chats: Needs and Acceptance , 2006, EC-TEL.

[133]  Simone Paolo Ponzetto,et al.  Semantic Role Labeling for Coreference Resolution , 2006, EACL.

[134]  S. Lindblom-Ylänne,et al.  Self-, peer- and teacher-assessment of student essays , 2006 .

[135]  Jihie Kim,et al.  Learning to Detect Conversation Focus of Threaded Discussions , 2006, NAACL.

[136]  Hsin-Hsi Chen,et al.  Novel Association Measures Using Web Search with Double Checking , 2006, ACL.

[137]  Mehran Sahami,et al.  A web-based kernel function for measuring the similarity of short text snippets , 2006, WWW '06.

[138]  Benoît Lemaire,et al.  A computational model for simulating text comprehension , 2006, Behavior research methods.

[139]  Geraldine Clarebout,et al.  Tool use in computer-based learning environments: towards a research framework , 2006, Comput. Hum. Behav..

[140]  Roy B. Clariana,et al.  The criterion-related validity of a computer-based approach for scoring concept maps , 2006 .

[141]  Bernard R. Gifford,et al.  Computer-Based Assessment in E-Learning: A Framework for Constructing "Intermediate Constraint" Questions and Tasks for Technology Platforms , 2006 .

[142]  Robert J. Mislevy,et al.  Automated scoring of complex tasks in computer-based testing , 2006 .

[143]  Kôiti Hasida,et al.  POLYPHONET: an advanced social network extraction system from the web , 2006, WWW '06.

[144]  Marilyn Hughes Blackmon,et al.  Automating Usability Evaluation : Cognitive Walkthrough for the Web Puts LSA to Work on Real-World HCI Design Problems , 2006 .

[145]  P. Elango.  Coreference Resolution : A Survey , 2006 .

[146]  V. Shute.  Focus on Formative Feedback , 2007 .

[147]  Stefan Trausan-Matu,et al.  Visual Analysis and Assessment of Collaborative Learning in Chat Conversations , 2007 .

[148]  S. Graham,et al.  A meta-analysis of writing instruction for adolescent students. , 2007 .

[149]  Philippe Dessus,et al.  Modeling summarization assessment strategies with LSA , 2007 .

[150]  Summary Street®: Computer-guided Summary writing , 2007 .

[151]  Vincent Ng,et al.  Shallow Semantics for Coreference Resolution , 2007, IJCAI.

[152]  Jose Quesada.  Spaces for Problem Solving , 2007 .

[153]  Vittorio Scarano,et al.  CoFFEE : Cooperative Face2Face educational environment , 2007, 2007 International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2007).

[154]  Kôiti Hasida,et al.  POLYPHONET: An advanced social network extraction system from the Web , 2007, J. Web Semant..

[155]  Stefan Trausan-Matu,et al.  Polyphony, a Knowledge-based Chat System Supporting Collaborative Work , 2007, IDC.

[156]  Victor Kaptelinin,et al.  Group Cognition Computer Support for Building Collaborative Knowledge , 2007 .

[157]  Andrew McCallum,et al.  First-Order Probabilistic Models for Coreference Resolution , 2007, NAACL.

[158]  Dan Klein,et al.  Unsupervised Coreference Resolution in a Nonparametric Bayesian Model , 2007, ACL.

[159]  Peter Van Rosmalen,et al.  A support model for question answering , 2007 .

[160]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[161]  R. Mitkov.  ANAPHORA RESOLUTION: THE STATE OF THE ART , 2007 .

[162]  Marc W Howard,et al.  Semantic Structure and Episodic Memory , 2007 .

[163]  Stefan Trausan-Matu,et al.  Polyphonic Inter-Animation of Voices in Chats , 2007 .

[164]  Ron Sun,et al.  The Cambridge Handbook of Computational Psychology , 2008 .

[165]  Benoît Lemaire,et al.  A semantic space for modeling children's semantic memory , 2007, ArXiv.

[166]  Benoît Lemaire,et al.  Effects of High-Order Co-occurrences on Word Semantic Similarities , 2006, ArXiv.

[167]  Virginie Zampa,et al.  What is teaching? Cognitive-based tutoring principles for the design of a learning environment. , 2008 .

[168]  Christian D. Schunn,et al.  The nature of feedback: how different types of peer feedback affect writing performance , 2009 .

[169]  Traian Rebedea,et al.  Polyphonic Inter-Animation of Voices in VMT , 2009 .