Does it really matter whether students' contributions are spoken versus typed in an intelligent tutoring system with natural language?

There is the question of whether learning differs when students speak versus type their responses when interacting with intelligent tutoring systems with natural language dialogues. Theoretical bases exist for three contrasting hypotheses. The speech facilitation hypothesis predicts that spoken input will increase learning, whereas the text facilitation hypothesis predicts typed input will be superior. The modality equivalence hypothesis claims that learning gains will be equivalent. Previous experiments that tested these hypotheses were confounded by automated speech recognition systems with substantial error rates that were detected by learners. We addressed this concern in two experiments via a Wizard of Oz procedure, where a human intercepted the learner's speech and transcribed the utterances before submitting them to the tutor. The overall pattern of the results supported the following conclusions: (1) learning gains associated with spoken and typed input were on par and quantitatively higher than a no-intervention control, (2) participants' evaluations of the session were not influenced by modality, and (3) there were no modality effects associated with differences in prior knowledge and typing proficiency. Although the results generally support the modality equivalence hypothesis, highly motivated learners reported lower cognitive load and demonstrated increased learning when typing compared with speaking. We discuss the implications of our findings for intelligent tutoring systems that can support typed and spoken input.

[1]  Joel A. Michael,et al.  Classifying Student Initiatives and Tutor Responses in Human Keyboard-to-Keyboard Tutoring Sessions , 2002 .

[2]  Danielle S. McNamara,et al.  Using LSA in AutoTutor: Learning Through Mixed-Initiative Dialogue in Natural Language , 2007 .

[3]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[4]  David Moshman,et al.  Exogenous, endogenous, and dialectical constructivism☆ , 1982 .

[5]  Johanna D. Moore,et al.  Using Natural Language Processing to Analyze Tutorial Dialogue Corpora Across Domains Modalities , 2009, AIED.

[6]  Mitsuru Ikeda,et al.  Proceedings of the 8th international conference on Intelligent Tutoring Systems , 2006 .

[7]  Ann L. Brown Motivation to learn and understand: On taking charge of one's own learning. , 1988 .

[8]  L. Steels,et al.  Grounding adaptive language games in robotic agents , 2006, AAAI 2012.

[9]  Reinhard Pekrun,et al.  Boredom in achievement settings: Exploring control–value antecedents and performance outcomes of a neglected emotion. , 2010 .

[10]  Benedict du Boulay Computer-assisted instruction and intelligent tutoring systems , 1993 .

[11]  John R. Anderson,et al.  How Should a Theory of Learning and Cognition Inform Instruction , 2004 .

[12]  D. Tannen Spoken and written language : exploring orality and literacy , 1984 .

[13]  Steve Whittaker,et al.  Theories and methods in mediated communication , 2003 .

[14]  Ann L. Brown,et al.  Reciprocal Teaching of Comprehension-Fostering and Comprehension-Monitoring Activities , 1984 .

[15]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[16]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[17]  Beverley Park Woolf,et al.  Building Intelligent Interactive Tutors , 2008 .

[18]  Arthur C. Graesser,et al.  When Are Tutorial Dialogues More Effective Than Reading? , 2007, Cogn. Sci..

[19]  Thomas Quinlan,et al.  Speech Recognition Technology and Students With Writing Difficulties: Improving Fluency. , 2004 .

[20]  Joseph Psotka,et al.  Intelligent tutoring systems : lessons learned , 1988 .

[21]  S. Tobias Interest, Prior Knowledge, and Learning , 1994 .

[22]  Robert E. Kraut,et al.  Persistence matters: making the most of chat in tightly-coupled work , 2004, CHI.

[23]  Arthur C. Graesser,et al.  Intelligent Tutoring Systems with Conversational Dialogue , 2001, AI Mag..

[24]  Margaret G. McKeown,et al.  Bringing Reading Research to Life. , 2009 .

[25]  Carolyn Penstein Rosé,et al.  The Architecture of Why2-Atlas: A Coach for Qualitative Physics Essay Writing , 2002, Intelligent Tutoring Systems.

[26]  F. Paas,et al.  Measurement of Cognitive Load in Instructional Research , 1994, Perceptual and motor skills.

[27]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[28]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[29]  Kurt VanLehn,et al.  A model of the self-explanation effect. , 1992 .

[30]  Paul J. Feltovich,et al.  Smart machines in education: the coming revolution in educational technology , 2001 .

[31]  Brady Clark,et al.  Advantages of Spoken Language Interaction in Dialogue-Based Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[32]  L. S. Vygotksy Mind in society: the development of higher psychological processes , 1978 .

[33]  Arthur C. Graesser,et al.  Third generation computer tutors: learn from or ignore human tutors? , 1999, CHI Extended Abstracts.

[34]  Patricia D. Mautone,et al.  Social cues in multimedia learning: Role of speaker's voice. , 2003 .

[35]  Hau-San Wong,et al.  Human Computer Interaction , 2006, Encyclopedia of Multimedia.

[36]  J. D. Fletcher,et al.  Opportunities for New “Smart” Learning Environments Enabled by Next-Generation Web Capabilities , 2004 .

[37]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[38]  P. Chandler,et al.  Cognitive Load Theory and the Format of Instruction , 1991 .

[39]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[40]  W. Lewis Johnson,et al.  Tactical Language and Culture Training Systems: Using Artificial Intelligence to Teach Foreign Languages and Cultures , 2008, AAAI.

[41]  Albert T. Corbett,et al.  Cognitive Computer Tutors: Solving the Two-Sigma Problem , 2001, User Modeling.

[42]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[43]  Susanne P. Lajoie,et al.  Sherlock: A Coached Practice Environment for an Electronics Troubleshooting Job. , 1988 .

[44]  Arthur C. Graesser,et al.  Agent Technologies Designed to Facilitate Interactive Knowledge Construction , 2008 .

[45]  Mark R. Lepper,et al.  The wisdom of practice: Lessons learned from the study of highly effective tutors. , 2002 .

[46]  Galia Angelova,et al.  Recent Advances in Natural Language Processing IV: Selected papers from RANLP 2005 , 2007 .

[47]  Michelene T. H. Chi,et al.  Observing Tutorial Dialogues Collaboratively: Insights About Human Tutoring Effectiveness From Vicarious Learning , 2008, Cogn. Sci..

[48]  D. Rubin,et al.  Comparing Correlated but Nonoverlapping Correlations , 1996 .

[49]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[50]  Carolyn Penstein Rosé,et al.  Spoken Versus Typed Human and Computer Dialogue Tutoring , 2006, Int. J. Artif. Intell. Educ..

[51]  Jack Mostow,et al.  Evaluating tutors that listen: an overview of project LISTEN , 2001 .

[52]  Chen-Lin C. Kulik,et al.  Educational Outcomes of Tutoring: A Meta-analysis of Findings , 1982 .

[53]  Joshua Aronson Improving academic achievement: Impact of psychological factors on education , 2002 .

[54]  S. Parker,et al.  Origins of Intelligence , 1983, Springer US.

[55]  Arthur C. Graesser,et al.  Human or Computer? AutoTutor in a Bystander Turing Test , 2002, Intelligent Tutoring Systems.

[56]  Guy Gouardères,et al.  Proceedings of the 6th International Conference on Intelligent Tutoring Systems , 2002 .

[57]  Heather H. Mitchell,et al.  AutoTutor: A tutor with dialogue in natural language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[58]  Stacy Marsella,et al.  Modeling Emotions in the Mission Rehearsal Exercise , 2001 .

[59]  J. Hedberg The Cambridge handbook of multimedia learning , 2007 .

[60]  J. Greeno,et al.  Thinking Practices in Mathematics and Science Learning , 1998 .

[61]  Kurt VanLehn,et al.  Andes: A Coached Problem Solving Environment for Physics , 2000, Intelligent Tutoring Systems.

[62]  D. Tannen Oral and Literate Strategies in Spoken and Written Narratives. , 1982 .

[63]  Diane J. Litman,et al.  ITSPOKE: An Intelligent Tutoring Spoken Dialogue System , 2004, NAACL.

[64]  J. Biggs Enhancing teaching through constructive alignment , 1996 .

[65]  L.T.W. Verhoeven,et al.  Interactive literacy education: facilitating literacy environments through technology , 2008 .