Journal of Information Technology Education Known and Unknown Weaknesses in Software Animated Demonstrations (screencasts): a Study in Self-paced Learning Settings

Introduction The ever-growing importance of computer literacy has ensured the continuity of political and scientific interest in computer learning media and environments for over 30 years. Although human-computer interaction research has strived to facilitate the acquisition of software skills, firstly through the design and exploitation of interfaces that have clear intentions, anticipated semiotics, direct manipulations, real world metaphors, and various other exciting qualities (Shneiderman & Plaisant, 2005) and, secondly, by designating 'learnability' as one of the most fundamental usability attributes of software applications (Grossman, Fitzmaurice & Attar, 2009), most idiosyncratic problems related to computer learning remain unsolved. The "paradox of the active user" (Carroll & Rosson, 1987; Fu & Gray, 2004) endures since users persist in realizing tasks in an inefficient way even when demonstrably more efficient procedures exist. The occasional, rather than causal or premeditated, character of computer learning (Phelps, Hase, & Ellis, 2005), as well as various factors such as the impossibility of complete coverage of the computer knowledge domain, the inevitability of knowledge obsolescence (Eisenberg & Fischer, 1993) and the prevalence of unsupported exploratory learning from early on (Carroll & Rosson, 1987), constitute a complex and original learning ecology (Barron, 2004). Computer learning is a complex task that puts a tremendous burden on all computer users, experienced or not (Kiesler, Zdaniuk, Lundmark, & Kraut, 2000), and results in a multiplicity of 'frustrating experiences' and extensive time losses (Lazar, Jones & Shneiderman, 2006). Regardless of the multibillion investments in schools, universities, and corporate training activities (Corrall, 2008; Gupta & Bostrom, 2006), computer learning continues to be viewed as a personal landscape dominated by individual exploratory approaches, even for students and instructors of Computer Science Departments. Software animated demonstrations (SADs), which were developed in the early 1990s and which more recently have come to be known as 'screencasts', have generated new interest as a promising platform for computer users. Many commercial authoring tools, such as TechSmith Camtasia[C] and Adobe Captivate[C], and free authoring tools, such as Articulate ScreenR [C], TechSmith Jing [C]and Wink Screen Recorder[C] have been made available, while a new trend towards sharing screencasts in specially configured web 2.0 platforms (such as www.jingproject.com) or generic user generated video sites (such as www.youtube.com), have also started to gain momentum. SADs, in their primitive form, reproduce a screen-captured usage scenario of a software application. Their definition is usually differentiated on the basis of the presumed presenter or the scenario contents. In most cases, SADs resemble watching an instructor, an expert, a ghost user, a colleague, or even a student providing worked-out examples of software utilization. From a factual point of view, SADs constitute a unique tool for e-learning design, especially for Computer Science instructors, since they promote an easy and affordable way of producing multimedia instructional material that is authentic, situated, and motivating and can be exploited in various educational settings (in the classroom, self-paced, collaboratively, etc.) unlike other kinds of multimedia resources. Instructors, whose role in educational technology adoption has long been underestimated, desperately seek an accessible technology that enables the quick creation/development of software tutorials and that allows them to update the learning material frequently in order to keep up with the pace of software evolution. SADs production, with the use of the last generation of screencasting tools, requires almost a time-frame similar to the one needed for preparing a class demonstration plus the time required for recording it, or, in essence, realizing it for once. …

[1]  Allan Ellis,et al.  Competency, capability, complexity and computers: exploring a new model for conceptualising end-user computer education , 2005, Br. J. Educ. Technol..

[2]  David M. Lane,et al.  The use of animation in software training: Pitfalls and benefits. , 1997 .

[3]  Fred D. Davis,et al.  Improving computer skill training: behavior modeling, symbolic mental rehearsal, and the role of knowledge structures. , 2004, The Journal of applied psychology.

[4]  F. Paas,et al.  How to Optimize Learning From Animated Models: A Review of Guidelines Based on Cognitive Load , 2008 .

[5]  Stephanie W. Haas,et al.  Evaluation of the govstat statistical interactive glossary: implications for just-in-time help , 2005, DG.O.

[6]  S. Schwan,et al.  The cognitive benefits of interactive videos: learning to tie nautical knots , 2004 .

[7]  John Sweller,et al.  Cognitive Load Theory: Instructional Implications of the Interaction between Information Structures and Cognitive Architecture , 2004 .

[8]  Susan M. Harrison A comparison of still, animated, or nonillustrated on-line help with written or spoken instructions in a graphical user interface , 1995, CHI '95.

[9]  J. Sweller,et al.  Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions , 2005 .

[10]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[11]  David Lewis,et al.  Animated Demonstrations: Evidence of Improved Performance Efficiency and the Worked Example Effect , 2009, HCI.

[12]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[13]  Robert P. Bostrom,et al.  End-user training methods: what we know, need to know , 2006, SIGMIS CPR '06.

[14]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[15]  Linda Loos Scarth,et al.  The Corsini Encyclopedia of Psychology and Behavioral Science , 2002 .

[16]  Stephen J. Payne,et al.  Animated Demonstrations for Exploratory Learners , 1992, Interact. Comput..

[17]  Wai-Tat Fu,et al.  Resolving the paradox of the active user: stable suboptimal performance in interactive tasks , 2004, Cogn. Sci..

[18]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[19]  Susan Palmiter,et al.  An evaluation of animated demonstrations of learning computer-based tasks , 1991, CHI.

[20]  Richard Lowe,et al.  Animation and learning: selective processing of information in dynamic graphics , 2003 .

[21]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[22]  Ellyssa Kroski That's Infotainment!: How to Create Your Own Screencasts. , 2009 .

[23]  Albert T. Corbett,et al.  Assessing dynamics in computer-based instruction , 1996, CHI.

[24]  Stephen J. Payne,et al.  Learning to Use a Spreadsheet By Doing and By Watching , 1994, Interact. Comput..

[25]  M. Malbrán The Cambridge Handbook of Multimedia Learning , 2007 .

[26]  Educause 7 Things You Should Know About...Screencasting , 2006 .

[27]  S. Yussen,et al.  Observational learning. , 1979, Science.

[28]  D. Leutner,et al.  Instructional animation versus static pictures: A meta-analysis , 2007 .

[29]  Joanne Oud,et al.  Guidelines for effective online instruction using multimedia screencasts , 2009 .

[30]  Fred D. Davis,et al.  Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition , 2003, Inf. Syst. Res..

[31]  Deborah Compeau,et al.  Application of Social Cognitive Theory to Training for Computer Skills , 1995, Inf. Syst. Res..

[32]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[33]  Tovi Grossman,et al.  A survey of software learnability: metrics, methodologies and guidelines , 2009, CHI.

[34]  Ben Shneiderman,et al.  Workplace user frustration with computers: an exploratory investigation of the causes and severity , 2006, Behav. Inf. Technol..

[35]  Ben Shneiderman,et al.  Show Me! Guidelines for producing recorded demonstrations , 2005, 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05).

[36]  Addie Ehrenstein,et al.  Training for a rapidly changing workplace : applications of psychological research , 1997 .

[37]  Mary Beth Rosson,et al.  Paradox of the active user , 1987 .

[38]  Anna Ertelt,et al.  Making a Difference - Exploiting the Full Potential of Instructionally Designed On-Screen Videos , 2006, ICLS.

[39]  John Rieman,et al.  A field study of exploratory learning strategies , 1996, TCHI.

[40]  Sheila Corrall,et al.  Information literacy strategy development in higher education: An exploratory study , 2008, Int. J. Inf. Manag..

[41]  A. Adam Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[42]  Claire O'Malley,et al.  Using animated demonstrations to teach graphics skills , 1993 .

[43]  Brigid Barron Learning Ecologies for Technological Fluency: Gender and Experience Differences , 2004 .

[44]  Mary C. Dyson,et al.  Are animated demonstrations the clearest and most comfortable way to communicate on-screen instructions? , 2008 .

[45]  M. Omizo,et al.  Modeling , 1983, Encyclopedic Dictionary of Archaeology.

[46]  Fred D. Davis,et al.  Improving Computer Training Effectiveness for Decision Technologies: Behavior Modeling and Retention Enhancement , 2001, Decis. Sci..

[47]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[48]  George Palaigeorgiou,et al.  Students' Attitudes Towards Animated Demonstrations as Computer Learning Tools , 2007, J. Educ. Technol. Soc..

[49]  Ulrik Schroeder,et al.  Animated demonstrations and training wheels interfaces in a complex learning environment , 2008, Interact. Comput..

[50]  Susan Palmiter,et al.  Animated Demonstrations for Learning Procedural Computer-Based Tasks , 1993, Hum. Comput. Interact..

[51]  Robert E. Kraut,et al.  Troubles With the Internet: The Dynamics of Help at Home , 2000, Hum. Comput. Interact..

[52]  Jan L. Plass,et al.  Design factors for educationally effective animations and simulations , 2009, J. Comput. High. Educ..

[53]  Howard Margolis * Increasing struggling learners’ self‐efficacy: what tutors can do and say , 2005 .

[54]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[55]  Susan Palmiter The Effectiveness of Animated Demonstrations for Computer-based Tasks: a Summary, Model and Future Research , 1993, J. Vis. Lang. Comput..