Collaborative Critical Incident Development

We have been using critical incidents to research the design and evaluation of computer-mediated collaborative and communication technologies for use in K-12 education. A variety of methods have generated a number of critical incidents identified during classroom evaluations. To enhance our analysis and understanding of these incidents, we developed a Web-based forum called the collaborative critical incident tool (CCIT). Users (teachers) and researchers collaboratively post, rate incident criticality, and elaborate on critical incidents through sustained dialog, contributing to the understanding of underlying conditions, causes, and implications. In this paper we describe the tool and its impact on evaluation.

[1]  Saul Greenberg,et al.  Computer-supported cooperative work and groupware , 1991 .

[2]  H. Rex Hartson,et al.  Remote evaluation for post-deployment usability improvement , 1998, AVI '98.

[3]  Robert C. Williges,et al.  A Critical Incident Evaluation Tool For Software Documentation , 1987 .

[4]  John M. Carroll,et al.  Multi-faceted evaluation for complex, distributed activities , 1999, CSCL.

[5]  John Bowers,et al.  The work to make a network work: studying CSCW in action , 1994, CSCW '94.

[6]  Mary Beth Rosson,et al.  Critical incidents and critical threads in empirical usability evaluation , 1993 .

[7]  Thomas B. Malone,et al.  Human Factors and Human Error , 1990 .

[8]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[9]  David Meister,et al.  Behavioral Analysis and Measurement Methods , 1985 .

[10]  Lee Sproull,et al.  Connections: New Ways of Working in the Networked Organization , 1991 .

[11]  P. T. Hughes,et al.  CoOpLab: practical experiences with evaluating a multi-user system , 1993 .

[12]  L. Shattuck,et al.  The Critical Incident Technique: 40 Years Later , 1994 .

[13]  Andrew F. Monk,et al.  Evaluation for design , 1990 .

[14]  Clifford A. Shaffer,et al.  Designing collaborative applications for classroom use: the LiNC project , 1998 .

[15]  Grace Fivars,et al.  The Critical Incident Technique: A Bibliography. , 1973 .

[16]  Bengt-Erik Andersson,et al.  Studies in the reliability and validity of the critical incident technique. , 1964 .

[17]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[18]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.