Methods for troubleshooting a video before assessing its clinical impact

No techniques have been established for assessing quality or troubleshooting video materials before evaluating their clinical effectiveness - for example in a randomized controlled trial (RCT). This paper reports three studies leading to the development of such techniques. In the first study 20 adults rated successive video clips for informativeness and style giving separate ratings for visual presentation and spoken commentary. Pooling across raters yielded a profile of the high and low points within the video. The profile for the first video was replicated across two participant groups, each of 20 adults. This profiling technique identified potential trouble-spots within an HRT video and potential repairs were assessed in Study 2 where the rating procedure was changed to a pairwise comparison, enabling revisions to be evaluated against original clips by another 24 adults. The outcome of this comparison was validated in Study 3 using the full profiling procedure and substituting the revised clips for the originals. These studies show that the quick and simple rating techniques developed in Studies 1 and 2 offer ways of checking the micro-quality of a video and identifying potential trouble-spots. This enables weaknesses to be removed before the effectiveness of the video is evaluated in a clinical context.

[1]  Martin Tattersall,et al.  Informing Patients: An Assessment of the Quality of Patient Information Materials , 1999, BMJ.

[2]  Christopher D. Wickens,et al.  Guidelines for Presenting Quantitative Data in HFES Publications , 1998, Hum. Factors.

[3]  I. Masters,et al.  Educating young children about asthma: comparing the effectiveness of a developmentally appropriate asthma education video tape and picture book. , 1998, Child: care, health and development.

[4]  P Smith,et al.  Randomised controlled trial comparing effectiveness of touch screen system with leaflet for providing women with information on prenatal tests. , 2000, BMJ.

[5]  Howard Wainer,et al.  Visual Revelations: Graphical Tales of Fate and Deception from Napoleon Bonaparte to Ross Perot , 1997 .

[6]  R. H. Finn.  Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings , 1972 .

[7]  Stephen M. Kosslyn,et al.  Elements of graph design , 1993 .

[8]  R. Robinson,et al.  Comprehension in Patient Literature: The Importance of Text and Reader Characteristics , 1994 .

[9]  W. DeJong,et al.  Reducing AIDS and other STDs among inner-city Hispanics: the use of qualitative research in the development of video-based patient education. , 1994, AIDS education and prevention : official publication of the International Society for AIDS Education.

[10]  Peter M. Chisnall,et al.  Questionnaire Design, Interviewing and Attitude Measurement , 1993 .

[11]  L. Bohon,et al.  The Effects of a Mental Health Video on the Social Skills Knowledge and Attitudes of Mexican Immigrants1 , 1994 .

[12]  Charles G. Martin,et al.  Influence of data display formats on physician investigators' decisions to stop clinical trials: prospective trial with repeated measures , 1999, BMJ.

[13]  J Wyatt.  Same information, different decisions: format counts , 1999, BMJ.

[14]  H. Stevenson,et al.  Impact of culturally sensitive AIDS video education on the AIDS risk knowledge of African-American adolescents. , 1994, AIDS education and prevention : official publication of the International Society for AIDS Education.

[15]  A Coulter,et al.  Sharing decisions with patients: is the information good enough? , 1999, BMJ.

[16]  Gideon Keren,et al.  A Handbook for Data Analysis in the Behavioral Sciences: Statistical Issues , 1993 .

[17]  A. Farmer,et al.  Using interactive videos in general practice to inform patients about treatment choices: a pilot study. , 1995, Family practice.

[18]  D. Wright,et al.  Handbook of Applied Cognition , 1999 .

[19]  Ken Hyland,et al.  Writing: Texts, Processes and Practices , 1999 .