Investigating paper vs. screen in real-life hospital workflows: Performance contradicts perceived superiority of paper in the user experience

Introduction: All hospitals in the province of Styria (Austria) are well equipped with sophisticated Information Technology, which provides all-encompassing on-screen patient information. Previous research made on the theoretical properties, advantages and disadvantages, of reading from paper vs. reading from a screen has resulted in the assumption that reading from a screen is slower, less accurate and more tiring. However, recent flat screen technology, especially on the basis of LCD, is of such high quality that obviously this assumption should now be challenged. As the electronic storage and presentation of information has many advantages in addition to a faster transfer and processing of the information, the usage of electronic screens in clinics should outperform the traditional hardcopy in both execution and preference ratings. This study took part in a County hospital Styria, Austria, with 111 medical professionals, working in a real-life setting. They were each asked to read original and authentic diagnosis reports, a gynecological report and an internal medical document, on both screen and paper in a randomly assigned order. Reading comprehension was measured by the Chunked Reading Test, and speed and accuracy of reading performance was quantified. In order to get a full understanding of the clinicians' preferences, subjective ratings were also collected. Results: Wilcoxon Signed Rank Tests showed no significant differences on reading performance between paper vs. screen. However, medical professionals showed a significant (90%) preference for reading from paper. Despite the high quality and the benefits of electronic media, paper still has some qualities which cannot provided electronically do date.

[1]  Martina Ziefle,et al.  A visual ergonomic evaluation of different screen types and screen technologies with respect to discrimination performance. , 2009, Applied ergonomics.

[2]  J S Allen,et al.  Effects of VDT resolution on visual fatigue and readability: an eye movement approach. , 1989, Ergonomics.

[3]  Martina Ziefle,et al.  Information presentation in small screen devices: the trade-off between visual density and menu foresight. , 2010, Applied ergonomics.

[4]  George K. Hung,et al.  Static vergence and accommodation: population norms and orthoptics effects , 1986, Documenta Ophthalmologica.

[5]  A. Lickorish,et al.  Proof-reading texts on screen and paper , 1983 .

[6]  Andrew Dillon,et al.  Visual search and reading tasks using ClearType and regular displays: two experiments , 2006, CHI.

[7]  W Jaschinski,et al.  Accommodation, convergence, pupil diameter and eye blinks at a CRT display flickering near fusion limit. , 1996, Ergonomics.

[8]  Andrew Dillon,et al.  Myths, misconceptions and an alternative perspective on information usage and the electronic medium , 1996 .

[9]  R. Hendrick,et al.  Performance comparison of full-field digital mammography to screen-film mammography in clinical practice. , 2002, Medical physics.

[10]  Martina Ziefle,et al.  Effects of Display Resolution on Visual Performance , 1998, Hum. Factors.

[11]  Thomas Haigh,et al.  Remembering the Office of the Future: The Origins of Word Processing and Office Automation , 2006, IEEE Annals of the History of Computing.

[12]  B. Chaparro,et al.  The Effects of Line Length on Children and Adults' Online Reading Performance , 2002 .

[13]  Andreas Holzinger,et al.  Mobile computer Web-application design in medicine: some research based guidelines , 2007, Universal Access in the Information Society.

[14]  Abigail Sellen,et al.  The myth of the paperless office , 2001 .

[15]  Ying Liu,et al.  Effects of font size, display resolution and task type on reading Chinese fonts from mobile devices. , 2009 .

[16]  Stephen E. Newstead,et al.  Proof-reading on VDUs , 1987 .

[17]  Carolyn M. Sommerich,et al.  Effects of Computer Monitor Viewing Angle and Related Factors on Strain, Performance, and Preference Outcomes , 2001, Hum. Factors.

[18]  Hiroki Takada,et al.  Visibility and characteristics of the mobile phones for elderly people , 2002, Behav. Inf. Technol..

[19]  William C. Treurniet,et al.  Extended Reading of Continuous Text on Television Screens , 1982 .

[20]  A K Gramopadhye,et al.  Relations between individual differences in oculomotor resting states and visual inspection performance. , 1996, Ergonomics.

[21]  A. Wilkins,et al.  A neurological basis for visual discomfort. , 1984, Brain : a journal of neurology.

[22]  Frank H. Heppner,et al.  Reading Performance on a Standardized Test is Better from Print than from Computer Display. , 1985 .

[23]  Andreas Holzinger,et al.  Semantic Information in Medical Information Systems: Utilization of Text Mining Techniques to Analyze Medical Diagnoses , 2008, J. Univers. Comput. Sci..

[24]  Martina Ziefle,et al.  Visual Ergonomic Issues of LCD Displays – An Insight into Working Conditions and User Characteristics , 2009 .

[25]  Olaf Oehme,et al.  Visual displays , 2002 .

[26]  Karl Josef Klauer,et al.  Intentional and Incidental Learning with Instructional Texts: A Meta-Analysis for 1970–1980 , 1984 .

[27]  Lindsay W. MacDonald,et al.  Display Systems: Design and Applications , 1999 .

[28]  石原 伸哉 Do liquid crystal displays assure better readability than cathode-ray tubes? , 1993 .

[29]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[30]  Martina Ziefle,et al.  The Effects of LCD Anisotropy on the Visual Performance of Users of Different Ages , 2007, Hum. Factors.

[31]  Martina Ziefle,et al.  Aging, Visual Performance and Eyestrain in Different Screen Technologies , 2001 .

[32]  J M Lewin,et al.  Comparison of full-field digital mammography with screen-film mammography for cancer detection: results of 4,945 paired examinations. , 2001, Radiology.

[33]  Justin G. Hollands,et al.  LCD versus CRT Displays: A Comparison of Visual Search Performance for Colored Symbols , 2002, Hum. Factors.

[34]  Paul Muter,et al.  Reading of Continuous Text on Video Screens , 1984 .

[35]  V Barnes,et al.  Reading Is Slower from CRT Displays than from Paper: Attempts to Isolate a Single-Variable Explanation , 1987, Human factors.

[36]  Andrew Dillon,et al.  Reading from paper versus screens: a critical review of the empirical literature , 1992 .

[37]  R. T. Wilkinson,et al.  Proof-reading: VDU and paper text compared for speed, accuracy and fatigue , 1987 .

[38]  Carol Bergfeld,et al.  Reading text from computer screens , 1987, CSUR.

[39]  B Nilsson,et al.  The influence of VDT work on musculoskeletal disorders. , 1995, Ergonomics.

[40]  Andreas Holzinger,et al.  Lessons from Real-Life Usability Engineering in Hospital: From Software Usability to Total Workplace Usability , 2005, Usability Symposium.

[41]  L. Gitelman The Social Life of Paper , 2009 .

[42]  Andrew Dillon,et al.  HyperText and Cognition , 1996 .

[43]  G. Santucci,et al.  [Visual displays]. , 1981, L'Annee therapeutique et clinique en ophtalmologie.

[44]  James E. Sheedy,et al.  Filters on computer displays – effects on legibility, performance and comfort , 2003, Behav. Inf. Technol..

[45]  Risto Näsänen,et al.  Display quality and the speed of visual letter search , 2001 .

[46]  Ronald P. Carver,et al.  Analysis of the Chunked Reading Test and Reading Comprehension1 , 1972 .

[47]  Mary C. Dyson,et al.  How physical text layout affects reading from screen , 2004, Behav. Inf. Technol..

[48]  Martina Ziefle,et al.  Visual Costs of the Inhomogeneity of Luminance and Contrast by Viewing LCD-TFT Screens Off-Axis , 2003, International journal of occupational safety and ergonomics : JOSE.

[49]  Paul van Schaik,et al.  The effects of frame layout and differential background contrast on visual search performance in Web pages , 2001, Interact. Comput..

[50]  Marino Menozzi,et al.  CRT versus LCD: Effects of refresh rate, display technology and background luminance in visual performance. , 2001 .

[51]  J. Jacko,et al.  The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications , 2002 .

[52]  Ronald P. Carver,et al.  DEVELOPMENT AND EVALUATION OF A TEST OF INFORMATION STORAGE DURING READING1 , 1971 .

[53]  Martina Ziefle Sitting Posture, Postural Discomfort, and Visual Performance: A Critical View on the Interdependence of Cognitive and Anthropometric Factors in the VDU Workplace , 2003, International journal of occupational safety and ergonomics : JOSE.

[54]  D A Owens,et al.  Near work, visual fatigue, and variations of oculomotor tonus. , 1987, Investigative ophthalmology & visual science.