Analysing and evaluating usefulness and usability in electronic information services

Digital libraries, e-journal platforms, portals, e-prints and other web-based information systems provide services supporting users to perform intense work tasks that require complex interaction activities. The main components of such services are the users, the offered content and the system on which they are performed. This paper presents a model, which analyses the attributes of the electronic information services' components that affect user interaction and correlates them in the usefulness and usability evaluation process. An experimental study traces the relations between usefulness and usability, indicating that these evaluation parameters are interconnected and users do not find discriminating differences between them. The analysis of the content and system attributes suggests that user interaction is affected equally by content and system characteristics. Finally, the study illustrates users' preference for the attributes that constitute a useful system in contrast to those that support usability.

[1]  Jonas Holmström.  Managing a Paradigm Shift - Aligning Management, Privacy Policy, Technology and Standards , 2004, ECDL.

[2]  Manuel A. Pérez-Quiñones,et al.  Usability inspection of digital libraries: a case study , 2004, International Journal on Digital Libraries.

[3]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[4]  Andrew Dillon,et al.  Power, Perception and Performance: From Usability Engineering to Technology Acceptance with the P3 Model of User Response , 1999 .

[5]  Peter Ingwersen,et al.  Information seeking research needs extension toward tasks and technology , 2004, Inf. Res..

[6]  Ghislaine Chartron,et al.  How French research scientists are making use of electronic journals: a case study conducted at Pierre et Marie Curie University and Denis Diderot University , 2000, J. Inf. Sci..

[7]  D M Fuller,et al.  Ensuring quality Website redesign: the University of Maryland's experience. , 2001, Bulletin of the Medical Library Association.

[8]  Carol Collier Kuhlthau,et al.  Inside the search process: Information seeking from the user's perspective , 1991, J. Am. Soc. Inf. Sci..

[9]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[10]  Judy H. Jeng.  What is usability in the context of the digital library and how can it be measured , 2005 .

[11]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[12]  Menno D. T. de Jong,et al.  Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison , 2004, Interact. Comput..

[13]  Jacquelyn A. Burkell,et al.  Believe it or not: Factors influencing credibility on the Web , 2002, J. Assoc. Inf. Sci. Technol..

[14]  Harald Krottmaier.  Current and Future Features of Digital Journals , 2002, EurAsia-ICT.

[15]  Mary F. Casserly,et al.  Usage and Usability Assessment: Library Practices and Concerns , 2002 .

[16]  Maja Zumer,et al.  Comparison and evaluation of the user interfaces of e-journals , 2005, J. Documentation.

[17]  Gobinda G. Chowdhury,et al.  An overview of the information retrieval features of twenty digital libraries , 2000 .

[18]  Ziming Liu.  Perceptions of credibility of scholarly information on the web , 2004, Inf. Process. Manag..

[19]  Raya Fidel,et al.  The many faces of accessibility: engineers' perception of information sources , 2004, Inf. Process. Manag..

[20]  Shaheen Majid,et al.  Usage of information resources by computer engineering students: a case study of Nanyang Technological University, Singapore , 2002, Online Inf. Rev..

[21]  Carol Collier Kuhlthau.  Inside the Search Process: Information Seeking from the User's Perspective. , 1991 .

[22]  Micheline Beaulieu.  Interaction in information searching and retrieval , 2000, J. Documentation.

[23]  Diann Rusch-Feja,et al.  Evaluation of Usage and Acceptance of Electronic Journals: Results of an Electronic Survey of Max Planck Society Researchers including Usage Statistics from Elsevier, Springer, and Academic Press , 1999, D Lib Mag..

[24]  Roslin V. Hauck,et al.  When a better interface and easy navigation aren't enough: Examining the information architecture in a law enforcement agency , 2002, J. Assoc. Inf. Sci. Technol..

[25]  David Nicholas,et al.  Engaging with scholarly digital libraries (publisher platforms): The extent to which 'added-value' functions are used , 2006, Inf. Process. Manag..

[26]  Susan McMullen,et al.  Usability testing in a library web site redesign project , 2001 .

[27]  Hung-Pin Shih,et al.  Extended technology acceptance model of Internet utilization behavior , 2004, Inf. Manag..

[28]  Rachael Green Clemens,et al.  Usage and Usability Assessment: Library Practices and Concerns , 2003 .

[29]  이훈,et al.  지각된 유용성(Perceived Usefulness)의 영향분석 , 2004 .

[30]  Christine Marton.  Quality of health information on the Web: user perceptions of relevance and reliability , 2003 .

[31]  Nigel Ford,et al.  Serendipity and information seeking: an empirical study , 2003, J. Documentation.

[32]  Harold Thimbleby,et al.  Interaction Modelling for Digital Libraries , 2000 .

[33]  Rachael Green Clemens.  Usage and Usability Assessment , 2003 .

[34]  T. D. Wilson,et al.  On user studies and information needs , 2006, J. Documentation.

[35]  Elaine Anderson Jayne,et al.  How do I find an article? Insights from a web usability study , 2002 .

[36]  Maryellen Allen.  A case study of the usability testing of the University of South Florida's virtual library interface design , 2002, Online Inf. Rev..

[37]  Panagiotis Georgiou,et al.  A user-oriented evaluation of digital libraries: case study the "electronic journals" service of the library and information service of the University of Patras, Greece , 2002, Aslib Proc..

[38]  Preben Hansen,et al.  Evaluation of IR User interface – Implications for User Interface Design , 1998 .

[39]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[40]  Marilyn Domas White,et al.  Identifying user-based criteria for Web pages , 1997, Internet Res..

[41]  Kar Yan Tam,et al.  Understanding User Acceptance of Digital Libraries: What are the Roles of Interface Characteristics, Organizational Context, and Individual Differences? , 2002, Int. J. Hum. Comput. Stud..

[42]  Pertti Vakkari,et al.  Changes in relevance criteria and problem stages in task performance , 2000, J. Documentation.

[43]  Angela M. Weiler.  Information-seeking behavior in Generation Y students: Motivation, critical thinking, and learning theory , 2005 .

[44]  A. Tomlinson.  POWER , 1998, The Palgrave Encyclopedia of Imperialism and Anti-Imperialism.

[45]  Norbert Fuhr,et al.  Digital Libraries: A Generic Classification and Evaluation Scheme , 2001, ECDL.

[46]  Catherine Ebenezer.  Usability evaluation of an NHS library website. , 2003, Health information and libraries journal.

[47]  Elaine Toms,et al.  Information interaction: Providing a framework for information architecture , 2002, J. Assoc. Inf. Sci. Technol..

[48]  Allen Foster,et al.  A nonlinear model of information-seeking behavior , 2004, J. Assoc. Inf. Sci. Technol..

[49]  Zheng Zhou,et al.  Development and validation of an instrument to measure user perceived service quality of information presenting Web portals , 2005, Inf. Manag..