The impact of task complexity on people's mental models of MedlinePlus

This study explored the impact of task complexity on people's mental models of MedlinePlus, an information-rich web space providing consumer health information to the general public. Thirty-eight subjects were randomly assigned to two groups, performing either simple or complex search tasks. After the search session, subjects' perceptions of MedlinePlus were elicited using a concept listing protocol where subjects listed concepts concerning MedlinePlus in the order each concept occurred to them. The analysis of the concepts suggested that task complexity impacted subjects' mental models by influencing the objects in the system that they perceived and represented, the specificity of the representations, their evaluations of and emotions about the objects, and the heuristics that they developed for what works and what does not in the system. The pragmatic aspect of mental models was represented by subjects' descriptions of the steps that they would follow to tackle a hypothetical task. The analysis showed that task complexity affected the strategies that subjects perceived themselves using to solve new tasks using the system.

[1]  R. Young.  Surrogates and mappings: two kinds of conceptual models for interactive , 1983 .

[2]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part I. Background and Theory , 1997, J. Documentation.

[3]  Lynn Westbrook,et al.  Mental models: a theoretical overview and preliminary study , 2006, J. Inf. Sci..

[4]  Andrea A. diSessa,et al.  Models of Computation , 1986 .

[5]  Chaomei Chen.  Individual differences in a spatial-semantic virtual environment , 2000, J. Am. Soc. Inf. Sci..

[6]  Stephen T. Kerr.  Wayfinding in an electronic database: The relative importance of navigational cues vs. mental models , 1990, Inf. Process. Manag..

[7]  Efthimis N. Efthimiadis,et al.  Search engines and how students think they work , 2005, SIGIR '05.

[8]  P. Barnard,et al.  Design practice and interface usability: Evidence from interviews with designers , 1983, CHI '83.

[9]  Ryen W. White,et al.  A study of factors affecting the utility of implicit relevance feedback , 2005, SIGIR '05.

[10]  P. Johnson-Laird.  Mental models , 1989 .

[11]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[12]  Chirag Shah,et al.  Effects of performance feedback on users' evaluations of an interactive IR system , 2008, IIiX.

[13]  Chaomei Chen.  Individual differences in a spatial-semantic virtual environment , 2000 .

[14]  John M. Carroll,et al.  Mental models in human-computer interaction: research issues about what the user of software knows , 1987 .

[15]  Mark Chignell,et al.  Assessment of the effects of user characteristics on mental models of information retrieval systems , 2001 .

[16]  Dohoon Kim,et al.  Key functional characteristics in designing and operating health information websites for user satisfaction: An application of the extended technology acceptance model , 2007, Int. J. Medical Informatics.

[17]  H. Harman,et al.  Kit of factor-referenced cognitive tests , 1976 .

[18]  Yan Zhang,et al.  Survey of learners' knowledge structures: Rationales, methods and instruments , 2005, ASIST.

[19]  George Buchanan,et al.  A library or just another information resource? A case study of users' mental models of traditional and digital libraries , 2007, J. Assoc. Inf. Sci. Technol..

[20]  Yuelin Li,et al.  Exploring the relationships between work task and search task in information search , 2009, J. Assoc. Inf. Sci. Technol..

[21]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[22]  Jakob Nielsen,et al.  The matters that really matter for hypertext usability , 1989, Hypertext.

[23]  Philip Henning,et al.  Mental Models: Knowledge in the Head and Knowledge in the World , 1996, ICLS.

[24]  Wanda Pratt,et al.  Transparent Queries: investigation users' mental models of search engines , 2001, SIGIR '01.

[25]  Andrew Dillon,et al.  Spatial-semantics: How users derive shape from information space , 2000, J. Am. Soc. Inf. Sci..

[26]  Marina Papastergiou,et al.  Students’ Mental Models of the Internet and Their Didactical Exploitation in Informatics Education , 2005, Education and Information Technologies.

[27]  Indi Young,et al.  Mental Models: Aligning design strategy with human behavior , 2008, UBIQ.

[28]  Alexandra Dimitroff,et al.  Mental Models Theory and Search Outcome in a Bibliographic Retrieval System. , 1992 .

[29]  Christine L. Borgman.  The User's Mental Model of an Information Retrieval System: An Experiment on a Prototype Online Catalog , 1986, Int. J. Man Mach. Stud..

[30]  Thomas P. Moran,et al.  Mental models and problem solving in using a calculator , 1983, CHI '83.

[31]  Pamela A. Savage-Knepshield.  Mental models : issues in construction, congruency, and cognition , 2002 .

[32]  David Klahr,et al.  Learning in an instructionless environment: Observation and analysis , 1983, CHI '83.

[33]  Robert R. Hoffman,et al.  Perspectives on Cognitive Task Analysis: Historical Origins and Modern Communities of Practice , 2008 .

[34]  Michael J. Tauber,et al.  Mental Models and Human Computer Interaction I , 1990 .

[35]  David N. Ford,et al.  Mental models concepts for system dynamics research , 1998 .

[36]  Gary Marchionini,et al.  Effects of structure and interaction style on distinct search tasks , 2007, JCDL '07.

[37]  Judith S. Olson,et al.  A mental model can help with learning to operate a complex device , 1993, CHI '93.

[38]  George Buchanan,et al.  A library or just another information resource? A case study of users' mental models of traditional and digital libraries: Research Articles , 2007 .

[39]  Laura J. Neumann,et al.  Trial and Error as a Learning Strategy in System Use , 1998 .

[40]  Lorna Uden,et al.  Insight into mental models of novice Internet searchers , 2003, CACM.

[41]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[42]  Jeroen M. van der Velden,et al.  Mental models and the evaluation of user interfaces: a case-study of a library system , 1989, Informatics and Psychology Workshop.

[43]  Cecilia Katzeff.  System Demands on Mental Models for a Fulltext Database , 1990, Int. J. Man Mach. Stud..

[44]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[45]  Malcolm Otter,et al.  Lost in hyperspace: metrics and mental models , 2000, Interact. Comput..

[46]  Pia Borlund,et al.  Evaluation of interactive information retrieval systems , 2000 .

[47]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[48]  Yan Zhang.  Undergraduate students' mental models of the Web as an information retrieval system , 2008, J. Assoc. Inf. Sci. Technol..

[49]  Christine L. Borgman.  The user's mental model of an information retrieval system: an experiment on a prototype online catalog , 1999, Int. J. Hum. Comput. Stud..

[50]  Esslli Site,et al.  Models of Computation , 2012 .

[51]  Pertti Vakkari,et al.  Task complexity, problem structure and information actions - Integrating studies on information seeking and retrieval , 1999, Inf. Process. Manag..

[52]  K. J. Craik,et al.  The nature of explanation , 1944 .

[53]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[54]  Efthimis N. Efthimiadis,et al.  Conceptual Models for Search Engines , 2008 .

[55]  Barbara M. Wildemuth,et al.  Perspectives on the tasks in which information behaviors are embedded. , 2005 .

[56]  Peter Ingwersen,et al.  Cognitive Perspectives of Information Retrieval Interaction: Elements of a Cognitive IR Theory , 1996, J. Documentation.

[57]  Yan Zhang.  The influence of mental models on undergraduate students' searching behavior on the Web , 2008, Inf. Process. Manag..

[58]  Renée L. Babcock,et al.  An examination of the factor structure of four of the cognitive abilities included in the educational testing service kit of factor-referenced cognitive tests , 1997 .

[59]  Kalervo Järvelin,et al.  Task complexity affects information seeking and use , 1995 .

[60]  Pertti Vakkari,et al.  Task-based information searching , 2005, Annu. Rev. Inf. Sci. Technol..

[61]  Jacek Gwizdka,et al.  Predicting task difficulty for different task types , 2010, ASIST.

[62]  Dania Bilal.  Children's use of the Yahooligans! Web search engine: II. cognitive and physical behaviors on research tasks , 2001 .

[63]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[64]  Debra J. Slone.  The influence of mental models and goals on search patterns during Web interaction , 2002, J. Assoc. Inf. Sci. Technol..

[65]  Reinhard Rapp,et al.  Computation of Word Associations Based on Co-occurrences of Words in Large Corpora , 1993, VLC@ACL.

[66]  Andrew Thatcher,et al.  Mental models of the Internet , 1998 .

[67]  Elizabeth Yakel,et al.  Conceptualizing institutional repositories: using co-discovery to uncover mental models , 2010, IIiX.