Development of cognitive model for navigating on the web

The objective of this thesis is to build a cognitive model of human performance in Web-assisted tasks. The research is driven by the following questions: What are the most important factors in determining success in Web-assisted tasks? What cognitive mechanisms are involved in these factors? What kind of Web navigation support can be conceived based on the knowledge gained from the previous questions? The approach is based on the simultaneous consideration of theory, method and real-world applicability. Web navigation is grounded in theories of Cognitive Science (Text Comprehension in particular), and Information Science (Human-Computer Interaction in particular). Experimentation, statistical analysis and modeling are conducted. Practical needs of Web engineering are taken into consideration. This research investigates how real Web applications are used. A sequence of repeated studies shows that a combination of two factors is the most important determinant of human performance in Web-assisted tasks: a structure-related factor (spatial ability) and a content-related factor (domain expertise). Spatial cognition is involved in representing the structure of the information space, while domain knowledge is necessary for understanding and selecting relevant content. Factors, such as spatial ability and domain expertise, can only be measured with specialized tests, which cannot be implemented in realistic Web applications. For this reason, Web-logging data is used to calculate metrics of Web navigation behavior. Metrics referring to the structure of user navigation are called syntactic, whereas metrics referring to the visited content are called semantic. It is demonstrated that syntactic (structural) metrics indicate users' navigation styles, for example, if they prefer to revisit pages rather than viewing new pages, or if they return to previously viewed pages using the back button or just by following links. Semantic metrics indicate if users are effective in pursuing their goals independent of their navigation styles. These navigation metrics can be used in building user-models for adaptive Web applications such as recommender systems. A cognitive model of Web navigation (labeled CoLiDeS+) is proposed. Theoretical and empirical arguments are used to motivate the main assumptions of the model which are: (a) users build and update a mental representation of the information space being navigated; and (b) they assess relevance and make decisions to select particular contents based on both prior knowledge they have about those contents, and knowledge they gain from the local context of those particular contents (i.e., what contents they link to). CoLiDeS+, an augmented version of CoLiDeS (Kitajima, Blackmon, & Polson, 2000), uses Latent Semantic Analysis to model assessments of relevance and user navigation history (sequence of selected links) to model contextual information involved in making navigational decisions. This latter feature is the main distinguishing characteristic of CoLiDeS+. The model has been empirically tested for its accuracy in simulating actual user behavior and its utility in generating Web navigation support. It is shown that CoLiDeS+ performs better in modeling user behavior than its previous version (CoLiDeS) and the navigation support generated from its simulations has a positive impact on user behavior and task outcomes. This thesis advances the scientific understanding of human performance in knowledge-intensive tasks and contributes to designing useable and accessible information environments.

[1]  David R. Danielson Web navigation and the behavioral effects of constantly visible site maps , 2002, Interact. Comput..

[2]  Mats Lind,et al.  2D vs 3D, implications on spatial memory , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[3]  Ben Shneiderman,et al.  Structural analysis of hypertexts: identifying hierarchies and useful metrics , 1992, TOIS.

[4]  Leo J. Gugerty,et al.  Individual differences in internet search outcomes and processes , 2006, CHI EA '06.

[5]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[6]  John R. Anderson,et al.  Interpretation-based processing: a unified theory of semantic sentence comprehension , 2004, Cogn. Sci..

[7]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[8]  Herre van Oostendorp,et al.  Google's "I'm Feeling Lucky", Truly a Gamble? , 2004, WISE.

[9]  Jane Webster,et al.  Perceived disorientation: an examination of a new measure to assess web design effectiveness , 2001, Interact. Comput..

[10]  Lynda Hardman,et al.  Supporting the generation of argument structure within video sequences , 2005, HYPERTEXT '05.

[11]  Virginie Zampa,et al.  Latent Semantic Analysis for User Modeling , 2004, Journal of Intelligent Information Systems.

[12]  Marie Sjolinder Individual differences in spatial cognition and hypermedia navigation , 1996 .

[13]  Neerincx,et al.  Human-computer interaction and presence in virtual reality exposure therapy , 2003 .

[14]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[15]  Anthony J. Hornof,et al.  Cognitive strategies and eye movements for searching hierarchical computer displays , 2003, CHI '03.

[16]  Jonathan Lazar,et al.  WORLD WIDE WEB , 1999, Ecological Restoration.

[17]  Vincent G. Duffy,et al.  Human centred computing : cognitive, social and ergonomic aspects , 2003 .

[18]  A. Baddeley Working Memory: The Interface between Memory and Cognition , 1992, Journal of Cognitive Neuroscience.

[19]  Brian Detlor,et al.  Information Seeking on the Web: An Integrated Model of Browsing and Searching , 2000, First Monday.

[20]  Anthony J. Hornof,et al.  Predicting Cognitive Strategies and Eye Movements in Hierarchical Visual Search , 2003 .

[21]  Gwm Matthias Rauterberg How to measure cognitive complexity in human-computer interaction , 1996 .

[22]  Roger W. Remington,et al.  Modeling Opportunistic Strategy for Information Navigation , 2001 .

[23]  Jeff Conklin,et al.  Hypertext: An Introduction and Survey , 1987, Computer.

[24]  G Salvendy,et al.  Information visualization; assisting low spatial individuals with information access tasks through the use of visual mediators. , 1995, Ergonomics.

[25]  van Boris Wessel Schooten,et al.  Development and Specification of Virtual Environments , 2003 .

[26]  Andy Cockburn,et al.  What do web users do? An empirical analysis of web use , 2001, Int. J. Hum. Comput. Stud..

[27]  Andreas Martin Thomas Lincke,et al.  Electronic business negotiation: some experimental studies on the interaction between medium, innovation context, and culture , 2003 .

[28]  A. Jameson Adaptive interfaces and agents , 2002 .

[29]  Boris Shishkov,et al.  Software Specification Based on Re-usable Business Components , 2005 .

[30]  Keith S. Jones,et al.  Users' schemata of hypermedia: what is so 'spatial' about a website? , 2002, Interact. Comput..

[31]  David F. Redmiles,et al.  Extracting usability information from user interface events , 2000, CSUR.

[32]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[33]  C. Kirchner,et al.  Who's Surfing? Internet Access and Computer Use by Visually Impaired Youths and Adults , 2001 .

[34]  Walter Kintsch,et al.  An Overview of Top-Down and Bottom-Up Effects in Comprehension: The CI Perspective , 2005 .

[35]  Lynda Hardman,et al.  'Lost in Hyperspace': Cognitive Mapping and Navigation in a Hypertext Environment , 1999, UK Hypertext.

[36]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[37]  Leonard R. Kasday,et al.  Site Seeing: The Development of an Accessible Website or Webbased Multimedia Product , 2000 .

[38]  Catherine Plaisant,et al.  Navigation patterns and usability of zoomable user interfaces with and without an overview , 2002, TCHI.

[39]  van Joeri Ruth Flattening queries over nested data types , 2006 .

[40]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[41]  Michael D. Byrne,et al.  Cognitive Architecture , 2003 .

[42]  Michael D. Kickmeier,et al.  Web-based Navigation: The traditional Tree Browser and the alternative Star Tree , 2002 .

[43]  L. H. Christoph The role of metacognitive skills in learning to solve problems , 2006 .

[44]  Fn Florian Egger FROM INTERACTIONS TO TRANSACTIONS: Designing the Trust Experience for Business-to-Consumer Electronic Commerce , 2003 .

[45]  Ion Juvina,et al.  Bringing Cognitive Models in the Domain of Web Accessibility , 2005 .

[46]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[47]  Mary Czerwinski,et al.  The Contribution of Thumbnail Image, Mouse-over Text and Spatial Location Memory to Web Page Retrieval in 3D , 1999, INTERACT.

[48]  Ion Juvina,et al.  Predicting user preferences: from semantic to pragmatic metrics of Web navigation behavior , 2004 .

[49]  Craig S. Miller,et al.  Modeling Information Navigation: Implications for Information Architecture , 2004, Hum. Comput. Interact..

[50]  Simon Keizer,et al.  Reasoning under Uncertainty in Natural Language Dialogue using Bayesian Networks , 2003 .

[51]  Lai Xu Monitoring multi-party contracts for E-business , 2004 .

[52]  H.H.L.M. Donkers,et al.  NOSCE HOSTEM: Searching with Opponent Models , 1997 .

[53]  Stacey Fusae Nagat User Assistance for Multitasking with Interruptions on a Mobile Device , 2006 .

[54]  Fabio Paternò,et al.  Intelligent analysis of user interactions with web applications , 2002, IUI '02.

[55]  Marilyn Hughes Blackmon,et al.  Cognitive walkthrough for the web , 2002, CHI.

[56]  Rainer Malik CONAN : Text Mining in the Biomedical Domain , 2006 .

[57]  M. B. van Riemsdijk,et al.  Cognitive agent programming : A semantic approach , 2006 .

[58]  Martin Wigbertus Antonius Caminada For the sake of the Argument : explorations into argument-based reasoning , 1997 .

[59]  P. Groot,et al.  A Theoretical and Empirical Analysis of Approximation in Symbolic Problem Solving , 2004 .

[60]  Ion Juvina,et al.  Discovery of Individual User Navigation Styles , 2004 .

[61]  Susan R. Goldman,et al.  Por qué son útiles los modelos computacionales de comprensión de textos , 2007 .

[62]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[63]  Saul Greenberg,et al.  How people revisit web pages: empirical findings and implications for the design of history systems , 1997, Int. J. Hum. Comput. Stud..

[64]  H. Stuckenschmidt,et al.  Ontology-Based Information Sharing in Weakly Structured Environments , 2003 .

[65]  S. F. Nagata,et al.  User Assistance for Multitasking with Interruptions on a Mobile Device , 2006 .

[66]  Robert W. Reeder,et al.  Information scent as a driver of Web behavior graphs: results of a protocol analysis method for Web usability , 2001, CHI.

[67]  Herre van Oostendorp,et al.  Towards Modelling Exploratory Learning in the Context of Direct Manipulation Interfaces , 1995, Interact. Comput..

[68]  Ion Juvina,et al.  Analysis of Web Browsing Behavior - a great potential for psychological research , 2002, TAMODIA.

[69]  Marina Velikova,et al.  Monotone models for prediction in data mining , 2006 .

[70]  Mark A. Neerincx,et al.  Support concepts for Web navigation: a cognitive engineering approach , 2001, WWW '01.

[71]  Ion Juvina,et al.  Task Modeling in Intelligent Tutoring Systems on the Web , 2002, TAMODIA.

[72]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[73]  James Wen POST-VALUED RECALL WEB PAGES: USER DISORIENTATION HITS THE BIG TIME , 2003 .

[74]  Eelco Herder Characterizations of User Web Revisit Behavior , 2005, LWA.

[75]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[76]  Ion Juvina,et al.  Enhancing internet experience of visually impaired persons by means of dynamic highlighting and selective reading , 2006 .

[77]  Jakob Nielsen,et al.  The matters that really matter for hypertext usability , 1989, Hypertext.

[78]  E. G. Boltjes,et al.  Voorbeeldig onderwijs : voorbeeldgestuurd onderwijs, een opstap naar abstract denken, vooral voor meisjes , 2004 .

[79]  P. Broek,et al.  The Landscape model of reading: Inferences and the online construction of memory representation. , 1999 .

[80]  Brian R. Johnson,et al.  Examining Information Searching on the World Wide Web with a Screen-Reader: A Verbal Protocol Analysis , 2002 .

[81]  Eelco Herder,et al.  Forward, Back and Home Again - Analyzing User Behavior on the Web , 2006 .

[82]  Anders Bouwer,et al.  Explaining behaviour: using qualitative simulation in interactive learning environments , 2005 .

[83]  W.C.A. Wijngaards,et al.  Agent-Based Modelling of Dynamics: Biological and Organisational Applications , 2002 .

[84]  Peter Boncz,et al.  UvA-DARE ( Digital Academic Repository ) Monet ; a next-Generation DBMS Kernel For Query-Intensive Applications , 2007 .

[85]  Stefan Manegold,et al.  Understanding, modeling, and improving main-memory database performance , 2002 .

[86]  P. Warr,et al.  Intelligence, elementary cognitive components, and cognitive styles as predictors of complex task performance , 1996 .

[87]  Richard E. Mayer,et al.  The effects of graphic organizers giving cues to the structure of a hypertext document on users' navigation strategies and performance , 2002, Int. J. Hum. Comput. Stud..

[88]  Marilyn Hughes Blackmon,et al.  A Comprehension-based Model of Web Navigation and Its Application to Web Usability Analysis , 2000, BCS HCI.

[89]  Ion Juvina,et al.  The Impact of Link Suggestions on User Navigation and User Perception , 2005, User Modeling.

[90]  Stuart K. Card,et al.  Information foraging models of browsers for very large document spaces , 1998, AVI '98.

[91]  Roy Rada Hypertext: from Text to Expertext , 1994, SIGB.

[92]  S. G. Sterrett Physical models and fundamental laws: Using one piece of the world to tell about another , 2001 .

[93]  Ans A. G. Steuten A contribution to the linguistic analysis of business conversations within the language/action perspective , 1998 .

[94]  Andrew Howes,et al.  An Instance-based Model of the Effect of Previous Choices on the Control of Interactive Search , 2002 .

[95]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[96]  Ion Juvina,et al.  Human Factors in Web-Assisted Personal Finance , 2003 .

[97]  Dave Howes ADAPTIVE DECISION MAKING IN MENU SEARCH : THE ROLE OF INTERDEPENDENCE AND PAST EXPERIENCE ON LINK SELECTION , 2003 .

[98]  Richard M. Young Rational Analysis of Exploratory Choice , 2001 .

[99]  Peter Brusilovsky,et al.  From adaptive hypermedia to the adaptive web , 2002, CACM.

[100]  Wai-Tat Fu,et al.  SNIF-ACT: A Model of Information Foraging on the World Wide Web , 2003, User Modeling.

[101]  William P. Eveland,et al.  Users and navigation patterns of a science World Wide Web site for the public , 1998 .

[102]  V. Bessa Machado Supporting the Construction of Qualitative Knowledge models , 2004 .

[103]  Rosemary J. Stevenson,et al.  Spatial versus conceptual maps as learning tools in hypertext , 1999 .

[104]  Jurek Kirakowski,et al.  The Software Usability Measurement Inventory: Background and Usage , 1996 .

[105]  Pauline A. Smith Towards a Practical Measure of Hypertext Usability , 1996, Interact. Comput..

[106]  Mary Czerwinski,et al.  Web page design: implications of memory, structure and scent for information retrieval , 1998, CHI.

[107]  S J Westerman Computerized Information Retrieval: Individual Differences in the Use of Spatial vs Nonspatial Navigational Information , 1995, Perceptual and motor skills.

[108]  Ion Juvina,et al.  Individual differences and behavioral metrics involved in modeling web navigation , 2006, Universal Access in the Information Society.

[109]  Ion Juvina,et al.  Cognitive Model Working Alongside the User , 2005, BCS HCI.

[110]  Charles A. Perfetti,et al.  Higher level language processes in the brain : inference and comprehension processes , 2007 .

[111]  Jan Broersen Modal Action Logics for Reasoning about Reactive Systems , 2003 .

[112]  Andy Cockburn,et al.  Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments , 2002, CHI.

[113]  Mary Czerwinski,et al.  From latent semantics to spatial hypertext—an integrated approach , 1998, HYPERTEXT '98.

[114]  A. J. Lehmann Causation in artificial intelligence and law : a modelling approach , 2003 .

[115]  Muneo Kitajima,et al.  A comprehension-based model of exploration , 1996, Hum. Comput. Interact..

[116]  Chaomei Chen Individual differences in a spatial-semantic virtual environment , 2000, J. Am. Soc. Inf. Sci..

[117]  Rik Eshuis,et al.  Semantics and Verification of UML Activity Diagrams for Workflow Modelling , 2002 .

[118]  Philip K. Chan,et al.  Learning implicit user interest hierarchy for context in personalization , 2008, IUI '03.

[119]  Andrew Howes,et al.  Good Enough But I'll Just Check: Web-page Search as Attentional Refocusing , 2004, ICCM.

[120]  Michael D. Byrne,et al.  Information search: the intersection of visual and semantic space , 2005, CHI EA '05.

[121]  F. J. Wiesman,et al.  Information retrieval by graphically browsing meta-information , 1998 .

[122]  S. Kim MacGregor,et al.  Hypermedia Navigation Profiles: Cognitive Characteristics and Information Processing Strategies , 1999 .

[123]  Vojislav Kecman,et al.  Kernel Based Algorithms for Mining Huge Data Sets: Supervised, Semi-supervised, and Unsupervised Learning , 2006, Studies in Computational Intelligence.

[124]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[125]  Stuart K. Card,et al.  A taxonomic analysis of what world wide web activities significantly impact people's decisions and actions , 2001, CHI Extended Abstracts.

[126]  Wojciech Janusz Jamroga,et al.  Using multiple models of reality: on agents who know how to play safer , 2004 .

[127]  Frank E. Ritter,et al.  Supporting cognitive models as users , 2000, TCHI.

[128]  Michael D. Byrne,et al.  The tangled Web we wove: a taskonomy of WWW use , 1999, CHI '99.

[129]  James Reason,et al.  Human Error , 1990 .

[130]  Barbara S. Chaparro,et al.  Cascading versus Indexed Menu Design , 2003 .

[131]  Jaap Gordijn,et al.  Value-based requirements engineering: exploring innovative e-commerce ideas , 2003, Requirements Engineering.

[132]  Thijs Westerveld,et al.  Using generative probabilistic models for multimedia retrieval , 2005, SIGF.

[133]  M. Chi,et al.  Gender Differences in Patterns of Searching the Web , 2003 .

[134]  Paolo Paolini,et al.  “Usable Accessibility” to the Web for blind Users , 2004 .

[135]  Marti A. Hearst,et al.  Empirically validated web page design metrics , 2001, CHI.

[136]  Alfons Maes,et al.  I have been here before: An investigation into spatial verbalizations in hypertext navigation , 2006 .

[137]  Jeffrey O. Kephart,et al.  Incremental Learning in SwiftFile , 2000, ICML.

[138]  Ion Juvina,et al.  Role of Icons and Chat Boxes in Computer Supported Collaborative Learning , 2003, CSCL.

[139]  Stuart K. Card,et al.  Information foraging in information access environments , 1995, CHI '95.

[140]  Walter Kintsch,et al.  Reading Strategies and Hypertext Comprehension , 2005 .

[141]  Tracy Linderholm,et al.  Predictive Inference Generation as a Function of Working Memory Capacity and Causal Text Constraints , 2002 .

[142]  H. Oostendorp,et al.  The Construction of Mental Representations During Reading , 1998 .

[143]  David N. Rapp,et al.  Integrating Memory-Based and Constructionist Processes in Accounts of Reading Comprehension , 2005 .

[144]  Marko Smiljanic,et al.  XML schema matching : balancing efficiency and effectiveness by means of clustering , 2006 .

[145]  Dick C. A. Bulterman,et al.  Links in hypermedia: the requirement for context , 1993, Hypertext.

[146]  Fabio Paternò Tools for Task Modelling: Where we are, Where we are headed , 2002, TAMODIA.

[147]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[148]  Robert D. Macredie,et al.  Cognitive styles and hypermedia navigation: Development of a learning model , 2002, J. Assoc. Inf. Sci. Technol..

[149]  Herre van Oostendorp,et al.  Cognitive Effects of a Structural Overview in a Hypertext , 1999, Br. J. Educ. Technol..

[150]  Duncan P. Brumby A Model of Single-page Web Search: The Effect of Interdependence on Link Assessment , 2004, ICCM.