3. Using pathfinder networks to analyze procedural knowledge in interactions with advanced technology

Research on human cognition in complex tasks, such as interacting with advanced technology, requires the development and validation of new methods. This paper describes PRONET, a method for summarizing, representing, and analyzing event sequences. The first section outlines how the PRONET method can be applied to any sequence of events, with lessons learned from previous applications of the method. The second section presents demonstrations of the application of PRONET. In the first demonstration — a computer-based simulation of operant training - the PRONET analysis and representation clearly shows the change in the behavior of the simulation produced by changes in reinforcement contingencies, but also shows interesting aspects of behavior that were not affected. In the second demonstration — involving transfer of word processing skill — network-related and performance measures showed the expected pattern of positive transfer. In addition, the network of the far transfer participant suggested that she used task knowledge to search for conditions that would permit the correct action. Two previously-published examples showed the usefulness of the PRONET method in characterizing a hybrid event sequence consisting of environmental conditions and behavioral actions and a sequence of events from a team.

[1]  M Rauterberg,et al.  AMME: an Automatic Mental Model Evaluation to analyse user behaviour traced in a finite, discrete state space. , 1993, Ergonomics.

[2]  Douglas J. Gillan,et al.  The Psychologies of Human-Computer Interaction: An Integrative Approach , 1997 .

[3]  Roger Bakeman,et al.  Observing Interaction: An Introduction to Sequential Analysis , 1986 .

[4]  Mark Guzdial,et al.  Deriving Software Usage Patterns from Log Files , 1993 .

[5]  Francis T. Durso,et al.  Network Structures in Proximity Data , 1989 .

[6]  Nancy J. Cooke,et al.  Making Usability Data More Usable , 1998 .

[7]  Ronald Baecker,et al.  Timelines, a tool for the gathering, coding and analysis of usability data , 1994, CHI '94.

[8]  Carol A. Manning,et al.  Sequences of Actions for Individual and Teams of Air Traffic Controllers , 1994, Hum. Comput. Interact..

[9]  Francis T. Durso,et al.  Recall and Measures of Memory Organization , 1986 .

[10]  Gwm Matthias Rauterberg,et al.  A Petri net based analysing and modelling tool kit for logfiles in human-computer interaction , 1996 .

[11]  John R. Anderson,et al.  The Transfer of Cognitive Skill , 1989 .

[12]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[13]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[14]  R. Bakeman,et al.  Observing interaction: An introduction to sequential analysis, 2nd ed. , 1997 .

[15]  Paul Weiler,et al.  PDA-based observation logging , 1995, CHI '95.

[16]  John Millar Carroll.  The Nurnberg Funnel: Designing Minimalist Instruction for Practical Computer Skill , 1990 .

[17]  Terri Gullickson.  Analyzing Interaction: Sequential Analysis With SDIS and GSEQ. , 1996 .

[18]  Philippe A. Palanque,et al.  Time modelling in Petri nets for the design of interaction active , 1996, SGCH.

[19]  Penelope M. Sanderson,et al.  Exploratory Sequential Data Analysis: Foundations , 1994, Hum. Comput. Interact..

[20]  T. Goldsmith,et al.  Assessing structural similarity of graphs , 1990 .

[21]  Michael Molenda,et al.  Instructional Technology , 2020, The International Encyclopedia of Higher Education Systems and Institutions.

[22]  B. Hayes-Roth.  Evolution of Cognitive Structures and Processes. , 1977 .

[23]  Alexander L. Wolf,et al.  Automating Process Discovery through Event-Data Analysis , 1995, 1995 17th International Conference on Software Engineering.

[24]  Thomas Elwert.  Continuous and explicit dialogue modelling , 1996, CHI 1996.

[25]  J. Graham,et al.  Sniffy, the virtual rat: Simulated operant conditioning , 1994 .

[26]  G. Engelbeck,et al.  A test of a common elements theory of transfer , 1986, CHI '86.

[27]  Matthias Rauterberg,et al.  From Novice to Expert Decision Behaviour: a Qualitative Modelling Approach with Petri Nets. , 1995 .

[28]  S. C. Johnson.  Hierarchical clustering schemes , 1967, Psychometrika.

[29]  Nancy J. Cooke,et al.  Procedural Network Representations of Sequential Data , 1996, Hum. Comput. Interact..

[30]  John M. Gottman,et al.  Sequential Analysis: A Guide for Behavorial Researchers , 1990 .

[31]  Susan M. Dray,et al.  Mind maps and causal models: using graphical representations of field research data , 1997, CHI Extended Abstracts.

[32]  Wolfgang Reisig,et al.  A Primer in Petri Net Design , 1992, Springer Compass International.

[33]  Myron Wish,et al.  Three-Way Multidimensional Scaling , 1978 .

[34]  E. Hutchins.  Cognition in the wild , 1995 .

[35]  S. Pinker.  How the Mind Works , 1999, Annals of the New York Academy of Sciences.

[36]  Nancy J. Cooke,et al.  Predicting judgment time from measures of psychological proximity. , 1992 .

[37]  C. A. Petri.  Introduction to General Net Theory , 1979, Advanced Course: Net Theory and Applications.