Predictive Models of Procedural Human Supervisory Control Behavior

Thesis (Ph. D.)--Massachusetts Institute of Technology, Engineering Systems Division, 2011.

[1]  George T. Frampton,et al.  Three Mile Island: a report to the commissioners and to the public. Volume II, Part 1 , 1979 .

[2]  Wondea Jung,et al.  The step complexity measure for emergency operating procedures: measure verification , 2002, Reliab. Eng. Syst. Saf..

[3]  T. van der Schaaf,et al.  Error recovery in a hospital pharmacy , 2006, Ergonomics.

[4]  D. S. Wooding,et al.  Fixation maps: quantifying eye-movement traces , 2002, ETRA.

[5]  S. Greenberg,et al.  The Importance of Awareness for Team Cognition in Distributed Collaboration , 2001 .

[6]  Gabrielle de Brito.  Towards a model for the study of written procedure following in dynamic environments , 2002, Reliab. Eng. Syst. Saf..

[7]  Stacey D. Scott,et al.  Aiding Team Supervision in Command and Control Operations with Large-Screen Displays , 2007 .

[8]  Anthony J. Hornof,et al.  Cognitive strategies and eye movements for searching hierarchical computer displays , 2003, CHI '03.

[9]  Mitchell Rogovin,et al.  Three Mile Island : a report to the Commissioners and to the public , 1980 .

[10]  William Sulis,et al.  Nonlinear Dynamics in Human Behavior , 1996 .

[11]  Randolph A. Miller,et al.  Review: Medical Diagnostic Decision Support Systems - Past, Present, And Future: A Threaded Bibliography and Brief Commentary , 1994, J. Am. Medical Informatics Assoc..

[12]  Christopher D. Wickens,et al.  Control of Multiple-UAVs: A Workload Analysis , 2003 .

[13]  B. Yogameena,et al.  Support Vector Machine-Based Human Behavior Classification in Crowd through Projection and Star Skeletonization , 2010 .

[14]  Michael Matessa,et al.  A Production System Theory of Serial Memory , 1997 .

[15]  Miwa Hayashi.  Hidden Markov Models to identify pilot instrument scanning and attention patterns , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[16]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[17]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[18]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[19]  J. Crandall,et al.  Using Discrete-Event Simulation to Model Situational Awareness of Unmanned-Vehicle Operators , 2008 .

[20]  Amy R. Pritchett,et al.  Improving performance on procedural tasks through presentation of locational procedure context: an empirical evaluation , 2004, Behav. Inf. Technol..

[21]  Birsen Donmez,et al.  Effects of Time Pressure on the Use of an Automated Decision Support System for Strike Planning , 2009 .

[22]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[23]  A. Pentland,et al.  Toward augmented control systems , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[24]  Alex Pentland,et al.  Honest Signals - How They Shape Our World , 2008 .

[25]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[26]  Geri Gay,et al.  Averaging scan patterns and what they can tell us , 2006, ETRA.

[27]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[28]  Mary L. Cummings,et al.  Predictive models of human supervisory control behavioral patterns using hidden semi-Markov models , 2011, Eng. Appl. Artif. Intell..

[29]  K. Weick.  The Vulnerable System: An Analysis of the Tenerife Air Disaster , 1990 .

[30]  M. Cummings,et al.  Behavioral Recognition and Prediction of an Operator Supervising Multiple Heterogeneous Unmanned Vehicles , 2008 .

[31]  W. Karwowski.  Assessment of Team Cognition , 2006 .

[32]  R. Scheines,et al.  Organizational Behavior and Human Decision Processes , 1977 .

[33]  David G. Gibbs.  The Predator in Operation IRAQI FREEDOM -- A Pilot's Perspective , 2005 .

[34]  Miwa Hayashi,et al.  Hidden Markov model analysis for space shuttle crewmembers' scanning behavior , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[35]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[36]  Peter A. Hancock,et al.  Human-Centered Design of Unmanned Aerial Vehicles , 2003 .

[37]  Sridhar Mahadevan,et al.  Robot Learning , 1993 .

[38]  Michael C. Pyryt.  Human cognitive abilities: A survey of factor analytic studies , 1998 .

[39]  I. Janis.  Victims Of Groupthink , 1972 .

[40]  Mary P. Harper,et al.  On the complexity of explicit duration HMM's , 1995, IEEE Trans. Speech Audio Process..

[41]  J. E. Groves,et al.  Made in America: Science, Technology and American Modernist Poets , 1989 .

[42]  Kathleen L. Mosier,et al.  Aircrews and Automation Bias: The Advantages of Teamwork? , 2001 .

[43]  Mary L. Cummings,et al.  Modeling multiple human operators in the supervisory control of heterogeneous unmanned vehicles , 2009, PerMIS.

[44]  J Patrick,et al.  Human processes of control: tracing the goals and strategies of control room teams , 2006, Ergonomics.

[45]  Stephen J. Morrissey,et al.  Reviews of Human Factors and Ergonomics , 2008 .

[46]  Neville A Stanton,et al.  Modelling of human alarm handling response times: a case study of the Ladbroke Grove rail accident in the UK , 2008, Ergonomics.

[47]  David R. Anderson,et al.  Understanding AIC and BIC in Model Selection , 2004 .

[48]  Susan K. Schnipke,et al.  Trials and tribulations of using an eye-tracking system , 2000, CHI Extended Abstracts.

[49]  C. Gersick,et al.  Habitual routines in task-performing groups. , 1990, Organizational behavior and human decision processes.

[50]  Glenn Gunzelmann,et al.  Emulating a Visuospatial Memory Field Using ACT-R , 2004, ICCM.

[51]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[52]  Laurence R. Newcome,et al.  Unmanned Aviation: A Brief History of Unmanned Aerial Vehicles , 2004 .

[53]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[54]  Timothy M. Ravich.  The Integration of Unmanned Aerial Vehicles into the National Airspace , 2009 .

[55]  Gábor Lugosi,et al.  Introduction to Statistical Learning Theory , 2004, Advanced Lectures on Machine Learning.

[56]  Jen-Tzung Chien,et al.  Predictive hidden Markov model selection for decision tree state tying , 2003, INTERSPEECH.

[57]  Ilpo Kojo,et al.  Using hidden Markov model to uncover processing states from eye movements in information search tasks , 2008, Cognitive Systems Research.

[58]  Mica R. Endsley,et al.  The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits , 1987 .

[59]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[60]  Dario D. Salvucci.  A Multitasking General Executive for Compound Continuous Tasks , 2005, Cogn. Sci..

[61]  Jesse Hoey,et al.  Value-Directed Human Behavior Analysis from Video Using Partially Observable Markov Decision Processes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.

[63]  Volume Assp,et al.  ACOUSTICS. SPEECH. AND SIGNAL PROCESSING , 1983 .

[64]  Jean-Michel Marin,et al.  Bayesian Modelling and Inference on Mixtures of Distributions , 2005 .

[65]  S. Dekker.  Failure to adapt or adaptations that fail: contrasting models on procedures and safety. , 2003, Applied ergonomics.

[66]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[67]  Elke U. Weber,et al.  Descriptive and prescriptive models of decision-making: implications for the development of decision aids , 1990, IEEE Trans. Syst. Man Cybern..

[68]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[69]  Derek Ross,et al.  Safety Behaviour in the Construction Sector , 2002 .

[70]  Florian Jentsch,et al.  Creating High-tech Teams: Practical Guidance On Work Performance And Technology , 2005 .

[71]  Nancy J. Cooke,et al.  Coordinated Awareness of Situation by Teams (CAST): Measuring Team Situation Awareness of a Communication Glitch , 2005 .

[72]  R. Simmons,et al.  Complexity Analysis of , 1993 .

[73]  Haiying Tu,et al.  Detecting, tracking, and counteracting terrorist networks via hidden Markov models , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[74]  C. F. Mackenzie,et al.  Decision Making in Dynamic Environments: Fixation Errors and Their Causes , 1995 .

[75]  Domenico Accardo.  AIAA Infotech@Aerospace , 2010 .

[76]  Sandra P. Marshall,et al.  Eye tracking insights into cognitive modeling , 2006, ETRA.

[77]  Roger K. Moore,et al.  Hidden Markov model decomposition of speech and noise , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[78]  Barry Kirwan,et al.  A Guide To Task Analysis: The Task Analysis Working Group , 1992 .

[79]  Mary L. Cummings,et al.  Tracking Resource Allocation Cognitive Strategies for Strike Planning , 2006 .

[80]  Philip Marsden,et al.  Procedures in the nuclear industry , 1996 .

[81]  Mary L. Cummings,et al.  Managing Multiple UAVs through a Timeline Display , 2005 .

[82]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[83]  Neville A. Stanton,et al.  Human Factors in Nuclear Safety , 2007 .

[84]  Valerie J. Gawron,et al.  Human performance measures handbook , 2000 .

[85]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[86]  Markus Falkhausen,et al.  Calculation of distance measures between hidden Markov models , 1995, EUROSPEECH.

[87]  Mark Green,et al.  Optimising procedures in manufacturing systems , 1996 .

[88]  Asaf Degani,et al.  Procedures in complex systems: the airline cockpit , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[89]  N. Deng,et al.  Unsupervised Support Vector Machines with Perturbations , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[90]  Manuele Bicego,et al.  A Hidden Markov Model-Based Approach to Sequential Data Clustering , 2002, SSPR/SPR.

[91]  Ken-ichi Matsumoto,et al.  Detecting low usability web pages using quantitative data of users' behavior , 2006, ICSE.

[92]  David F. Feldon,et al.  Cognitive task analysis , 2009 .

[93]  J. Aldrich.  R.A. Fisher and the making of maximum likelihood 1912-1922 , 1997 .

[94]  William B. Rouse,et al.  Human Detection and Diagnosis of System Failures , 1981 .

[95]  Mary L. Cummings,et al.  Automation Architecture for Single Operator, Multiple UAV Command and Control, , 2007 .

[96]  Krishna R. Pattipati,et al.  Anomaly Detection via Feature-Aided Tracking and Hidden Markov Models , 2007, 2007 IEEE Aerospace Conference.

[97]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.

[98]  Hank Hsin Han Huang,et al.  Developing an abstraction layer for the visualization of HSMM-based predictive decision support , 2009 .

[99]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[100]  Hiroshi Mamitsuka.  Supervised learning of hidden Markov models for sequence discrimination , 1997, RECOMB '97.

[101]  Gautam Biswas,et al.  Finding Behavior Patterns from Temporal Data using Hidden Markov Model based Unsupervised Classi cation , 1999 .

[102]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[103]  J. Deutsch.  Perception and Communication , 1958, Nature.

[104]  Anbal Ollero,et al.  Multiple Heterogeneous Unmanned Aerial Vehicles , 2008 .

[105]  Thomas B. Sheridan,et al.  DRAFT COPY 1 CH XX : Human Supervisory Control Challenges in Network Centric Operations , 2010 .

[106]  Frédéric Vanderhaegen,et al.  Prediction of Human Behaviour Using Artificial Neural Networks , 2005, ICMLC.

[107]  Michael J. Muller,et al.  Can we have spiritual experiences on-line? , 2000, CHI Extended Abstracts.

[108]  Brendan McCane,et al.  Diagnostic tools for evaluating and updating hidden Markov models , 2004, Pattern Recognit..

[109]  Carl Gutwin,et al.  Task analysis for groupware usability evaluation: Modeling shared-workspace tasks with the mechanics of collaboration , 2003, TCHI.

[110]  Michael E. Atwood,et al.  The precis of Project Ernestine or an overview of a validation of GOMS , 1992, CHI.

[111]  Monica N. Lees,et al.  The influence of distraction and driving context on driver response to imperfect collision warning systems , 2007, Ergonomics.

[112]  Thomas B. Sheridan,et al.  Humans and Automation: System Design and Research Issues , 2002 .

[113]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[114]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[115]  M. Reiser,et al.  3. A Goodness-of-Fit Test for the Latent Class Model When Expected Frequencies are Small , 1999 .

[116]  Mary P. Harper,et al.  A Second-Order Hidden Markov Model for Part-of-Speech Tagging , 1999, ACL.

[117]  유화자.  기독교 사역과 Leadership , 1997 .

[118]  Florian Jentsch,et al.  Who Is Flying This Plane Anyway? What Mishaps Tell Us about Crew Member Role Assignment and Air Crew Situation Awareness , 1999, Hum. Factors.

[119]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[120]  Thomas R. Hensley,et al.  Victims of Groupthink , 1986 .

[121]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[122]  Linden J. Ball,et al.  Eye Tracking in Human-Computer Interaction and Usability Research : Current Status and Future Prospects , 2004 .

[123]  Peter A. Hancock,et al.  Implementing Adaptive Function Allocation , 2001 .

[124]  J. Hackman,et al.  Leading Teams: Setting the Stage for Great Performances , 2002 .

[125]  Kazuo Furuta,et al.  Human Factor Analysis of JCO Criticality Accident , 2000, Cognition, Technology & Work.

[126]  A. Tversky,et al.  Judgment under Uncertainty , 1982 .

[127]  Y. Guédon.  Estimating Hidden Semi-Markov Chains From Discrete Sequences , 2003 .

[128]  R. Ratcliff,et al.  Human cognition and a pile of sand: a discussion on serial correlations and self-organized criticality. , 2005, Journal of experimental psychology. General.

[129]  Ching Y. Suen,et al.  Automatic model selection for the optimization of SVM kernels , 2005, Pattern Recognit..

[130]  Emilie M. Roth,et al.  An empirical investigation of operator performance in cognitively demanding simulated emergencies , 1994 .

[131]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[132]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[133]  Michael D. Byrne,et al.  Task Structure and Postcompletion Error in the Execution of a Routine Procedure , 2006, Hum. Factors.

[134]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[135]  Douglas DeCarlo,et al.  Robust clustering of eye movement recordings for quantification of visual interest , 2004, ETRA.

[136]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[137]  Neil Brewer,et al.  Effects of supervisory monitoring on productivity and quality of performance. , 1998 .

[138]  Andrew H. Sung,et al.  Intrusion detection using neural networks and support vector machines , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[139]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[140]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[141]  N. Brewer,et al.  Supervisory behaviour and team performance amongst police patrol sergeants , 1994 .

[142]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[143]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[144]  Alex Bateman,et al.  An introduction to hidden Markov models. , 2007, Current protocols in bioinformatics.

[145]  George Cybenko,et al.  Efficient computation of the hidden Markov model entropy for a given observation sequence , 2005, IEEE Transactions on Information Theory.

[146]  Charles Kemp,et al.  Bayesian models of cognition , 2008 .

[147]  Pierre Baldi,et al.  Smooth On-Line Learning Algorithms for Hidden Markov Models , 1994, Neural Computation.

[148]  WU KarenT,et al.  Results , 1969 .

[149]  Jung-Hsien Chiang,et al.  Handwritten word recognition with character and inter-character neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[150]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[151]  Abdelaziz Kriouile,et al.  Some improvements in speech recognition algorithms based on HMM , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[152]  R. John Hansman,et al.  SAFETY CONSIDERATIONS FOR OPERATION OF UNMANNED AERIAL VEHICLES IN THE NATIONAL AIRSPACE SYSTEM , 2006 .

[153]  Christopher A. Higgins,et al.  Computerized performance monitoring systems: use and abuse , 1986, CACM.

[154]  E. Salas,et al.  Toward an understanding of team performance and training. , 1992 .

[155]  John R. Anderson,et al.  A central circuit of the mind , 2008, Trends in Cognitive Sciences.

[156]  J. Gregory Trafton,et al.  Human control of multiple unmanned vehicles: effects of interface type on execution and task switching times , 2006, HRI '06.

[157]  Martin J. Russell,et al.  Poster abstract: evaluation of hidden Markov models robustness in uncovering focus of visual attention from noisy eye-tracker data , 2004, ETRA.

[158]  J. Theiler,et al.  Grammar-guided Feature Extraction for Time Series Classification , 2005 .

[159]  Jeff A. Bilmes,et al.  What HMMs Can Do , 2006, IEICE Trans. Inf. Syst..

[160]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[161]  Eric R. Ziegel,et al.  Analysis of Financial Time Series , 2002, Technometrics.

[162]  Ivandro Sanches.  Noise-compensated hidden Markov models , 2000, IEEE Trans. Speech Audio Process..

[163]  Nicholas Roy,et al.  Comparing Learning Techniques for Hidden Markov Models of Human Supervisory Control Behavior , 2009 .

[164]  A. Abdel-Malek,et al.  A model of human operator behavior during pursuit manual tracking-what does it reveal? , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[165]  Andrew T. Duchowski,et al.  Proceedings of the 2006 symposium on Eye tracking research & applications , 2000 .

[166]  S.P. Miller,et al.  Mode confusion analysis of a flight guidance system using formal methods , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[167]  Yangsheng Xu,et al.  Support Vector Machine for Behavior-Based Driver Identification System , 2010, J. Robotics.

[168]  I. Csiszár,et al.  The consistency of the BIC Markov order estimator , 2000 .

[169]  Dean A. Pomerleau,et al.  Knowledge-Based Training of Artificial Neural Networks for Autonomous Robot Driving , 1993 .

[170]  J. Carroll.  Human Cognitive Abilities-a sur-vey of factor-analytic studies , 1993 .

[171]  Alan C. Bovik,et al.  Visual search: structure from noise , 2002, ETRA.

[172]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[173]  Nancy G. Leveson,et al.  A new accident model for engineering safer systems , 2004 .

[174]  Jeff Pressing,et al.  Spectral properties of human cognition and skill , 1997, Biological Cybernetics.

[175]  A. Welford.  THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .

[176]  李幼升,et al.  Ph , 1989 .

[177]  J C F de Winter,et al.  Violations and errors during simulation-based driver training , 2007, Ergonomics.

[178]  Mustapha Mouloua,et al.  Automation Technology and Human Performance: Current Research and Trends , 1999 .

[179]  Stanley M. Shinners.  Modeling of Human Operator Performance Utilizing Time Series Analysis , 1974, IEEE Trans. Syst. Man Cybern..

[180]  Carl Nehme,et al.  Modeling human supervisory control in heterogeneous unmanned vehicle systems , 2009 .

[181]  André P. Calitz,et al.  The added value of eye tracking in the usability evaluation of a network management tool , 2005 .

[182]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[183]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[184]  C. Lappe.  Eye movements: A window on mind and brain , 2008 .

[185]  John S. Gardenier.  Ship Navigational Failure Detection and Diagnosis , 1981 .

[186]  Thomas B. Sheridan,et al.  HUMAN SUPERVISORY CONTROL ISSUES IN NETWORK CENTRIC WARFARE , 2004 .