Human attention modeling in a human-machine interface based on the incorporation of contextual features in a Bayesian network

Human attention can only be inferred from certain causal clues. Such an inference process is of high uncertainty. Bayesian network (BN) is often used for modeling such a process; specifically different features that represent human attention can be fused to reach a consistent conclusion. Previous studies on BN have little consideration of so-called contextual features. In this paper, we propose a few contextual features related to human attention. A novel BN model is then formulated which combines both the contextual features and their corresponding observable behavioral features. At the end, an example is used to illustrate the potential use of the new BN model for human-machine interface design.

[1]  John M. Carroll,et al.  Human-Computer Interaction in the New Millennium , 2001 .

[2]  C. Koch,et al.  Models of bottom-up and top-down visual attention , 2000 .

[3]  S. Yantis,et al.  On the distinction between visual salience and stimulus-driven attentional capture. , 1999, Journal of experimental psychology. Human perception and performance.

[4]  Chen Yu,et al.  Understanding Human Behaviors Based on Eye-Head-Hand Coordination , 2002, Biologically Motivated Computer Vision.

[5]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[6]  E. Rajabally,et al.  Aids to Bayesian belief network construction , 2004, 2004 2nd International IEEE Conference on 'Intelligent Systems'. Proceedings (IEEE Cat. No.04EX791).

[7]  Y. Lin,et al.  Using eye movement parameters for evaluating human-machine interface frameworks under normal control operation and fault detection situations , 2003, Int. J. Hum. Comput. Stud..

[8]  David G. Stork,et al.  Pattern Classification , 1973 .

[9]  Antonio A. F. Oliveira,et al.  Tracing Patterns and Attention: Humanoid Robot Cognition , 2000, IEEE Intell. Syst..

[10]  K. Cave,et al.  Top-down and bottom-up attentional control: On the nature of interference from a salient distractor , 1999, Perception & psychophysics.

[11]  J. Wolfe Visual search in continuous, naturalistic stimuli , 1994, Vision Research.

[12]  J. Maunsell,et al.  The role of attention in visual processing. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[13]  U. Neisser VISUAL SEARCH. , 1964, Scientific American.

[14]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[15]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[16]  Eric Horvitz,et al.  Models of attention in computing and communication , 2003, Commun. ACM.

[17]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[18]  Wenjun Chris Zhang,et al.  Effective attention allocation behavior and its measurement: a preliminary study , 2004, Interact. Comput..

[19]  Kim J. Vicente,et al.  Attention Allocation within the Abstraction Hierarchy , 1997 .

[20]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[21]  Reiner Onken,et al.  Detecting Usability Problems with Eye Tracking in Airborne Battle Management Support , 2000 .

[22]  H. Egeth,et al.  Overriding stimulus-driven attentional capture , 1994, Perception & psychophysics.