Visual Sampling Processes Revisited: Replicating and Extending Senders (1983) Using Modern Eye-Tracking Equipment

In pioneering work, Senders (1983) tasked five participants to watch a bank of six dials, and found that glance rates and times glanced at dials increase linearly as a function of the frequency bandwidth of the dial's pointer. Senders did not record the angle of the pointers synchronously with eye movements, and so could not assess participants’ visual sampling behavior in regard to the pointer state. Because the study of Senders has been influential but never repeated, we replicated and extended it by assessing the relationship between visual sampling and pointer state, using modern eye-tracking equipment. Eye tracking was performed with 86 participants who watched seven 90-second videos, each video showing six dials with moving pointers. Participants had to press the spacebar when any of the six pointers crossed a threshold. Our results showed a close resemblance to Senders’ original results. Additionally, we found that participants did not behave in accordance with a periodic sampling model, but rather were conditional samplers, in that the probability of looking at a dial was contingent on pointer angle and velocity. Finally, we found that participants sampled more in agreement with Nyquist sampling when the high bandwidth dials were placed in the middle of the bank rather than at its outer edges. We observed results consistent with the saliency, effort, expectancy, and value model and conclude that human sampling of multidegree of freedom systems should not only be modeled in terms of bandwidth but also in terms of saliency and effort.

[1]  R W OBERMAYER,et al.  Pilot Eye Fixations While Flying Selected Maneuvers Using Two Instrument Panels , 1964, Human factors.

[2]  Paul Milgram,et al.  The Development of a Time-Related Measure to Describe Driving Strategy , 1984 .

[3]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[4]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[5]  Marcus Nyström,et al.  An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data , 2010, Behavior research methods.

[6]  Neville Moray,et al.  Monitoring behavior and supervisory control , 1986 .

[7]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .

[8]  J. R. Carbonell A Queueing Model of Many-Instrument Visual Sampling , 1966 .

[9]  John W. Senders,et al.  THE ATTENTIONAL DEMAND OF AUTOMOBILE DRIVING , 1967 .

[10]  Max Mulder,et al.  Predicting Pilot Task Demand Load During Final Approach , 2009 .

[11]  Michael D. Byrne,et al.  A History and Primer of Human Performance Modeling , 2009 .

[12]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[13]  Michael D. Fleetwood Refining theoretical models of visual sampling in supervisory control tasks: Examining the influence of alarm frequency, effort, value, and salience , 2005 .

[14]  Christopher D. Wickens,et al.  Theory-based Models of Attention in Visual Workspaces , 2017, Int. J. Hum. Comput. Interact..

[15]  M Donk Human monitoring behavior in a multiple-instrument setting: independent sampling, sequential sampling or arrangement-dependent sampling. , 1994, Acta psychologica.

[16]  Jeremy M. Wolfe,et al.  Guided Search 4.0: Current Progress With a Model of Visual Search , 2007, Integrated Models of Cognitive Systems.

[17]  Christopher D. Wickens,et al.  Visual Attention Control, Scanning, and Information Sampling , 2007, Applied Attention Theory.

[18]  Christopher Wickens,et al.  NT-SEEV: A model of attention capture and noticing on the Flight Deck , 2009 .

[19]  Thomas B. Sheridan,et al.  On How Often the Supervisor Should Sample , 1970, IEEE Trans. Syst. Sci. Cybern..

[20]  J I Elkind,et al.  An investigation of the visual sampling behaviour of human observers. NASA Contract Rep NASA CR-434. , 1966, NASA contractor report. NASA CR. United States. National Aeronautics and Space Administration.

[21]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[22]  Jaime R. Carbonell,et al.  A Queueing Model of Visual Sampling Experimental Validation , 1968 .

[23]  A. A. Spady Airline pilot scan patterns during simulated ILS approaches , 1978 .

[24]  R J Bootsma,et al.  Visual information about time-to-collision between two objects. , 1993, Journal of experimental psychology. Human perception and performance.

[25]  William J Horrey,et al.  Modeling drivers' visual attention allocation while interacting with in-vehicle technologies. , 2006, Journal of experimental psychology. Applied.

[26]  John W. Senders,et al.  The Human Operator as a Monitor and Controller of Multidegree of Freedom Systems , 1964 .

[27]  John W. Senders,et al.  The peripheral viewing of dials. , 1955 .

[28]  Dario D. Salvucci,et al.  Threaded cognition: an integrated theory of concurrent multitasking. , 2008, Psychological review.

[29]  Walter W. Wierwille,et al.  Estimating the Amount of Eye Movement Data Required for Panel Design and Instrument Placement , 1976 .

[30]  J. I. Elkind,et al.  Characteristics of simple manual control systems , 1956 .

[31]  Bo Zhang,et al.  I spy with my little eye: Analysis of airline pilots' gaze patterns in a manual instrument flight scenario. , 2017, Applied ergonomics.

[32]  Lawrence J. Fogel,et al.  A note on the sampling theorem , 1955, IRE Trans. Inf. Theory.

[33]  Peter Zaal,et al.  Effects of Retinal Eccentricity on Human Manual Control , 2017 .

[34]  Heikki Summala,et al.  Maintaining Lane Position with Peripheral Vision during In-Vehicle Tasks , 1996, Hum. Factors.

[35]  Christopher D. Wickens,et al.  Attentional Models of Multitask Pilot Performance Using Advanced Display Technology , 2003, Hum. Factors.

[36]  Amy R. Pritchett,et al.  Human-computer interaction in aerospace , 2002 .

[37]  T. O. Kvålseth Human information processing in visual sampling. , 1978, Ergonomics.

[38]  John W. Senders,et al.  Visual Sampling Processes , 1984 .

[39]  P A Hancock,et al.  Automation: how much is too much? , 2014, Ergonomics.

[40]  Thomas B. Sheridan Human centered automation: oxymoron or common sense? , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[41]  Dana H. Ballard,et al.  Modeling embodied visual behaviors , 2007, TAP.

[42]  Paul M. Fitts,et al.  Eye movements of aircraft pilots during instrument-landing approaches. , 1950 .

[43]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Thomas B. Sheridan,et al.  Humans and Automation: System Design and Research Issues , 2002 .