Chapter 20 – What the Driver's Eye Tells the Car's Brain

Publisher Summary This chapter explores the possibility of using the link between eye movements and the underlying mental processes for improving driving comfort and safety. The main question is whether the mental state or intentions of the driver can be inferred from eye movements before an action or maneuver takes place. Decoding human intentions by eye movement patterns (as an aide to safer driving) seems within the realms of reality as collected data suggests. A precise program that can read human eye movement behavior, which in turn can be associated with a particular task, needs serious research and analysis. A statistical approach used to model human drivers, provides a set of mathematical tools with which one can actually identify the mental state most likely to be associated with an observed pattern of behavior. Precise eye movement analysis promises to enhance the systems performance by enabling recognition of driver intentions rather than just recognizing maneuvers as they begin. Although the wide variety of potential driving circumstances may impede the implementation of a generally smart car, the general outlook for success seems optimistic.

[1]  J M Findlay,et al.  A probability vector and transition matrix analysis of eye movements during visual search. , 1995, Acta psychologica.

[2]  Michael Land,et al.  Which parts of the road guide steering? , 1995, Nature.

[3]  Alan Kingstone,et al.  Orienting of Visual Attention , 1992 .

[4]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[5]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[6]  R R Mourant,et al.  Mapping Eye-Movement Patterns to the Visual Scene in Driving: An Exploratory Study1 , 1970, Human factors.

[7]  A. S. Cohen,et al.  Eye Movements While Driving Cars around Curves , 1977 .

[8]  H P Willumeit,et al.  VISUAL SCANNING PATTERN IN CURVE NEGOTIATION. , 1991 .

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  M. Potter Meaning in visual search. , 1975, Science.

[11]  A. Pentland,et al.  Toward augmented control systems , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[12]  K Nakayama,et al.  Experiencing and perceiving visual surfaces. , 1992, Science.

[13]  Ronald R. Mourant,et al.  Strategies of Visual Search by Novice and Experienced Drivers , 1972 .

[14]  A. Pentland,et al.  Towards real-time recognition of driver intentions , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[15]  R. Groner,et al.  Looking at Faces: Local and Global Aspects of Scanpaths , 1984 .

[16]  Daniel Raviv,et al.  A Unified Approach to Camera Fixation and Vision-Based Road Following , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[17]  L Stark,et al.  Eye Movements during the Viewing of Necker Cubes , 1978, Perception.

[18]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[19]  P. Viviani Eye movements in visual search: cognitive, perceptual and motor control aspects. , 1990, Reviews of oculomotor research.

[20]  Joseph H. Goldberg,et al.  Eye-gaze determination of user intent at the computer interface , 1993 .

[21]  Yangsheng Xu,et al.  Human action learning via hidden Markov model , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[22]  Chris Harris,et al.  On the reversibility of Markov scanning in free-viewing , 1993 .

[23]  P. Locher,et al.  The role of scanpaths in the recognition of random shapes , 1974 .

[24]  P L Olson,et al.  DRIVER EYE FIXATIONS UNDER DIFFERENT OPERATING CONDITIONS , 1989 .

[25]  I. Biederman,et al.  On the information extracted from a glance at a scene. , 1974, Journal of experimental psychology.

[26]  Jitendra Malik,et al.  New results in stereo-based automatic vehicle guidance , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[27]  Blake Hannaford,et al.  Hidden Markov Model Analysis of Force/Torque Information in Telemanipulation , 1991, Int. J. Robotics Res..

[28]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[29]  R. Tibshirani,et al.  Association between cellular-telephone calls and motor vehicle collisions. , 1997, The New England journal of medicine.

[30]  Richard A. Bolt,et al.  A gaze-responsive self-disclosing display , 1990, CHI '90.

[31]  Ronald R. Mourant,et al.  Acquisition of indirect vision information by novice, experienced, and mature drivers. , 1977 .

[32]  Joseph G. Wohl,et al.  Man-Machine Steering Dynamics , 1961 .

[33]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[34]  S R Ellis,et al.  Statistical Dependency in Visual Scanning , 1986, Human factors.

[35]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[36]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[37]  C. Eriksen,et al.  Visual attention within and around the field of focal attention: A zoom lens model , 1986, Perception & psychophysics.

[38]  Thomas A. Dingus,et al.  An Evaluation of the Effectiveness and Efficiency of an Automobile Moving-Map Navigational Display , 1990, Int. J. Man Mach. Stud..

[39]  J. Antes The time course of picture viewing. , 1974, Journal of experimental psychology.

[40]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[41]  D. Shinar,et al.  Eye Movements in Curve Negotiation , 1977, Human factors.