Situation Awareness for Tactical Driving

A primary challenge to creating an intelligent vehicle that can competently drive in traffic is the task of tactical reasoning: deciding which maneuvers to perform in a particular driving situation, in real-time, given incomplete information about the rapidly changing traffic configuration. Human expertise in tactical driving is attributed to situation awareness, a task-specific understanding of the dynamic entities in the environment, and their projected impact on the agent’s actions. In this thesis, I demonstrate how situation awareness may be used as a basis for tactical-level reasoning in intelligent vehicles. SAPIENT (Situation Awareness Planner Implementing Effective Navigation in Traffic) combines a knowledge of high-level driving goals with low-level reactive behavior to control vehicles in a custom tactical-level simulator, SHIVA. The simulated vehicles are based on the Carnegie Mellon Navlabs, sharing a common perception and control interface, allowing researchers to port systems from simulation to real life with minimal modification. The first implementation, MonoSAPIENT, uses explicitly encoded rules for competent driving, along with specialized algorithms for gap selection and lane changing to drive safely in the simulated world. The second implementation, PolySAPIENT, is a distributed intelligence, built around the notion of reasoning objects, independent experts, each specializing in a single aspect of the driving domain. Each reasoning object is associated with an observed traffic entity, such as a nearby vehicle or an upcoming exit, and examines the projected interactions of that entity on the agent’s proposed actions. Thus, a reasoning object associated with a vehicle is responsible for preventing collisions, while one associated with a desired exit recommends those actions that will help maneuver the vehicle to the exit. The results are expressed as votes and vetoes over a tactical action space of available maneuvers, and are used by a domainindependent arbiter to select the agent’s next action. This loose coupling avoids the complex interactions common in traditional architectures, and also allows new reasoning objects to be easily added to an existing PolySAPIENT system. I also introduce a new learning strategy, based on the PBIL evolutionary algorithm, that simultaneously optimizes internal parameters for multiple reasoning objects given a user-specified evaluation metric. This automated parameter exploration also enables rapid prototyping of new PolySAPIENT configurations.

[1]  Brenda J. Vumbaco The application of traffic simulation models : proceedings of a Conference on the Application of Traffic Simulation Models, June 3-5, 1981, Williamsburg, Virginia , 1981 .

[2]  Harilaos N. Koutsopoulos,et al.  A microscopic traffic simulator for evaluation of dynamic traffic management systems , 1996 .

[3]  A. Pentland,et al.  Toward augmented control systems , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[4]  H. T. Kung,et al.  CARGuide: on-board computer for automobile route guidance , 1984, AFIPS '84.

[5]  Dean A. Pomerleau,et al.  PANS: a portable navigation platform , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[6]  Nadine B. Sarter,et al.  How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control , 1995, Hum. Factors.

[7]  Julio Rosenblatt,et al.  DAMN: a distributed architecture for mobile navigation , 1997, J. Exp. Theor. Artif. Intell..

[8]  Rich Caruana,et al.  Removing the Genetics from the Standard Genetic Algorithm , 1995, ICML.

[9]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[10]  C. Chang,et al.  Kalman filter algorithms for a multi-sensor system , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[11]  Toshiyuki Gotoh,et al.  A compact navigation system using image processing and fuzzy control , 1990, IEEE Proceedings on Southeastcon.

[12]  Günther Schmidt,et al.  A COMPREHENSIVE CONTROL CONCEPT FOR MERGING OF AUTOMATED VEHICLES UNDER A BROAD CLASS OF TRAFFIC CONDITIONS , 1983 .

[13]  R. von Tomkewitsch,et al.  Dynamic route guidance and interactive transport management with ALI-SCOUT , 1991 .

[14]  Moshe Ben-Akiva,et al.  MODELS OF FREEWAY LANE CHANGING AND GAP ACCEPTANCE BEHAVIOR , 1996 .

[15]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[16]  Milind Tambe,et al.  Intelligent Automated Agents for Tactical Air Simulation: A Progress Report , 1994 .

[17]  Charles E. Thorpe,et al.  Integrated mobile robot control , 1991 .

[18]  Michael A. Companion,et al.  Are they Shooting at Me?: An Approach to Training Situational Awareness , 1990 .

[19]  Bruce H. Krogh,et al.  Integrated path planning and dynamic steering control for autonomous vehicles , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[20]  Dean A. Pomerleau,et al.  Vision guided lane transition , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[21]  S-Y Wong TRAF-NETSIM: HOW IT WORKS, WHAT IT DOES , 1990 .

[22]  M. A. Stoneridge,et al.  Practical horseman's book of riding, training, and showing hunters and jumpers , 1989 .

[23]  Raj Reddy,et al.  The Challenge of Artificial Intelligence , 1996, Computer.

[24]  Bernard Widrow,et al.  Neural networks: applications in industry, business and science , 1994, CACM.

[25]  E. D. Dickmanns,et al.  A Curvature-based Scheme for Improving Road Vehicle Guidance by Computer Vision , 1987, Other Conferences.

[26]  Pravin Varaiya,et al.  SMARTPATH, AN AUTOMATED HIGHWAY SYSTEM SIMULATOR , 1992 .

[27]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[28]  Andrew McCallum,et al.  Reinforcement learning with selective perception and hidden state , 1996 .

[29]  Chang Yang,et al.  A Longitudinal Control Concept For Merging Of Automated Vehicles , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[30]  Takeo Kanade,et al.  First Results in Robot Road-Following , 1985, IJCAI.

[31]  Ralf Kories,et al.  Towards autonomous convoy driving: recognizing the starting vehicle in front , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[32]  Oren Etzioni,et al.  An Approach to Planning with Incomplete Information , 1992, KR.

[33]  A J McKnight,et al.  DRIVER EDUCATION TASK ANALYSIS. VOLUME 1: TASK DESCRIPTIONS , 1970 .

[34]  K H F Cardew THE AUTOMATIC STEERING OF VEHICLES : AN EXPERIMENTAL SYSTEM FITTED TO A DS 19 CITROEN CAR , 1970 .

[35]  D. Ballard,et al.  A knowledge-based decision aid for enhanced situational awareness , 1994, AIAA/IEEE Digital Avionics Systems Conference. 13th DASC.

[36]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[37]  Ronald R Knipling,et al.  SINGLE-VEHICLE ROADWAY DEPARTURE CRASHES: PROBLEM SIZE ASSESSMENT AND STATISTICAL DESCRIPTION. FINAL REPORT , 1994 .

[38]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[39]  Bart Kosko,et al.  Neural networks and fuzzy systems: a dynamical systems approach to machine intelligence , 1991 .

[40]  J. H. Rillings,et al.  Advanced driver information systems , 1990 .

[41]  Charles E. Thorpe,et al.  Panacea: An Active Sensor Controller for the ALVINN Autonomous Driving System , 1993 .

[42]  J Aasman IMPLEMENTATIONS OF CAR-DRIVER BEHAVIOUR AND PSYCHOLOGICAL RISK MODELS --ROAD USER BEHAVIOR. THEORY AND RESEARCH. PAPERS PRESENTED AT THE 2ND INTERNATIONAL CONFERENCE ON ROAD SAFETY HELD IN GRONINGEN, NETHERLANDS, AUGUST 1987 , 1988 .

[43]  Michael E. Lesk,et al.  Route Finding in Street Maps by Computers and People , 1982, AAAI.

[44]  J. Davenport Editor , 1960 .

[45]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[46]  Shumeet Baluja,et al.  Evolution of an artificial neural network based autonomous land vehicle controller , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[47]  Joseph William Crow,et al.  Automatic Headway Control - An Automatic Vehicle Spacing System , 1970 .

[48]  Aleks Ohannes Gollu,et al.  Object Management Systems , 1995 .

[49]  R. L. Small,et al.  A real-time approach to information management in a pilot's associate , 1991, IEEE/AIAA 10th Digital Avionics Systems Conference.

[50]  Hoong Chor Chin SIMRO: a model to simulate traffic at roundabouts , 1985 .

[51]  Martin L Fracker,et al.  Explicit, Implicit, and Subjective Rating Measures of Situation Awareness in a Monitoring Task , 1991 .

[52]  Delnaz Khorramabadi,et al.  SMARTPATH USER'S MANUAL , 1994 .

[53]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[54]  James F. Cremer,et al.  The Software Architecture for Scenario Control in the Iowa Driving Simulator , 1993 .

[55]  Shumeet Baluja,et al.  Expectation-based selective attention , 1996 .

[56]  H H Van der molen,et al.  Risk models for traffic participants: a concerted effort for theoretical operationalizations , 1987 .

[57]  Maxwell J. Wells,et al.  Communicating Situation Awareness in Virtual Environments , 1994 .

[58]  Michael A. Vidulich,et al.  Testing a Subjective Metric of Situation Awareness , 1991 .

[59]  J R Treat,et al.  TRI-LEVEL STUDY OF THE CAUSES OF TRAFFIC ACCIDENTS: FINAL REPORT , 1979 .

[60]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[61]  Charles E. Thorpe,et al.  A Simulation and Design System for Tactical Driving Algorithms , 1996 .

[62]  R. E. Fenton,et al.  A study of automatic car following , 1969 .

[63]  Rahul Sukthankar,et al.  RACCOON: A Real-time Autonomous Car Chaser Operating Optimally At Night , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[64]  Steven A. Shafer,et al.  Selective Perception for Robot Driving , 1993, AAAI.

[65]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[66]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[67]  John A. Michon,et al.  A critical view of driver behavior models: What do we know , 1985 .

[68]  David S. Prerau,et al.  Developing and managing expert systems , 1989 .

[69]  David Woods,et al.  Situation Awareness: A Critical But Ill-Defined Phenomenon , 1991 .

[70]  Douglas W. Gage,et al.  Ground Vehicle Convoying , 1987, Other Conferences.

[71]  Eduardo Salas,et al.  Situation Awareness in Team Performance: Implications for Measurement and Training , 1995, Hum. Factors.

[72]  Dean A. Pomerleau,et al.  Neural Network Perception for Mobile Robot Guidance , 1993 .

[73]  Theodore J. Rosenthal,et al.  A Computer Simulation Analysis of Safety Critical Maneuvers for Assessing Ground Vehicle Dynamic Stability , 1993 .

[74]  C Jacoby,et al.  AN AHS CONCEPT BASED ON MAXIMUM ADAPTABILITY , 1996 .

[75]  Martin R. Stytz,et al.  Providing Situation Awareness Assistance to Users of Large-Scale, Dynamic, Complex Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[76]  Günther Schmidt,et al.  A Comprehensive Control Concept for Merging of Automated Vehicles Under a Broad Class of Traffic Conditions , 1983 .

[77]  Dean A. Pomerleau,et al.  AVCS RESEARCH AT CARNEGIE MELLON UNIVERSITY , 1994 .

[78]  Martial Hebert,et al.  A Reactive System For Off-Road Navigation , 1994 .

[79]  C. Vision-based Vehicle Guidance , 1992, Springer Series in Perception Engineering.

[80]  Nasser Kehtarnavaz,et al.  Visual control of an autonomous vehicle (BART)-the vehicle-following problem , 1991 .

[81]  D Reece,et al.  AN OVERVIEW OF THE PHAROS TRAFFIC SIMULATOR , 1988 .

[82]  Charles E. Thorpe,et al.  Tactical-level simulation for intelligent transportation systems , 1998 .

[83]  Peter Cheeseman,et al.  On the Representation and Estimation of Spatial Uncertainty , 1986 .

[84]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[85]  B A Galler,et al.  COLLISION WARNING USING NEIGHBORING VEHICLE INFORMATION , 1996 .

[86]  R C Vanstrum,et al.  PERCEPTION MODEL FOR DESCRIBING AND DEALING WITH DRIVER INVOLVEMENT IN HIGHWAY ACCIDENTS , 1971 .

[87]  Anthony Stentz Optimal and Efficient Path Planning for Unknown and Dynamic Environments , 1993 .

[88]  Rahul Sukthankar,et al.  Prototyping Intelligent Vehicle Modules Using Evolutionary Algorithms , 1997 .

[89]  B Biehl,et al.  IMPROVED SAFETY THROUGH IMPROVED TECHNICAL MEASURES , 1994 .

[90]  M Bayouth,et al.  AN AHS CONCEPT BASED ON AUTONOMOUS VEHICLE ARCHITECTURE , 1996 .

[91]  L. D. Reid,et al.  A systematic study of driver steering behaviour , 1981 .

[92]  George M. Siouris,et al.  SAMPLE: SITUATION AWARENESS MODEL FOR PILOT IN-THE-LOOP EVALUATION , 1995 .

[93]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[94]  Keith Gardels AUTOMATIC CAR CONTROLS FOR ELECTRONIC HIGHWAYS , 1960 .

[95]  P. Garnier,et al.  An hybrid motion controller for a real car-like robot evolving in a multi-vehicle environment , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[96]  R. Larsen AVCS: an overview of current applications and technology , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.