Learning driving patterns to support navigation

Experience is a significant source of knowledge for any human activity. Knowledge about past failures may help to avoid similar failures in the future, while repeating or even improving successes. Driving is a complex and dynamic activity, and the extensive previous experience provides great help when some important decision has to be made quickly. This thesis proposes and demonstrates methods for learning driving patterns and their use in supporting driving navigation tasks. Driving patterns are sequences of events in the traffic system repeating over time. We developed a framework of the driving warning system based on the learned driving patterns. The learning part of the proposed system builds and maintains the model of the traffic system. The system also predicts the most likely future events. The predicted event is compared with the actual event and if/when driver's behaviour becomes significantly different from "usual", appropriate warnings may be generated. We developed a hardware system for data acquisition from navigation sensors. We used off-the-shelf components and a standard software development environment to create an inexpensive but reliable platform for our experiments. Neural networks are computational methods developed to mimic human information processing. In this thesis we present experiments in vehicle movement prediction, using data from a small number of sensors. We tested prediction capabilities of multi-line perceptrons, recurrent and time-delay neural networks. We found that all neural network architectures have good performances for short-term vehicle movement prediction. However, the prediction error becomes significantly higher when predicting events further in the future. Here we also present the new method for driving event recognition based on hidden Markov models. The data from a very limited set of sensors is collected and transformed to observation sequences representing driving events. For each event type we wish to recognize, one hidden Markov model is trained with observation sequences of this type. Sequences representing test events are applied to all models, and the model with the highest probability indicates the type of event for each sequence. Experiments performed show that the proposed method has a very high recognition rate. We developed a system to predict future driving events based on recognized event types and other data collected from sensors. This system was able to successfully predict future events for previously used routes and to detect when an unexpected event has been experienced.

[1]  D. A. Rosen,et al.  An electronic route-guidance system for highway vehicles , 1970 .

[2]  Thad Starner,et al.  Learning Significant Locations and Predicting User Movement with GPS , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[3]  M. Gori,et al.  BPS: a learning algorithm for capturing the dynamic nature of speech , 1989, International 1989 Joint Conference on Neural Networks.

[4]  Andreas S. Weigend,et al.  The Future of Time Series: Learning and Understanding , 1993 .

[5]  Monson H. Hayes,et al.  Hidden Markov models for face recognition , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[6]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[7]  D. Mitrovic Driving event recognition by hidden Markov models , 1999, 4th International Conference on Telecommunications in Modern Satellite, Cable and Broadcasting Services. TELSIKS'99 (Cat. No.99EX365).

[8]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[9]  N. S. Manju Nath CAN PROTOCOL EASES AUTOMOTIVE-ELECTRONICS NETWORKING , 1998 .

[10]  Feng-Hsiung Hsu,et al.  Behind Deep Blue: Building the Computer that Defeated the World Chess Champion , 2002 .

[11]  Tomohiro Yamamura,et al.  A Driver Behavior Recognition Method Based on a Driver Model Framework , 2000 .

[12]  C. Lee Giles,et al.  An experimental comparison of recurrent neural networks , 1994, NIPS.

[13]  Stephen J. Maybank,et al.  Vehicle Trajectory Approximation and Classification , 1998, BMVC.

[14]  I. Witten,et al.  The Reactive Keyboard: a predictive typing aid , 1990, Computer.

[15]  Johan Bengtsson,et al.  Adaptive Cruise Control and Driver Modeling , 2001 .

[16]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.

[17]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[18]  T. Ozaki THE STATISTICAL ANALYSIS OF PERTURBED LIMIT CYCLE PROCESSES USING NONLINEAR TIME SERIES MODELS , 1982 .

[19]  Richard E. Haskell,et al.  FINDING PATTERN BEHAVIOR IN TEMPORAL DATA USING FUZZY CLUSTERING , 2000 .

[20]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[21]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[22]  Allen Newell,et al.  Heuristic Problem Solving: The Next Advance in Operations Research , 1958 .

[23]  Yangsheng Xu,et al.  Stochastic similarity for validating human control strategy models , 1998, IEEE Trans. Robotics Autom..

[24]  J. Baker,et al.  The DRAGON system--An overview , 1975 .

[25]  R. Peter Bonasso,et al.  Integrating Reaction Plans and Layered Competences Through Synchronous Control , 1991, IJCAI.

[26]  Ulrich Nehmzow,et al.  Route learning in mobile robots through self-organisation , 1996, Proceedings of the First Euromicro Workshop on Advanced Mobile Robots (EUROBOT '96).

[27]  Nasser Kehtarnavaz,et al.  A transportable neural network controller for autonomous vehicle following , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[28]  Daniel G. Bobrow,et al.  Natural Language Input for a Computer Problem Solving System , 1964 .

[29]  Dean A. Pomerleau,et al.  Neural Network Perception for Mobile Robot Guidance , 1993 .

[30]  L. Baum,et al.  An inequality with applications to statistical estimation for probabilistic functions of Markov processes and to a model for ecology , 1967 .

[31]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[32]  Stephen A. Billings,et al.  Non-linear system identification using neural networks , 1990 .

[33]  Rahul Sukthankar,et al.  Situation Awareness for Tactical Driving , 1997 .

[34]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[35]  L. Yang,et al.  Application of hidden Markov models for signature verification , 1995, Pattern Recognit..

[36]  Jonathan H. Connell,et al.  SSS: a hybrid architecture applied to robot navigation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[37]  Takeo Kanade,et al.  First Results in Robot Road-Following , 1985, IJCAI.

[38]  Ishwar K. Sethi,et al.  Road-following with continuous learning , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[39]  John E. Moody,et al.  Forecasting the Economy with Neural Nets: A Survey of Challenges and Solutions , 1996, Neural Networks: Tricks of the Trade.

[40]  Peter Tiño,et al.  Learning long-term dependencies is not as difficult with NARX networks , 1995, NIPS.

[41]  Ruediger Lamm,et al.  Highway Design and Traffic Safety Engineering Handbook , 1999 .

[42]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[43]  Karl-Friedrich Kraiss,et al.  Teaching neural networks to guide a vehicle through an obstacle course by emulating a human teacher , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[44]  H. Hartley Maximum Likelihood Estimation from Incomplete Data , 1958 .

[45]  Lalit R. Bahl,et al.  Design of a linguistic statistical decoder for the recognition of continuous speech , 1975, IEEE Trans. Inf. Theory.

[46]  Tom M. Mitchell,et al.  Version Spaces: A Candidate Elimination Approach to Rule Learning , 1977, IJCAI.

[47]  Ralph Hartley,et al.  Experiments with the subsumption architecture , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[48]  A. Berthoz,et al.  Eye-head coordination for the steering of locomotion in humans: an anticipatory synergy , 1998, Neuroscience Letters.

[49]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[50]  L. Baum,et al.  An inequality and associated maximization technique in statistical estimation of probabilistic functions of a Markov process , 1972 .

[51]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[52]  E. Ziegel Forecasting and Time Series: An Applied Approach , 2000 .

[53]  Richard M. Friedberg,et al.  A Learning Machine: Part I , 1958, IBM J. Res. Dev..

[54]  J. R. Quinlan Discovering rules by induction from large collections of examples Intro-ductory readings in expert s , 1979 .

[55]  D. Mitrovic Experiments in subsymbolic driving pattern prediction , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[56]  D Mitrovic LEARNING DRIVING PATTERNS TO SUPPORT NAVIGATION DECISION MAKING: PRELIMINARY RESULTS , 1998 .

[57]  Peter G. B. Enser Content-based Video Retrieval: A Database Perspective , 2004, J. Documentation.

[58]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[59]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[60]  M. Rornbaut ProLab 2 : a driving assistance system , 1993 .

[61]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[62]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[63]  G. Yule On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers , 1927 .

[64]  Steven L. Horowitz,et al.  A syntactic algorithm for peak detection in waveforms with applications to cardiography , 1975, Commun. ACM.

[65]  Eva Ericsson,et al.  Independent driving pattern factors and their influence on fuel-use and exhaust emission factors , 2001 .

[66]  Dejan Mitrovic,et al.  Reliable method for driving events recognition , 2005, IEEE Transactions on Intelligent Transportation Systems.

[67]  D. Mitrovic Short term prediction of vehicle movements by neural networks , 1999, 1999 Third International Conference on Knowledge-Based Intelligent Information Engineering Systems. Proceedings (Cat. No.99TH8410).

[68]  J. D. Luse,et al.  INTEGRATION OF TRANSIT, OMEGA AND LORAN-C FOR MARINE NAVIGATION , 1983 .

[69]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[70]  Jianing Dai Robust estimation of HMM parameters using fuzzy vector quantization and Parzen's window , 1995, Pattern Recognit..

[71]  Bruce G. Buchanan,et al.  Dendral and Meta-Dendral: Their Applications Dimension , 1978, Artif. Intell..

[72]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[73]  Karl-Friedrich Kraiss,et al.  Identification and application of neural operator models in a car driving situation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[74]  A. Pentland,et al.  Towards real-time recognition of driver intentions , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[75]  Hava T. Siegelmann,et al.  Computational capabilities of recurrent NARX neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[76]  R. Engle Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[77]  Yilin Zhao,et al.  Vehicle Location And Navigation Systems , 1997 .

[78]  Eric A. Wan,et al.  Finite impulse response neural networks with applications in time series prediction , 1994 .

[79]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[80]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[81]  D. Haussler,et al.  A hidden Markov model that finds genes in E. coli DNA. , 1994, Nucleic acids research.

[82]  Theodosios Pavlidis,et al.  Waveform Segmentation Through Functional Approximation , 1973, IEEE Transactions on Computers.

[83]  Erann Gat,et al.  The Winning Robots from the 1993 Robot Competition , 1993, AI Mag..

[84]  Alex Pentland,et al.  Graphical models for driver behavior recognition in a SmartCar , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[85]  Thomas R Carlson,et al.  Characterization of driving patterns and emissions from light-duty vehicles in California. Final report , 1993 .

[86]  H. Tong,et al.  Threshold Autoregression, Limit Cycles and Cyclical Data , 1980 .

[87]  Victor Scheinman Robotworld: a multiple robot vision guided assembly system , 1988 .

[88]  Stefan C. Kremer,et al.  Spatiotemporal Connectionist Networks: A Taxonomy and Review , 2001, Neural Computation.

[89]  Terrence J. Sejnowski,et al.  NETtalk: a parallel network that learns to read aloud , 1988 .

[90]  Christopher J. Harris,et al.  An intelligent driver warning system for vehicle collision avoidance , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[91]  V. Kvasnicka,et al.  Neural and Adaptive Systems: Fundamentals Through Simulations , 2001, IEEE Trans. Neural Networks.

[92]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[93]  Jonathan H. Connell,et al.  Minimalist mobile robotics - a colony-style architecture for an artificial creature , 1990, Perspectives in artificial intelligence.

[94]  Geoffrey E. Hinton,et al.  A time-delay neural network architecture for isolated word recognition , 1990, Neural Networks.

[95]  A. Pentland,et al.  Toward augmented control systems , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[96]  Julio Rosenblatt,et al.  DAMN: a distributed architecture for mobile navigation , 1997, J. Exp. Theor. Artif. Intell..

[97]  John H. L. Hansen,et al.  Discrete-Time Processing of Speech Signals , 1993 .

[98]  Hsiao-Wuen Hon,et al.  An overview of the SPHINX speech recognition system , 1990, IEEE Trans. Acoust. Speech Signal Process..