Predictive Control of Uncertain Systems based on Motion Prediction

Author(s): LEE, DONGHAN | Advisor(s): Borrelli, Francesco | Abstract: Model predictive control is a very popular control scheme in a wide range of fields including driver assistance systems and autonomous robots. For example, in driver assistance systems, predictive control allows for improved safety and comfort. However, its implementation is a challenge in uncertain environments. Therefore, it is desirable to predict the evolution of the environment in which the controlled system operates. In other words, we pursue a highly accurate forecast of the environment so that we may achieve feasible and reliable action from the controller.This dissertation presents a systematic framework that uses predictive control and forecasts of the future environment to operate under uncertainties and constraints. In particular, we focus on enhancing the performance of a predictive control scheme based on an accurate trajectory prediction of any targets controlled by humans (e.g., vehicles driven by human or humans themselves). We propose several motion-prediction-models using physics-based and data-driven approaches to improve the accuracy of the forecast. An interacting-multiple-model approach with Kalman filter techniques is useful in environments where it is difficult to have prior data sets such as disaster sites. Based on collected data from experimental vehicles, machine learning methods including hidden Markov models, convolution neural networks, and recurrent neural networks are used to enhance long-term predictions. Furthermore, we present predictive controls based on a probabilistic view of uncertain forecasts. The effectiveness of the proposed framework is demonstrated via applications such as human-companion robots, automotive adaptive cruise control, and autonomous lane change assist. The results of both simulation and real experimental data show the synergy between the motion prediction models and the predictive control designs.

[1]  Michael Schreckenberg,et al.  Asymmetric Lane Change Rules for a Microscopic Highway Traffic Model , 2014, ACRI.

[2]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[3]  Qeethara Al-Shayea Artificial Neural Networks in Medical Diagnosis , 2024, International Journal of Research Publication and Reviews.

[4]  Kyongsu Yi,et al.  Multi-vehicle target selection for adaptive cruise control , 2010 .

[5]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  B. Kouvaritakis,et al.  Successive linearization NMPC for a class of stochastic nonlinear systems , 2009 .

[7]  Wojciech Zaremba,et al.  Recurrent Neural Network Regularization , 2014, ArXiv.

[8]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[10]  Henrik I. Christensen,et al.  Autonomous person following for telepresence robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[11]  Lorenzo Fagiano,et al.  Randomized Solutions to Convex Programs with Multiple Chance Constraints , 2012, SIAM J. Optim..

[12]  D. Mayne,et al.  Min-max feedback model predictive control for constrained linear systems , 1998, IEEE Trans. Autom. Control..

[13]  Marcello Farina,et al.  Stochastic linear Model Predictive Control with chance constraints – A review , 2016 .

[14]  Juan Liu,et al.  An Efficient Computational Architecture for a Collision Early-Warning System for Vehicles, Pedestrians, and Bicyclists , 2011, IEEE Transactions on Intelligent Transportation Systems.

[15]  Luigi Chisci,et al.  Systems with persistent disturbances: predictive control with restricted constraints , 2001, Autom..

[16]  Feng Gao,et al.  A comprehensive review of the development of adaptive cruise control systems , 2010 .

[17]  K.C.J. Dietmayer,et al.  IMM object tracking for high dynamic driving maneuvers , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[18]  Francesco Borrelli,et al.  Automated driving: The role of forecasts and uncertainty - A control perspective , 2015, Eur. J. Control.

[19]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Vijay Kumar,et al.  Human-Robot Collaborative Topological Exploration for Search and Rescue Applications , 2014, DARS.

[21]  J. Suh,et al.  Development of collision probability based motion planning algorithm for automated driving vehicles , 2016 .

[22]  Lie Guo,et al.  Trajectory planning and tracking control for autonomous lane change maneuver based on the cooperative vehicle infrastructure system , 2015, Expert Syst. Appl..

[23]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[24]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Marco C. Campi,et al.  The Exact Feasibility of Randomized Solutions of Uncertain Convex Programs , 2008, SIAM J. Optim..

[26]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[27]  Maja J. Mataric,et al.  Autonomous human–robot proxemics: socially aware navigation based on interaction potential , 2016, Autonomous Robots.

[28]  Zhenyu He,et al.  Single object tracking via robust combination of particle filter and sparse representation , 2015, Signal Process..

[29]  Keith Redmill,et al.  Automated lane change controller design , 2003, IEEE Trans. Intell. Transp. Syst..

[30]  Petros A. Ioannou,et al.  Personalized Driver/Vehicle Lane Change Models for ADAS , 2015, IEEE Transactions on Vehicular Technology.

[31]  F. Borrelli,et al.  Stochastic Predictive Control of Autonomous Vehicles in Uncertain Environments , 2014 .

[32]  Giuseppe Carlo Calafiore,et al.  Uncertain convex programs: randomized solutions and confidence levels , 2005, Math. Program..

[33]  Tyler Ryan,et al.  LMI-Based Gain Synthesis for Simple Robust Quadrotor Control , 2013, IEEE Transactions on Automation Science and Engineering.

[34]  Francesco Borrelli,et al.  Vehicle inertial parameter identification using Extended and unscented Kalman Filters , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[35]  Christian Vollmer,et al.  Learning to navigate through crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[36]  Chang Liu,et al.  Parallel Interacting Multiple Model-Based Human Motion Prediction for Motion Planning of Companion Robots , 2015, IEEE Transactions on Automation Science and Engineering.

[37]  Manfred Morari,et al.  Model predictive control: Theory and practice , 1988 .

[38]  Renxi Qiu,et al.  User-centered design of a dynamic-autonomy remote interaction concept for manipulation-capable robots to assist elderly people in the home , 2012, HRI 2012.

[39]  Mathias Perrollaz,et al.  Learning-based approach for online lane change intention prediction , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[40]  Angelos Amditis,et al.  Cooperative Path Prediction in Vehicular Environments , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[41]  Francesco Borrelli,et al.  Scenario model predictive control for lane change assistance on highways , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[42]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[43]  Derek Stanley Caveney Multiple model techniques in automotive estimation and control , 2004 .

[44]  Francesco Borrelli,et al.  Predictive Control of Autonomous Ground Vehicles With Obstacle Avoidance on Slippery Roads , 2010 .

[45]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[47]  S. Shankar Sastry,et al.  Decentralized nonlinear model predictive control of multiple flying robots , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[48]  J. Richalet,et al.  Model predictive heuristic control: Applications to industrial processes , 1978, Autom..

[49]  M. Kretschmer,et al.  Combining Vehicle Dynamics Control and Decision Making Procedures Towards Safe Overtaking Maneuvers , 2005 .

[50]  Francesco Borrelli,et al.  Scenario Model Predictive Control for Lane Change Assistance and Autonomous Driving on Highways , 2017, IEEE Intelligent Transportation Systems Magazine.

[51]  Steven Dubowsky,et al.  PAMM - a robotic aid to the elderly for mobility assistance and monitoring: a "helping-hand" for the elderly , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[52]  Klaus C. J. Dietmayer,et al.  A learning concept for behavior prediction in traffic situations , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[53]  Georg Schildbach,et al.  Scenario-based optimization for multi-stage stochastic decision problems , 2014 .

[54]  Jürgen Schmidhuber,et al.  LSTM can Solve Hard Long Time Lag Problems , 1996, NIPS.

[55]  Dongsuk Kum,et al.  The multilayer perceptron approach to lateral motion prediction of surrounding vehicles for autonomous vehicles , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[56]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[57]  Azim Eskandarian,et al.  Vehicle Collision Avoidance Maneuvers With Limited Lateral Acceleration Using Optimal Trajectory Control , 2013 .

[58]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[59]  Jaewan Lee,et al.  Advanced braking algorithm for robust longitudinal risk management , 2016 .

[60]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[61]  Tay Christopher,et al.  Analysis of Dynamic Scenes: Application to Driving Assistance , 2009 .

[62]  Sirish L. Shah,et al.  Evaluation of Adaptive Extended Kalman Filter Algorithms for State Estimation in Presence of Model-Plant Mismatch , 2013 .

[63]  Klaus-Dieter Kuhnert,et al.  A lane change detection approach using feature ranking with maximized predictive power , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[64]  Basil Kouvaritakis,et al.  Explicit use of probabilistic distributions in linear predictive control , 2010, Autom..

[65]  David Q. Mayne,et al.  Robust model predictive control of constrained linear systems with bounded disturbances , 2005, Autom..

[66]  Wassim G. Najm,et al.  ANALYSIS OF LANE CHANGE CRASHES , 2003 .

[67]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[68]  Rajesh Rajamani,et al.  Vehicle dynamics and control , 2005 .

[69]  Thomas Bak,et al.  Trajectory planning for robots in dynamic human environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  Simon Steinmeyer,et al.  Lane Change Assistance , 2012 .

[71]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[72]  Chongzhao Han,et al.  Models and Algorithms for Tracking Target with Coordinated Turn Motion , 2014 .

[73]  Giuseppe Carlo Calafiore,et al.  Randomized Model Predictive Control for stochastic linear systems , 2012, 2012 American Control Conference (ACC).

[74]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[75]  Tomás Svoboda,et al.  Designing Intelligent Robots for Human-Robot Teaming in Urban Search and Rescue , 2012, AAAI Spring Symposium: Designing Intelligent Robots.

[76]  Francesco Borrelli,et al.  A machine learning approach for personalized autonomous lane change initiation and control , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[77]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[78]  Klaus-Dieter Kuhnert,et al.  A probabilistic long term prediction approach for highway scenarios , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[79]  Takayuki Kanda,et al.  Interactive Humanoid Robots for a Science Museum , 2006, IEEE Intelligent Systems.

[80]  Pongsathorn Raksincharoensak,et al.  Lane Change Behavior Modeling for Autonomous Vehicles Based on Surroundings Recognition , 2011 .

[81]  Basil Kouvaritakis,et al.  Probabilistic tubes in linear stochastic model predictive control , 2009, Syst. Control. Lett..

[82]  John Folkesson,et al.  Unsupervised robot learning to predict person motion , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[83]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[84]  Francesco Borrelli,et al.  Kinematic and dynamic vehicle models for autonomous driving control design , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[85]  Ashwin Mark Carvalho,et al.  Predictive Control under Uncertainty for Safe Autonomous Driving: Integrating Data-Driven Forecasts with Control Design , 2016 .

[86]  S. Haykin Kalman Filtering and Neural Networks , 2001 .

[87]  Jianqiang Wang,et al.  Model Predictive Multi-Objective Vehicular Adaptive Cruise Control , 2011, IEEE Transactions on Control Systems Technology.

[88]  Gerd Wanielik,et al.  Comparison and evaluation of advanced motion models for vehicle tracking , 2008, 2008 11th International Conference on Information Fusion.

[89]  Wolfgang Rosenstiel,et al.  Object-oriented Bayesian networks for detection of lane change maneuvers , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[90]  E. Hall,et al.  Proxemics [and Comments and Replies] , 1968, Current Anthropology.

[91]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[92]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[93]  Klaus-Dieter Kuhnert,et al.  When will it change the lane? A probabilistic regression approach for rarely occurring events , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[94]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[95]  Riccardo Scattolini,et al.  Stochastic Model Predictive Control of constrained linear systems with additive uncertainty , 2009, 2009 European Control Conference (ECC).

[96]  M. Horowitz HUMAN SPATIAL BEHAVIOR. , 1965, American journal of psychotherapy.

[97]  Kyongsu Yi,et al.  Human driving data-based design of a vehicle adaptive cruise control algorithm , 2008 .

[98]  Ruzena Bajcsy,et al.  Communicating intent on the road through human-inspired control schemes , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[99]  Tzila Shamir,et al.  How should an autonomous vehicle overtake a slower moving vehicle: design and analysis of an optimal trajectory , 2004, IEEE Transactions on Automatic Control.

[100]  Chang Liu,et al.  Interacting multiple model-based human motion prediction for motion planning of companion robots , 2015, SSRR.

[101]  Alberto Bemporad,et al.  Predictive Control for Linear and Hybrid Systems , 2017 .

[102]  Francesco Borrelli,et al.  Stochastic Model Predictive Control for Building HVAC Systems: Complexity and Conservatism , 2015, IEEE Transactions on Control Systems Technology.

[103]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[104]  Marcello Farina,et al.  An approach to output-feedback MPC of stochastic linear discrete-time systems , 2015, Autom..

[105]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[106]  Yizhou Wang,et al.  Autonomous lane-change controller via mixed logical dynamical , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[107]  Julius Ziegler,et al.  Optimal trajectory generation for dynamic street scenarios in a Frenét Frame , 2010, 2010 IEEE International Conference on Robotics and Automation.

[108]  Kyongsu Yi,et al.  Stochastic predictive control based motion planning for lane change decision using a Vehicle Traffic Simulator , 2016, 2016 IEEE Transportation Electrification Conference and Expo, Asia-Pacific (ITEC Asia-Pacific).

[109]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..

[110]  Larry C. Andrews,et al.  Special Functions Of Mathematics For Engineers , 2022 .

[111]  Véronique Berge-Cherfaoui,et al.  Vehicle trajectory prediction based on motion model and maneuver recognition , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[112]  José Eugenio Naranjo,et al.  Lane-Change Fuzzy Control in Autonomous Vehicles for the Overtaking Maneuver , 2008, IEEE Transactions on Intelligent Transportation Systems.

[113]  Francesco Borrelli,et al.  Stochastic predictive control for semi-autonomous vehicles with an uncertain driver model , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[114]  Chung Choo Chung,et al.  Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[115]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[116]  Yong Rui,et al.  Better proposal distributions: object tracking using unscented particle filter , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[117]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[118]  Xiaojing Zhang Robust and Stochastic Control of Uncertain Systems - From Scenario Optimization to Adjustable Uncertainty Sets , 2016 .

[119]  Christoph Stiller,et al.  Driver intent inference at urban intersections using the intelligent driver model , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[120]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[121]  Francesco Borrelli,et al.  Autonomous cruise control with cut-in target vehicle detection , 2016 .

[122]  B. Harshbarger An Introduction to Probability Theory and its Applications, Volume I , 1958 .

[123]  Basil Kouvaritakis,et al.  Efficient robust predictive control , 2000, IEEE Trans. Autom. Control..

[124]  Christian Laugier,et al.  Probabilistic navigation in dynamic environment using Rapidly-exploring Random Trees and Gaussian processes , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[125]  Cordelia Schmid,et al.  Local Convolutional Features with Unsupervised Training for Image Retrieval , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[126]  Sara McMains,et al.  Convolution neural network-based lane change intention prediction of surrounding vehicles for ACC , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[127]  Hermann Winner,et al.  Development of a general criticality criterion for the risk estimation of driving situations and its application to a maneuver-based lane change assistance system , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[128]  Karl Henrik Johansson,et al.  A scenario-based distributed stochastic MPC for building temperature regulation , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[129]  Marco C. Campi,et al.  A Sampling-and-Discarding Approach to Chance-Constrained Optimization: Feasibility and Optimality , 2011, J. Optim. Theory Appl..

[130]  Ulrich Kressel,et al.  Probabilistic trajectory prediction with Gaussian mixture models , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[131]  H. W. Sorenson,et al.  Kalman filtering : theory and application , 1985 .

[132]  Christian Laugier,et al.  From Proxemics Theory to Socially-Aware Navigation: A Survey , 2014, International Journal of Social Robotics.

[133]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[134]  Ruzena Bajcsy,et al.  Identifying Modes of Intent from Driver Behaviors in Dynamic Environments , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[135]  Jianda Han,et al.  Disturbance estimation for RUAV using UKF with acceleration measurement , 2015, 2015 IEEE International Conference on Mechatronics and Automation (ICMA).

[136]  John Lygeros,et al.  A randomized approach to Stochastic Model Predictive Control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[137]  Josef Pauli,et al.  A generic video and radar data fusion system for improved target selection , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[138]  Gonzalo Ferrer,et al.  Robot social-aware navigation framework to accompany people walking side-by-side , 2016, Autonomous Robots.

[139]  James A. Primbs,et al.  Stochastic Receding Horizon Control of Constrained Linear Systems With State and Control Multiplicative Noise , 2007, IEEE Transactions on Automatic Control.

[140]  Sebastian Thrun,et al.  Assisted Highway Lane Changing with RASCL , 2010, AAAI Spring Symposium: Embedded Reasoning.

[141]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[142]  Carl Doersch,et al.  Tutorial on Variational Autoencoders , 2016, ArXiv.