Creating Autonomous Vehicle Systems, Second Edition

Abstract This book is one of the first technical overviews of autonomous vehicles written for a general computing and engineering audience. The authors share their practical experiences designing a...

[1]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[2]  Jie Tang,et al.  A Container Based Edge Offloading Framework for Autonomous Driving , 2020, IEEE Access.

[3]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[4]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Silvio Savarese,et al.  Learning to Track: Online Multi-object Tracking by Decision Making , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Matthew McNaughton,et al.  Parallel Algorithms for Real-time Motion Planning , 2011 .

[8]  Franz Kummert,et al.  General Behavior Prediction by a Combination of Scenario-Specific Models , 2014, IEEE Transactions on Intelligent Transportation Systems.

[9]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[11]  Gabriel J. Brostow,et al.  Digging Into Self-Supervised Monocular Depth Estimation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[13]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[14]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Yang Gao,et al.  Performance Analysis of Precise Point Positioning Using Rea-Time Orbit and Clock Products , 2004 .

[16]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[17]  Jonathan P. How,et al.  Duckietown: An Innovative Way to Teach Autonomy , 2016, EDUROBOTICS.

[18]  Emilio Frazzoli,et al.  Synthetic 2D LIDAR for precise vehicle localization in 3D urban environment , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Pushmeet Kohli,et al.  Graph Cut Based Inference with Co-occurrence Statistics , 2010, ECCV.

[21]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Zhe Zhang,et al.  Computer Architectures for Autonomous Driving , 2017, Computer.

[23]  Paul Newman,et al.  Road vehicle localization with 2D push-broom LIDAR and 3D priors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[24]  Alfred Leick,et al.  GPS Satellite Surveying: Leick/GPS Satellite Surveying , 2015 .

[25]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Sebastian Thrun,et al.  Map-Based Precision Vehicle Localization in Urban Environments , 2007, Robotics: Science and Systems.

[27]  Denis Pomorski,et al.  GPS/IMU data fusion using multisensor Kalman filtering: introduction of contextual aspects , 2006, Inf. Fusion.

[28]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[29]  Jean-Luc Gaudiot,et al.  Autonomous vehicles lite self-driving technologies should start small, go slow , 2020, IEEE Spectrum.

[30]  Konrad Schindler,et al.  Multi-target tracking by continuous energy minimization , 2011, CVPR 2011.

[31]  Aloysius Wehr,et al.  Airborne laser scanning—an introduction and overview , 1999 .

[32]  Simon Lacroix,et al.  Calibration of a rotating multi-beam lidar , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Sebastian Thrun,et al.  Large-Scale Robotic 3-D Mapping of Urban Structures , 2004, ISER.

[34]  Mathias Perrollaz,et al.  Learning-based approach for online lane change intention prediction , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[35]  Weisong Shi,et al.  Edge Computing for Autonomous Driving: Opportunities and Challenges , 2019, Proceedings of the IEEE.

[36]  Bo Yu,et al.  $\pi$π-BA: Bundle Adjustment Hardware Accelerator Based on Distribution of 3D-Point Observations , 2020, IEEE Trans. Computers.

[37]  Jean-Luc Gaudiot,et al.  Computer, Drive My Car! , 2017, Computer.

[38]  Alan Dodson,et al.  Towards PPP-RTK: Ambiguity resolution in real-time precise point positioning , 2011 .

[39]  Emmanuel P. Baltsavias,et al.  Airborne laser scanning: existing systems and firms and other resources , 1999 .

[40]  Pan Zhao,et al.  A Scenario-Adaptive Driving Behavior Prediction Approach to Urban Autonomous Driving , 2017 .

[41]  James D. Spinhirne,et al.  Micro pulse lidar , 1993, IEEE Trans. Geosci. Remote. Sens..

[42]  Christian Berger,et al.  Software & Systems Engineering Process and Tools for the Development of Autonomous Driving Intelligence , 2007, J. Aerosp. Comput. Inf. Commun..

[43]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[45]  Bo Yu,et al.  FPGA-based ORB feature extraction for real-time visual SLAM , 2017, 2017 International Conference on Field Programmable Technology (ICFPT).

[46]  Tomás Martínez-Marín,et al.  Optimal motion planning by reinforcement learning in autonomous mobile vehicles , 2011, Robotica.

[47]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[48]  Vijay Gadepally,et al.  A Framework for Estimating Driver Decisions Near Intersections , 2014, IEEE Transactions on Intelligent Transportation Systems.

[49]  Rüdiger Dillmann,et al.  A probabilistic model for estimating driver behaviors and vehicle trajectories in traffic environments , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[50]  Dirk Haehnel,et al.  Junior: The Stanford entry in the Urban Challenge , 2008 .

[51]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[52]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[53]  Scott Shenker,et al.  Tachyon: Reliable, Memory Speed Storage for Cluster Computing Frameworks , 2014, SoCC.

[54]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[55]  Weisong Shi,et al.  LoPECS: A Low-Power Edge Computing System for Real-Time Autonomous Driving Services , 2020, IEEE Access.

[56]  A. Leick.  GPS satellite surveying , 1990 .

[57]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[58]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[59]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[60]  Kunihiko Fukushima,et al.  Neocognitron: A hierarchical neural network capable of visual pattern recognition , 1988, Neural Networks.

[61]  Markus J. Rieder,et al.  Error analysis and characterization of atmospheric profiles retrieved from GNSS occultation data , 2001 .

[62]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[63]  Valter Costa,et al.  Simulator for Teaching Robotics, ROS and Autonomous Driving in a Competitive Mindset , 2017, Int. J. Technol. Hum. Interact..

[64]  Shuang Wu,et al.  Creating Autonomous Vehicle Systems , 2017, Synthesis Lectures on Computer Science.

[65]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.

[66]  Jonathan P. How,et al.  Driver Behavior Classification at Intersections and Validation on Large Naturalistic Data Set , 2012, IEEE Transactions on Intelligent Transportation Systems.

[67]  Luc Van Gool,et al.  Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[69]  Shai Avidan,et al.  Semi-Global Matching: A Principled Derivation in Terms of Message Passing , 2014, GCPR.

[70]  Kostas Daniilidis,et al.  Monocular visual odometry in urban environments using an omnidirectional camera , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[71]  Ingmar Posner,et al.  Voting for Voting in Online Point Cloud Object Detection , 2015, Robotics: Science and Systems.

[72]  J. Zumberge,et al.  Precise point positioning for the efficient and robust analysis of GPS data from large networks , 1997 .

[73]  Zhijiang Shao,et al.  A unified motion planning method for parking an autonomous vehicle in the presence of irregularly placed obstacles , 2015, Knowl. Based Syst..

[74]  Rüdiger Dillmann,et al.  Probabilistic MDP-behavior planning for cars , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[75]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[76]  Oisin Mac Aodha,et al.  Unsupervised Monocular Depth Estimation with Left-Right Consistency , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[77]  Andreas Geiger,et al.  Object scene flow for autonomous vehicles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[78]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[79]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[80]  Stefan K. Gehrig,et al.  A Real-Time Low-Power Stereo Vision Engine Using Semi-Global Matching , 2009, ICVS.

[81]  Jean-Luc Gaudiot,et al.  Achieving energy efficiency through runtime partial reconfiguration on reconfigurable systems , 2013, TECS.

[82]  Ryan M. Eustice,et al.  Fast LIDAR localization using multiresolution Gaussian mixture maps , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[83]  Dariu Gavrila,et al.  A Bayesian Framework for Multi-cue 3D Object Tracking , 2004, ECCV.

[84]  Markus Maurer,et al.  Probabilistic online POMDP decision making for lane changes in fully automated driving , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[85]  Sebastian Thrun,et al.  Robust vehicle localization in urban environments using probabilistic maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[86]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[87]  Quan Wang,et al.  A Unified Cloud Platform for Autonomous Driving , 2017, Computer.

[88]  James R. Bergen,et al.  Visual odometry for ground vehicle applications , 2006, J. Field Robotics.

[89]  Raquel Urtasun,et al.  Efficient Deep Learning for Stereo Matching , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[90]  Richard S. Zemel,et al.  Learning and Incorporating Top-Down Cues in Image Segmentation , 2006, ECCV.

[91]  Christos Katrakazas,et al.  Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions , 2015 .

[92]  Raquel Urtasun,et al.  Exploiting Sparse Semantic HD Maps for Self-Driving Vehicle Localization , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).