Autonomous Driving in Adverse Weather Conditions: A Survey

Automated Driving Systems (ADS) open up a new domain for the automotive industry and offer new possibilities for future transportation with higher efficiency and comfortable experiences. However, autonomous driving under adverse weather conditions has been the problem that keeps autonomous vehicles (AVs) from going to level 4 or higher autonomy for a long time. This paper assesses the influences and challenges that weather brings to ADS sensors in an analytic and statistical way, and surveys the solutions against inclement weather conditions. Stateof-the-art techniques on perception enhancement with regard to each kind of weather are thoroughly reported. External auxiliary solutions like V2X technology, weather conditions coverage in currently available datasets, simulators, and experimental facilities with weather chambers are distinctly sorted out. By pointing out all kinds of major weather problems the autonomous driving field is currently facing, and reviewing both hardware and computer science solutions in recent years, this survey contributes a holistic overview on the obstacles and directions of ADS development in terms of adverse weather driving conditions. Index Terms — autonomous driving, adverse weather conditions, sensor fusion, perception enhancement, sensor robustness

[1]  Sen Wang,et al.  RadarSLAM: Radar based Large-Scale SLAM in All Weathers , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Edward Hoare,et al.  Road Surface Classification Using Automotive Ultrasonic Sensor , 2016 .

[3]  Jean-Philippe Tarel,et al.  Towards Fog-Free In-Vehicle Vision Systems through Contrast Restoration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Mcity Data Collection for Automated Vehicles Study , 2019, ArXiv.

[5]  M. Sivak,et al.  THE INFLUENCE OF HYDROPHOBIC WINDSHIELD COATING ON DRIVER VISUAL PERFORMANCE , 1997 .

[6]  Erran L. Li,et al.  Robust Multimodal Vehicle Detection in Foggy Weather Using Complementary Lidar and Radar Signals , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Aiping Liu,et al.  Image De-raining via Continual Learning , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yohannes Kassahun,et al.  A2D2: Audi Autonomous Driving Dataset , 2020, ArXiv.

[9]  Jeremy P. Bos,et al.  Drivable path detection using CNN sensor fusion for autonomous driving in the snow , 2021, Defense + Commercial Sensing.

[10]  Bing Zeng,et al.  Multi-Decoding Deraining Network and Quasi-Sparsity Based Training , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Sherif M. Gaweesh,et al.  Assessment of Drivers’ Perceptions of Connected Vehicle–Human Machine Interface for Driving Under Adverse Weather Conditions: Preliminary Findings From Wyoming , 2020, Frontiers in Psychology.

[12]  Sousso Kelouwani,et al.  The Perception System of Intelligent Ground Vehicles in All Weather Conditions: A Systematic Literature Review , 2020, Sensors.

[13]  Andy Lambrechts,et al.  RGB-NIR active gated imaging , 2016, Security + Defence.

[14]  Jin Hong,et al.  Guangzhou smart city construction and big data research , 2015, 2015 International Conference on Behavioral, Economic and Socio-cultural Computing (BESC).

[15]  R. Rasmussen,et al.  The Estimation of Snowfall Rate Using Visibility , 1999 .

[16]  Werner Huber,et al.  Test Methodology for Vision-Based ADAS Algorithms with an Automotive Camera-in-the-Loop , 2018, 2018 IEEE International Conference on Vehicular Electronics and Safety (ICVES).

[17]  E. Ryeng,et al.  Driver behaviour data linked with vehicle, weather, road surface, and daylight data , 2016, Data in brief.

[18]  H.F. Grip,et al.  Vehicle sideslip estimation , 2009, IEEE Control Systems.

[19]  Faouzi Kamoun,et al.  Estimating meteorological visibility range under foggy weather conditions: A deep learning approach , 2018, EUSPN/ICTH.

[20]  Nguyen Anh Minh Mai,et al.  3D Object Detection with SLS-Fusion Network in Foggy Weather Conditions , 2021, Sensors.

[21]  L. Ippolito,et al.  Propagation effects handbook for satellite systems design. A summary of propagation impairments on 10 to 100 GHz satellite links with techniques for system design , 1983 .

[22]  Rashid Mehmood,et al.  TAAWUN: a Decision Fusion and Feature Specific Road Detection Approach for Connected Autonomous Vehicles , 2019, Mobile Networks and Applications.

[23]  Ryan M. Eustice,et al.  University of Michigan North Campus long-term vision and lidar dataset , 2016, Int. J. Robotics Res..

[24]  Michal Uřičář,et al.  Let’s Get Dirty: GAN Based Data Augmentation for Camera Lens Soiling Detection in Autonomous Driving , 2021, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[25]  In So Kweon,et al.  KAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving , 2018, IEEE Transactions on Intelligent Transportation Systems.

[26]  Christopher R. Hudson,et al.  Predicting the Influence of Rain on LIDAR in ADAS , 2019, Electronics.

[27]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[28]  Bo Liu,et al.  Recognition of Road Surface Condition Through an On-Vehicle Camera Using Multiple Classifiers , 2016 .

[29]  D. Cremers,et al.  4Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Driving , 2020, GCPR.

[30]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Q. A. Al-Haija,et al.  Multi-Class Weather Classification Using ResNet-18 CNN for Autonomous IoT and CPS Applications , 2020, 2020 International Conference on Computational Science and Computational Intelligence (CSCI).

[32]  Kamil Żywanowski,et al.  Comparison of camera-based and 3D LiDAR-based place recognition across weather conditions , 2020, 2020 16th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[33]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[34]  Mark Campbell,et al.  All Weather Perception: Joint Data Association, Tracking, and Classification for Autonomous Ground Vehicles , 2016, ArXiv.

[35]  I. Gultepe.  Measurements of light rain, drizzle and heavy fog , 2008 .

[36]  Yoshitaka Shibata,et al.  Development and Evaluation of Road State Information Platform Based on Various Environmental Sensors in Snow Countries , 2020, EIDWT.

[37]  Monika Sester,et al.  Areal rainfall estimation using moving cars as rain gauges – a modelling study , 2009 .

[38]  Guofa Li,et al.  Deep Learning Approaches on Pedestrian Detection in Hazy Weather , 2020, IEEE Transactions on Industrial Electronics.

[39]  Jean-Jacques Boreux,et al.  An innovative artificial fog production device improved in the European project “FOG” , 2008 .

[40]  Deyu Meng,et al.  Semi-Supervised Video Deraining with Dynamical Rain Generator , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Dragomir Anguelov,et al.  Scalability in Perception for Autonomous Driving: Waymo Open Dataset , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Guoliang Zhang,et al.  Effects of temperature environment on ranging accuracy of lidar , 2018, International Conference on Digital Image Processing.

[43]  Chang Wang,et al.  Research on the Comfort of Vehicle Passengers Considering the Vehicle Motion State and Passenger Physiological Characteristics: Improving the Passenger Comfort of Autonomous Vehicles , 2020, International journal of environmental research and public health.

[44]  Ralph Helmar Rasshofer,et al.  Influences of weather phenomena on automotive laser radar systems , 2011 .

[45]  D. Hill,et al.  Assimilation of weather radar and binary ubiquitous sensor measurements for quantitative precipitation estimation , 2015 .

[46]  Austin A. Richards,et al.  Automotive sensing: assessing the impact of fog on LWIR, MWIR, SWIR, visible, and lidar performance , 2019, Defense + Commercial Sensing.

[47]  Song Wang,et al.  From Shadow Generation to Shadow Removal , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Felix Heide,et al.  Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Tao Yue,et al.  Controlling the Rain: from Removal to Rendering , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Yassine Ruichek,et al.  EU Long-term Dataset with Multiple Sensors for Autonomous Driving , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[51]  A. Shaker,et al.  Visibility-Based Technologies and Methodologies for Autonomous Driving , 2020, Self-driving Vehicles and Enabling Technologies [Working Title].

[52]  Jiong Yang,et al.  PointPillars: Fast Encoders for Object Detection From Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Xiaochun Cao,et al.  Ultra-High-Definition Image Dehazing via Multi-Guided Bilateral Learning , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Senthil Yogamani,et al.  Let The Sunshine in: Sun Glare Detection on Automotive Surround-view Cameras , 2020, Autonomous Vehicles and Machines.

[55]  R. Weigel,et al.  The influence of rain on small aperture LiDAR sensors , 2016, 2016 German Microwave Conference (GeMiC).

[56]  Matti Kutila,et al.  Automotive LiDAR performance verification in fog and rain , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[57]  Soo Jeon,et al.  Model predictive path planning with time-varying safety constraints for highway autonomous driving , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[58]  Mauro Bellone,et al.  Autonomous Driving in the Real-World: The Weather Challenge in the Sohjoa Baltic Project , 2021, Towards Connected and Autonomous Vehicle Highways.

[59]  Krzysztof Czarnecki,et al.  Canadian Adverse Driving Conditions dataset , 2020, Int. J. Robotics Res..

[60]  Vasile Palade,et al.  WhONet: Wheel Odometry Neural Network for Vehicular Localisation in GNSS-Deprived Environments , 2021, Eng. Appl. Artif. Intell..

[61]  Shinpei Kato,et al.  An Open Multi-Sensor Fusion Toolbox for Autonomous Vehicles , 2020, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[62]  Rubén M. Lorenzo,et al.  Accurate and Robust Localization in Harsh Environments Based on V2I Communication , 2013 .

[63]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[64]  Ryan M. Eustice,et al.  Fast LIDAR localization using multiresolution Gaussian mixture maps , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[65]  Cornelius Neumann,et al.  Automotive LiDAR pollution detection system based on total internal reflection techniques , 2020, OPTO.

[66]  B. Wu,et al.  Application of Kalman Filter to Improve 3D LiDAR Signals of Autonomous Vehicles in Adverse Weather , 2021, Applied Sciences.

[67]  Anthony Rowe,et al.  Fast reactive control for illumination through rain and snow , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[68]  Deyu Meng,et al.  From Rain Generation to Rain Removal , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[69]  Cewu Lu,et al.  Two-Class Weather Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  Robin Karlsson,et al.  Probabilistic Rainfall Estimation from Automotive Lidar , 2021, 2022 IEEE Intelligent Vehicles Symposium (IV).

[71]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[72]  Nick McKeown,et al.  Automated vehicle control developments in the PATH program , 1991 .

[73]  Yuxiang Sun,et al.  iCurb: Imitation Learning-Based Detection of Road Curbs Using Aerial Images for Autonomous Driving , 2021, IEEE Robotics and Automation Letters.

[74]  Trevor Darrell,et al.  BDD100K: A Diverse Driving Video Database with Scalable Annotation Tooling , 2018, ArXiv.

[75]  D. Winker,et al.  Looking through the haze: evaluating the CALIPSO level 2 aerosol optical depth using airborne high spectral resolution lidar data , 2014 .

[76]  Bo Li,et al.  SECOND: Sparsely Embedded Convolutional Detection , 2018, Sensors.

[77]  Christopher J Hill,et al.  Concept of Operations for Road Weather Connected Vehicle and Automated Vehicle Applications , 2017 .

[78]  Zuva Tranos,et al.  Performance of drivable path detection system of autonomous robots in rain and snow scenario , 2014, 2014 International Conference on Signal Processing and Integrated Networks (SPIN).

[79]  John Khoury,et al.  An Initial Investigation of the Effects of a Fully Automated Vehicle Fleet on Geometric Design , 2019, Journal of Advanced Transportation.

[80]  You Li,et al.  Lidar for Autonomous Driving: The Principles, Challenges, and Trends for Automotive Lidar and Perception Systems , 2020, IEEE Signal Processing Magazine.

[81]  Michael S. Brown,et al.  Learning Multi-Scale Photo Exposure Correction , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[82]  Jianping An,et al.  Voxel-FPN: Multi-Scale Voxel Feature Aggregation for 3D Object Detection from LIDAR Point Clouds , 2020, Sensors.

[83]  Vivek K Goyal,et al.  Advances in Single-Photon Lidar for Autonomous Vehicles: Working Principles, Challenges, and Recent Advances , 2020, IEEE Signal Processing Magazine.

[84]  Dariu Gavrila,et al.  EuroCity Persons: A Novel Benchmark for Person Detection in Traffic Scenes , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[85]  Ömer Sahin Tas,et al.  Limited Visibility and Uncertainty Aware Motion Planning for Automated Driving , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[86]  Christian Icking,et al.  Air Pollution and Fog Detection through Vehicular Sensors , 2014, 2014 8th Asia Modelling Symposium.

[87]  Viola Cavallo,et al.  Distance Perception of Vehicle Rear Lights in Fog , 2001, Hum. Factors.

[88]  Matti Kutila,et al.  Testing and Validation of Automotive Point-Cloud Sensors in Adverse Weather Conditions , 2019, Applied Sciences.

[89]  Mehrdad Dianati,et al.  A Survey of the State-of-the-Art Localization Techniques and Their Potentials for Autonomous Vehicle Applications , 2018, IEEE Internet of Things Journal.

[90]  R B McMullen.  Product specifications. , 1983, Hospital materiel management quarterly.

[91]  Q. Lu,et al.  LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[92]  Wenhan Luo,et al.  Deep Dense Multi-Scale Network for Snow Removal Using Semantic and Depth Priors , 2021, IEEE Transactions on Image Processing.

[93]  Sergio Casas,et al.  RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects , 2020, ECCV.

[94]  D. V. Rogers,et al.  The aR b relation in the calculation of rain attenuation , 1978 .

[95]  A. Carullo,et al.  An ultrasonic sensor for distance measurement in automotive applications , 2001, IEEE Sensors Journal.

[96]  Srinivas S. Pulugurtha,et al.  Back-propagation neural network model to predict visibility at a road link-level , 2020 .

[97]  S. Donati,et al.  Embedding LiDAR and smart laser headlight in a compact module for autonomous driving , 2021 .

[98]  S. Dunlop.  A dictionary of weather , 2001 .

[99]  Eijiro Takeuchi,et al.  Performance Analysis of 10 Models of 3D LiDARs for Automated Driving , 2020, IEEE Access.

[100]  Ruigang Yang,et al.  The ApolloScape Open Dataset for Autonomous Driving and Its Application , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[101]  Karl Schulmeister.  The new edition of the international laser product safety standard IEC 60825-1 , 2017 .

[102]  Tao Peng,et al.  Lane-Change Model and Tracking Control for Autonomous Vehicles on Curved Highway Sections in Rainy Weather , 2020 .

[103]  Radu Timofte,et al.  NTIRE 2018 Challenge on Image Dehazing: Methods and Results , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[104]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[105]  Ryan M. Eustice,et al.  Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving , 2017, Int. J. Robotics Res..

[106]  C. Neumann,et al.  Influence of sensor blockage on automotive LiDAR systems , 2019, 2019 IEEE SENSORS.

[107]  Erik Marchi,et al.  Detecting Road Surface Wetness from Audio: A Deep Learning Approach , 2015, 2016 23rd International Conference on Pattern Recognition (ICPR).

[108]  Paul Newman,et al.  Illumination Invariant Imaging : Applications in Robust Vision-based Localisation , Mapping and Classification for Autonomous Vehicles , 2014 .

[109]  Boris Buschardt,et al.  Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations , 2021, Sensors.

[110]  Ahmed A. Elngar,et al.  Internet of things based intelligent accident avoidance system for adverse weather and road conditions , 2021, Journal of Reliable Intelligent Environments.

[111]  Luc Van Gool,et al.  ACDC: The Adverse Conditions Dataset with Correspondences for Semantic Driving Scene Understanding , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[112]  Peter Kontschieder,et al.  The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[113]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[114]  Shervin Minaee,et al.  Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework , 2021, IEEE transactions on intelligent transportation systems (Print).

[115]  Samir A. Rawashdeh,et al.  A Review of Detection and Removal of Raindrops in Automotive Vision Systems , 2021, J. Imaging.

[116]  Aryan Mehra,et al.  ReViewNet: A Fast and Resource Optimized Network for Enabling Safe Autonomous Driving in Hazy Weather Conditions , 2021, IEEE Transactions on Intelligent Transportation Systems.

[117]  Wenfu Zhang,et al.  Si Photonics for Practical LiDAR Solutions , 2019, Applied Sciences.

[118]  Shinpei Kato,et al.  LIBRE: The Multiple 3D LiDAR Dataset , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[119]  Qifeng Chen,et al.  Robust Reflection Removal with Reflection-free Flash-only Cues , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[120]  S Yagar,et al.  A temporal analysis of rain-related crash risk. , 1993, Accident; analysis and prevention.

[121]  Paul D. Groves.  The Complexity Problem in Future Multisensor Navigation and Positioning Systems: A Modular Solution , 2014 .

[122]  Amnon Shashua,et al.  On a Formal Model of Safe and Scalable Self-driving Cars , 2017, ArXiv.

[123]  Teresa A. Vidal-Calleja,et al.  Selective Combination of Visual and Thermal Imaging for Resilient Localization in Adverse Conditions: Day and Night, Smoke and Fire , 2013, J. Field Robotics.

[124]  Werner Ritter,et al.  Benchmarking Image Sensors Under Adverse Weather Conditions for Autonomous Driving , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[125]  Bo Jiang,et al.  D2-City: A Large-Scale Dashcam Video Dataset of Diverse Traffic Scenarios , 2019, ArXiv.

[126]  Stewart Worrall,et al.  Optimising the selection of samples for robust lidar camera calibration , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[127]  Mohak Shah,et al.  Is it Safe to Drive? An Overview of Factors, Challenges, and Datasets for Driveability Assessment in Autonomous Driving , 2018, ArXiv.

[128]  Allan J. Delaney,et al.  Dielectric properties of soils at UHF and microwave frequencies , 1974 .

[129]  P. Newman,et al.  The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[130]  Zeyuan Chen,et al.  PSD: Principled Synthetic-to-Real Dehazing Guided by Physical Priors , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[131]  Ying Liu,et al.  Radar Based Object Detection and Tracking for Autonomous Driving , 2018, 2018 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).

[132]  Simon Lucey,et al.  Argoverse: 3D Tracking and Forecasting With Rich Maps , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[133]  Jae Wook Jeon,et al.  Low-Light Image Enhancement for Autonomous Driving Systems using DriveRetinex-Net , 2020, 2020 IEEE International Conference on Consumer Electronics - Asia (ICCE-Asia).

[134]  Zheng Zhang,et al.  Multi-class weather classification on single images , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[135]  Vladlen Koltun,et al.  Playing for Benchmarks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[136]  Stephen Phillips,et al.  De-noising of Lidar Point Clouds Corrupted by Snowfall , 2018, 2018 15th Conference on Computer and Robot Vision (CRV).

[137]  Ali Abdi Kordani,et al.  Effect of Adverse Weather Conditions on Vehicle Braking Distance of Highways , 2018 .

[138]  Antonio M. López,et al.  The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[139]  Stanley Lam,et al.  Laser Eyes for Driverless Cars: The Road to Automotive LIDAR , 2019, 2019 Optical Fiber Communications Conference and Exhibition (OFC).

[140]  Hai-Miao Hu,et al.  A fast image dehazing algorithm based on negative correction , 2014, Signal Process..

[141]  Yukinori Kobayashi,et al.  Multi-Modal Sensor Fusion-Based Semantic Segmentation for Snow Driving Scenarios , 2021, IEEE Sensors Journal.

[142]  Thomas Brandmeier,et al.  Modeling and simulation of rain for the test of automotive sensor systems , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[143]  M. Lehtonen,et al.  Supercontinuum generation in a highly biréfringent microstructured fiber , 2003 .

[144]  Nicholas Paul,et al.  Application of HDR algorithms to solve direct sunlight problems when autonomous vehicles using machine vision systems are driving into sun , 2018, Comput. Ind..

[145]  Yuan Tian,et al.  Vehicle Detection under Adverse Weather from Roadside LiDAR Data , 2020, Sensors.

[146]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[147]  Jaycil Z. Varghese,et al.  Overview of Autonomous Vehicle Sensors and Systems , 2015 .

[148]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[149]  Wolfram Burgard,et al.  Mapping and localization with RFID technology , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[150]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[151]  Zygmunt Mierczyk,et al.  Comparison of 905 nm and 1550 nm semiconductor laser rangefinders’ performance deterioration due to adverse environmental conditions , 2014 .

[152]  Ryo Yanase,et al.  Improving Lateral Autonomous Driving in Snow-Wet Environments Based on Road-Mark Reconstruction Using Principal Component Analysis , 2021, IEEE Intelligent Transportation Systems Magazine.

[153]  Huifang Li,et al.  An effective thin cloud removal procedure for visible remote sensing images , 2014 .

[154]  M. Cherniakov,et al.  Experimental study on low‐THz automotive radar signal attenuation during snowfall , 2019, IET Radar, Sonar & Navigation.

[155]  Andreas Ullrich,et al.  Online waveform processing for demanding target situations , 2014, Defense + Security Symposium.

[156]  Werner Ritter,et al.  A Benchmark for Lidar Sensors in Fog: Is Detection Breaking Down? , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[157]  Y. Ruichek,et al.  Performance Modeling a Near-Infrared ToF LiDAR Under Fog: A Data-Driven Approach , 2022, IEEE Transactions on Intelligent Transportation Systems.

[158]  A. T. van Zanten,et al.  Bosch ESP Systems: 5 Years of Experience , 2000 .

[159]  P. Newman,et al.  Multi-weather city: Adverse weather stacking for autonomous driving , 2021, 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW).

[160]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[161]  Cyrille Gernot.  GPS Signal Disturbances by Water in Various States , 2007 .

[162]  Gerald S. Buller,et al.  Full Waveform LiDAR for Adverse Weather Conditions , 2020, IEEE Transactions on Vehicular Technology.

[163]  Yingjie Chen,et al.  A Large-scale Simulation Dataset: Boost the Detection Accuracy for Special Weather Conditions , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[164]  Jiang Yu Zheng.  IUPUI Driving Videos and Images in All Weather and Illumination Conditions , 2021, ArXiv.

[165]  Jing Liu,et al.  LIDAR obstacle warning and avoidance system for unmanned aerial vehicle sense-and-avoid , 2016 .

[166]  Yukinori Kobayashi,et al.  Semantic Image Segmentation on Snow Driving Scenarios , 2020, 2020 IEEE International Conference on Mechatronics and Automation (ICMA).

[167]  Ansar-Ul-Haque Yasar,et al.  A Neural network approach to visibility range estimation under foggy weather conditions , 2017, EUSPN/ICTH.

[168]  Matti Kutila,et al.  Automotive LIDAR sensor development scenarios for harsh weather conditions , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[169]  Beijia Zhang,et al.  Localizing Ground Penetrating RADAR: A Step Toward Robust Autonomous Ground Vehicle Localization , 2016, J. Field Robotics.

[170]  G. Lio,et al.  LIDAR and Beam Steering Tailored by Neuromorphic Metasurfaces Dipped in a Tunable Surrounding Medium , 2021, Photonics.

[171]  Eijiro Takeuchi,et al.  Motion Analysis and Performance Improved Method for 3D LiDAR Sensor Data Compression , 2021, IEEE Transactions on Intelligent Transportation Systems.

[172]  Keisuke Yoneda,et al.  Improving localization accuracy for autonomous driving in snow-rain environments , 2016, 2016 IEEE/SICE International Symposium on System Integration (SII).

[173]  Dinesh Manocha,et al.  AutonoVi-Sim: Autonomous Vehicle Simulation Platform with Weather, Sensing, and Traffic Control , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[174]  Seiichi Mita,et al.  Object Tracking and Classification Using Millimeter-Wave Radar Based on LSTM , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[175]  Juan-Carlos Cano,et al.  V2X-d: A vehicular density estimation system that combines V2V and V2I communications , 2013, 2013 IFIP Wireless Days (WD).

[176]  Yong Gu Ji,et al.  Investigating the Importance of Trust on Adopting an Autonomous Vehicle , 2015, Int. J. Hum. Comput. Interact..

[177]  Mohinder Malhotra.  Single Image Haze Removal Using Dark Channel Prior , 2016 .

[178]  Kevin E. Trenberth,et al.  How Often Does It Really Rain , 2017 .

[179]  Zhensen Wu,et al.  Analytic Specific Attenuation Model for Rain for Use in Prediction Methods , 2001 .

[180]  S. Nayar,et al.  Interactive ( De ) Weathering of an Image using Physical Models ∗ , 2003 .

[181]  Ioan Silea,et al.  Laser and LIDAR in a System for Visibility Distance Estimation in Fog Conditions , 2020, Sensors.

[182]  Yang Liu,et al.  Auto-Exposure Fusion for Single-Image Shadow Removal , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[183]  G. Buller,et al.  Robust real-time 3D imaging of moving scenes through atmospheric obscurant using single-photon LiDAR , 2021, Scientific Reports.

[184]  C. Ruf,et al.  Characterization of rain impact on L-Band GNSS-R ocean surface measurements , 2020 .

[185]  Mahesh M Dhananjaya,et al.  Weather and Light Level Classification for Autonomous Driving: Dataset, Baseline and Active Learning , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[186]  Claude E. Shannon,et al.  Recent Contributions to The Mathematical Theory of Communication , 2009 .

[187]  H. Takada.  Antifrost system of windshield , 1989 .

[188]  Philip J. Sallis,et al.  Weather Detection in Vehicles by Means of Camera and LIDAR Systems , 2014, 2014 Sixth International Conference on Computational Intelligence, Communication Systems and Networks.

[189]  H. González-Jorge,et al.  Quantifying the influence of rain in LiDAR performance , 2017 .

[190]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[191]  Olegas Prentkovskis,et al.  Identification of Road-Surface Type Using Deep Neural Networks for Friction Coefficient Estimation , 2020, Sensors.

[192]  Yi Yang,et al.  Removing Raindrops and Rain Streaks in One Go , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[193]  Keisuke Yoneda,et al.  Robust Intensity-Based Localization Method for Autonomous Driving on Snow–Wet Road Surface , 2017, IEEE Transactions on Industrial Informatics.

[194]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[195]  Feiyue Huang,et al.  Learning to Restore Hazy Video: A New Real-World Dataset and A New Method , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[196]  Luxin Yan,et al.  Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translation , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[197]  H. T. Mouftah,et al.  Provisioning Road Weather Management using Edge Cloud and Connected and Autonomous Vehicles , 2021, 2021 International Wireless Communications and Mobile Computing (IWCMC).

[198]  Ahmed M. Elgammal,et al.  Weather classification with deep convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[199]  N. Nishizawa,et al.  Characteristics of Spectral Peaking in Coherent Supercontinuum Generation , 2021, 2021 Conference on Lasers and Electro-Optics (CLEO).

[200]  Luis Magdalena,et al.  A Color Vision-Based Lane Tracking System for Autonomous Driving on Unmarked Roads , 2004, Auton. Robots.

[201]  Wolfram Burgard,et al.  HeatNet: Bridging the Day-Night Domain Gap in Semantic Segmentation with Thermal Images , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[202]  Heidrun Belzner,et al.  Image based fog detection in vehicles , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[203]  Ryo Yanase,et al.  Automated driving recognition technologies for adverse weather conditions , 2019 .

[204]  Wolfram Burgard,et al.  Robust visual SLAM across seasons , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[205]  Paul Newman,et al.  1 year, 1000 km: The Oxford RobotCar dataset , 2017, Int. J. Robotics Res..

[206]  Mial E Warren,et al.  Automotive LIDAR Technology , 2019, 2019 Symposium on VLSI Circuits.

[207]  Oliver Bringmann,et al.  Simulating Photo-realistic Snow and Fog on Existing Images for Enhanced CNN Training and Evaluation , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[208]  Stefan Gehrig,et al.  Dead reckoning and cartography using stereo vision for an autonomous car , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[209]  James J. Little,et al.  The Raincouver Scene Parsing Benchmark for Self-Driving in Adverse Weather and at Night , 2017, IEEE Robotics and Automation Letters.

[210]  Takeyoshi Imai.  Legal regulation of autonomous driving technology: Current conditions and issues in Japan , 2019 .

[211]  Alexander Carballo,et al.  A Survey of Autonomous Driving: Common Practices and Emerging Technologies , 2019, IEEE Access.

[212]  Krishna Reddy Konda,et al.  Real-time fog visibility range estimation for autonomous driving applications , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[213]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[214]  Sebastien Glaser,et al.  Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving , 2017, IEEE Transactions on Intelligent Vehicles.

[215]  Christoph Stiller,et al.  Automated Driving , 2015, Autom..

[216]  Vijay John,et al.  Deep Visible and Thermal Camera-based Optimal Semantic Segmentation using Semantic Forecasting , 2021, Journal of Autonomous Vehicles and Systems.

[217]  Werner Ritter,et al.  A Benchmark for Spray from Nearby Cutting Vehicles , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[218]  Chiara Bartolozzi,et al.  Event-Based Vision: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[219]  Boris Buschardt,et al.  Weather Classification Using an Automotive LIDAR Sensor Based on Detections on Asphalt and Atmosphere , 2020, Sensors.

[220]  Dudley A. Williams,et al.  Optical properties of water in the near infrared. , 1974 .

[221]  Mohamed Ali Kaafar,et al.  The Impact of Adverse Weather Conditions on Autonomous Vehicles: How Rain, Snow, Fog, and Hail Affect the Performance of a Self-Driving Car , 2019, IEEE Vehicular Technology Magazine.

[222]  Ramanarayan Vasudevan,et al.  Windshield wipers on connected vehicles produce high-accuracy rainfall maps , 2019, Scientific Reports.

[223]  Murat Torlak,et al.  Automotive Radars: A review of signal processing techniques , 2017, IEEE Signal Processing Magazine.

[224]  Bernardo Wagner,et al.  Fusing LiDAR and Radar Data to Perform SLAM in Harsh Environments , 2016, ICINCO.

[225]  Isaac I. Kim,et al.  Comparison of laser beam propagation at 785 nm and 1550 nm in fog and haze for optical wireless communications , 2001, SPIE Optics East.

[226]  Richard L. Wood,et al.  LiDAR Scanning with Supplementary UAV Captured Images for Structural Inspections , 2015 .

[227]  Rachid Belaroussi,et al.  Impact of reduced visibility from fog on traffic sign detection , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[228]  Senthil Yogamani,et al.  SoilingNet: Soiling Detection on Automotive Surround-View Cameras , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[229]  Viola Cavallo,et al.  Measuring the effect of the rainfall on the windshield in terms of visual performance. , 2014, Accident; analysis and prevention.

[230]  T. Brandmeier,et al.  Towards Safe Autonomous Driving: Challenges of Pedestrian Detection in Rain with Automotive Radar , 2021, 2020 17th European Radar Conference (EuRAD).

[231]  Bernardo Wagner,et al.  Radar and LiDAR Sensorfusion in Low Visibility Environments , 2016, ICINCO.

[232]  Xudong Jiang,et al.  Single Image Reflection Removal with Absorption Effect , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[233]  Tobi Delbrück,et al.  DDD17: End-To-End DAVIS Driving Dataset , 2017, ArXiv.

[234]  Zabih Ghassemlooy,et al.  Analysis of fog and smoke attenuation in a free space optical communication link under controlled laboratory conditions , 2012, 2012 International Workshop on Optical Wireless Communications (IWOW).

[235]  A. T. Young.  Inferior mirages: an improved model. , 2015, Applied Optics.

[236]  Wilhelm Stork,et al.  Weather Influence and Classification with Automotive Lidar Sensors , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[237]  Sergey Sergeyev,et al.  Range detection assessment of photonic radar under adverse weather perceptions , 2020 .

[238]  R. Dubayah,et al.  Rapid, High-Resolution Forest Structure and Terrain Mapping over Large Areas using Single Photon Lidar , 2016, Scientific Reports.

[239]  Chinmoy Pal,et al.  Development of a Long-Range Ultrasonic Sensor for Automotive Application , 2008 .

[240]  Kazunori Ohno,et al.  Fog removal using laser beam penetration, laser intensity, and geometrical features for 3D measurements in fog-filled room , 2016, Adv. Robotics.

[241]  S. Jebson.  Fact sheet number 3: Water in the Atmosphere , 2007 .

[242]  S. Fleck,et al.  Data driven degradation of automotive sensors and effect analysis , 2021, Electronic Imaging.

[243]  Shaopeng Ma,et al.  Image distortion of working digital camera induced by environmental temperature and camera self-heating , 2019, Optics and Lasers in Engineering.

[244]  P. Tumas,et al.  Pedestrian Detection in Severe Weather Conditions , 2020, IEEE Access.

[245]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[246]  G. R. Osche,et al.  Imaging laser radar in the near and far infrared , 1996 .

[247]  F. Zhou,et al.  Single image dehazing motivated by Retinex theory , 2013, 2013 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation (IMSNA).

[248]  Gert Kootstra,et al.  International Conference on Robotics and Automation (ICRA) , 2008, ICRA 2008.

[249]  Yunfeng Hu,et al.  Modeling and Quantitative Assessment of Environment Complexity for Autonomous Vehicles , 2020, 2020 Chinese Control And Decision Conference (CCDC).

[250]  Andre Heller,et al.  Global Localization and Position Tracking of Automatic Guided Vehicles using passive RFID Technology , 2014, ISR 2014.

[251]  Lizhuang Ma,et al.  Contrastive Learning for Compact Single Image Dehazing , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[252]  Yingfeng Cai,et al.  Robust Target Recognition and Tracking of Self-Driving Cars With Radar and Camera Information Fusion Under Severe Weather Conditions , 2021, IEEE Transactions on Intelligent Transportation Systems.

[253]  Joonki Paik,et al.  Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering , 1998 .

[254]  Sen Wang,et al.  RADIATE: A Radar Dataset for Automotive Perception in Bad Weather , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[255]  Boxin Shi,et al.  Panoramic Image Reflection Removal , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[256]  Armin Mustafa,et al.  A*3D Dataset: Towards Autonomous Driving in Challenging Environments , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[257]  Luc Van Gool,et al.  Semantic Foggy Scene Understanding with Synthetic Data , 2017, International Journal of Computer Vision.