LSTM-based System for Multiple Obstacle Detection using Ultra-wide Band Radar

Autonomous vehicles present a promising opportunity in the future of transportation systems by providing road safety. As significant progress has been made in the automatic environment perception, the detection of road obstacles remains a major challenge. Thus, to achieve reliable obstacle detection, several sensors have been employed. For short ranges, the Ultra-Wide Band (UWB) radar is utilized in order to detect objects in the near field. However, the main challenge appears in distinguishing the real target’s signature from noise in the received UWB signals. In this paper, we propose a novel framework that exploits Recurrent Neural Networks (RNNs) with UWB signals for multiple road obstacle detection. Features are extracted from the time-frequency domain using the discrete wavelet transform and are forwarded to the Long short-term memory (LSTM) network. We evaluate our approach on the OLIMP dataset which includes various driving situations with complex environment and targets from several classes. The obtained results show that the LSTM-based system outperforms the other implemented related techniques in terms of obstacle detection.

[1]  Debalina Ghosh,et al.  Human Activity Classification Based On Breathing Patterns Using IR-UWB Radar , 2019, 2019 IEEE 16th India Council International Conference (INDICON).

[2]  R.S. Thoma,et al.  UWB short-range radar sensing - The architecture of a baseband, pseudo-noise UWB radar sensor , 2007, IEEE Instrumentation & Measurement Magazine.

[3]  Jingjing Wu,et al.  A Robust PDR/UWB Integrated Indoor Localization Approach for Pedestrians in Harsh Environments , 2019, Sensors.

[4]  Med Salim Bouhlel,et al.  A novel hybrid bidirectional unidirectional LSTM network for dynamic hand gesture recognition with Leap Motion , 2020, Entertain. Comput..

[5]  Imen Jegham,et al.  Deep CNN-based Pedestrian Detection for Intelligent Infrastructure , 2020, 2020 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[6]  Jerry M. Mendel,et al.  Tutorial on higher-order statistics (spectra) in signal processing and system theory: theoretical results and some applications , 1991, Proc. IEEE.

[7]  Jae-Young Pyun,et al.  Location Detection and Tracking of Moving Targets by a 2D IR-UWB Radar System , 2015, Sensors.

[8]  Martin Weiß,et al.  An improvement of the convergence proof of the ADAM-Optimizer , 2018, ArXiv.

[9]  Shuai Chen,et al.  UWB NLOS/LOS Classification Using Deep Learning Method , 2020, IEEE Communications Letters.

[10]  Sung Ho Cho,et al.  A New Thresholding Method for IR-UWB Radar-Based Detection Applications † , 2020, Sensors.

[11]  Youyun Xu,et al.  UWB Propagation Measurements and Modelling in Large Indoor Environments , 2019, IEEE Access.

[12]  Dong Seog Han,et al.  UWB Indoor Localization Using Deep Learning LSTM Networks , 2020, Applied Sciences.

[13]  L. Sakkila,et al.  UWB Radar system for road anti-collision application , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[14]  Atika Rivenq,et al.  A novel multi-view pedestrian detection database for collaborative Intelligent Transportation Systems , 2020, Future Gener. Comput. Syst..

[15]  Imen Jegham,et al.  Hand-Crafted Features vs Deep Learning for Pedestrian Detection in Moving Camera , 2020, Traitement du Signal.

[16]  E. Šabanovič,et al.  Autonomous road vehicles: recent issues and expectations , 2020, IET Intelligent Transport Systems.

[17]  Sung Ho Cho,et al.  People Counting Based on an IR-UWB Radar Sensor , 2017, IEEE Sensors Journal.

[18]  Hermann Rohling,et al.  Radar CFAR Thresholding in Clutter and Multiple Target Situations , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[19]  Dae-Hyun Kim Lane Detection Method with Impulse Radio Ultra-Wideband Radar and Metal Lane Reflectors , 2020, Sensors.

[20]  Xiaotao Huang,et al.  Low PRF Low Frequency Radar Sensor for Fall Detection by Using Deep Learning , 2019, 2019 IEEE 4th International Conference on Signal and Image Processing (ICSIP).

[21]  Imen Jegham,et al.  Safe Driving : Driver Action Recognition using SURF Keypoints , 2018, 2018 30th International Conference on Microelectronics (ICM).

[22]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[23]  Abdelmalik Taleb-Ahmed,et al.  OLIMP: A Heterogeneous Multimodal Dataset for Advanced Environment Perception , 2020, Electronics.

[24]  Sébastien Gaboury,et al.  Recognizing activities of daily living from UWB radars and deep learning , 2021, Expert Syst. Appl..

[25]  Doojin Lee,et al.  Imaging of Human Walking Behind the Obstacle Utilizing Pulsed Radar Technique in the C-Band for Military Surveillance Applications , 2020, Journal of Electrical Engineering & Technology.

[26]  Subhas Chandra Mukhopadhyay,et al.  SleepPoseNet: Multi-View Learning for Sleep Postural Transition Recognition Using UWB , 2020, IEEE Journal of Biomedical and Health Informatics.

[27]  Yassin Elhillali,et al.  A Real Time Signal Processing for an Anticollision Road Radar System , 2006, IEEE Vehicular Technology Conference.

[28]  Sung Ho Cho,et al.  Hand Gesture Recognition Using an IR-UWB Radar with an Inception Module-Based Classifier , 2020, Sensors.

[29]  Sreeraman Rajan,et al.  On the Use of Ultra Wideband Radar and Stacked LSTM-RNN for at Home Fall Detection , 2018, 2018 IEEE Life Sciences Conference (LSC).

[30]  Shefeng Yan,et al.  Some Analysis of Fuzzy CAGO/SO CFAR Detector in Non-Gaussian Background , 2010, 2010 2nd International Workshop on Intelligent Systems and Applications.

[31]  Jelena Kocić,et al.  Sensors and Sensor Fusion in Autonomous Vehicles , 2018, 2018 26th Telecommunications Forum (TELFOR).

[32]  Marco Lops,et al.  Performance analysis of CA-CFAR in the presence of compound Gaussian clutter , 1988 .

[33]  H. Harada,et al.  Development of band pass filter for ultra wideband (UWB) communication systems , 2003, IEEE Conference on Ultra Wideband Systems and Technologies, 2003.

[34]  Atika Rivenq,et al.  UWB radar recognition system based on HOS and SVMs , 2018 .

[35]  Byung-Tak Lee,et al.  Object classification of UWB responses using S T-CNN , 2016, 2016 International Conference on Information and Communication Technology Convergence (ICTC).

[36]  Bin Yang,et al.  High-Performance Automotive Radar: A review of signal processing algorithms and modulation schemes , 2019, IEEE Signal Processing Magazine.

[37]  S. Blake OS-CFAR theory for multiple targets and nonuniform clutter , 1988 .

[38]  Jaehoon Jung,et al.  Deep Neural Network-Based In-Vehicle People Localization Using Ultra-Wideband Radar , 2020, IEEE Access.