Object Tracking and Classification Using Millimeter-Wave Radar Based on LSTM

All-weather sensors are necessary to realize automated driving level 3 or more, one of which is a millimeter-wave radar. However, the radar has some issues such as low space resolution and noisy signal. In order to solve them, stochastic processing is necessary such as deep learning techniques. In this research, classification and tracking of target objects were tried by applying LSTM (Long Short Term Memory) which can treat time-series data. Reflection signals from the 76GHz radar for randomly moving objects which are cars, bicycles and pedestrians in the parking lot were measured, and they were tracked and classified by the classifier applying LSTM. Three types of input feature amount for the four and three-class classifiers with two types of LSTM were evaluated and compared. Then, the best algorithm and combination achieved high accuracy of 98.67% as the results. Furthermore, the classifier was evaluated by the dataset measured on the actual public road, and then no misclassification was occurred for crossing pedestrians at the signalized intersection. This indicates high generalization ability of this classifier.

[1]  Jiawei Huang,et al.  A State Machine-based Multi-Vehicle Tracking Framework with Dual-Range Radars , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[2]  H. H. Meinel Automotive Millimeter-wave Radar , 1998 .

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Yoshikazu Asano,et al.  Estimation of Received Signal Characteristics for Millimeter Wave Car Radar (Special Issue on Millimeter-wave Short-range Application Systems Technology) , 1996 .

[5]  Katsuyuki Ohguchi,et al.  79 GHz-Band High-Resolution Millimeter-Wave Radar , 2015 .

[6]  Cheng Wu,et al.  Millimeter Wave Radar Target Tracking Based on Adaptive Kalman Filter , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[7]  H. González-Jorge,et al.  Quantifying the influence of rain in LiDAR performance , 2017 .

[8]  Cheng Xiang Automotive Millimeter-wave Radar with Antenna Switching , 2007 .

[9]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[10]  Adam Forsgren,et al.  Radar-detection based classification of moving objects using machine learning methods , 2015 .

[11]  Y Miyake,et al.  AUTOMOTIVE RADAR WITH HIGH-RESOLUTION ALGORITHM , 2006 .

[12]  Hidetoshi Furukawa,et al.  Deep Learning for End-to-End Automatic Target Recognition from Synthetic Aperture Radar Imagery , 2018, ArXiv.

[13]  Marcel Hoffmann,et al.  Pedestrian Classification for 79 GHz Automotive Radar Systems , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).