Spiking Neural Network for Fourier Transform and Object Detection for Automotive Radar

The development of advanced autonomous driving applications is hindered by the complex temporal structure of sensory data, as well as by the limited computational and energy resources of their on-board systems. Currently, neuromorphic engineering is a rapidly growing field that aims to design information processing systems similar to the human brain by leveraging novel algorithms based on spiking neural networks (SNNs). These systems are well-suited to recognize temporal patterns in data while maintaining a low energy consumption and offering highly parallel architectures for fast computation. However, the lack of effective algorithms for SNNs impedes their wide usage in mobile robot applications. This paper addresses the problem of radar signal processing by introducing a novel SNN that substitutes the discrete Fourier transform and constant false-alarm rate algorithm for raw radar data, where the weights and architecture of the SNN are derived from the original algorithms. We demonstrate that our proposed SNN can achieve competitive results compared to that of the original algorithms in simulated driving scenarios while retaining its spike-based nature.

[1]  Yang Liu,et al.  Target detection in remote sensing image based on saliency computation of spiking neural network , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Samir Tamer,et al.  Target Detection , 2009, Encyclopedia of Biometrics.

[3]  Xu Wang,et al.  Spiking neural network-based target tracking control for autonomous mobile robots , 2015, Neural Computing and Applications.

[4]  Xinwei Cao,et al.  Control framework for cooperative robots in smart home using bio-inspired neural network , 2021 .

[5]  Csaba Petre,et al.  Unsupervised Learning from Continuous Video in a Scalable Predictive Recurrent Network , 2016, ArXiv.

[6]  Shih-Chii Liu,et al.  Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification , 2017, Front. Neurosci..

[7]  Patrice Pajusco,et al.  RCS modeling and measurements for automotive radar applications in the W band , 2017, 2017 11th European Conference on Antennas and Propagation (EUCAP).

[8]  Alois Knoll,et al.  Indirect and direct training of spiking neural networks for end-to-end control of a lane-keeping vehicle , 2020, Neural Networks.

[9]  Piotr Indyk,et al.  Recent Developments in the Sparse Fourier Transform: A compressed Fourier transform for big data , 2014, IEEE Signal Processing Magazine.

[10]  Lingjia Tang,et al.  The Architectural Implications of Autonomous Driving: Constraints and Acceleration , 2018, ASPLOS.

[11]  Murat Torlak,et al.  Automotive Radars: A review of signal processing techniques , 2017, IEEE Signal Processing Magazine.

[12]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[13]  Matthias Kronauge,et al.  Fast Two-Dimensional CFAR Procedure , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Mark C. Hersam,et al.  Neuromorphic nanoelectronic materials , 2020, Nature Nanotechnology.

[15]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[16]  Kirk Y. W. Scheper,et al.  Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  T. Zwick,et al.  Millimeter-Wave Technology for Automotive Radar Sensors in the 77 GHz Frequency Band , 2012, IEEE Transactions on Microwave Theory and Techniques.

[18]  Zhanpeng Jin,et al.  Temporal Pulses Driven Spiking Neural Network for Time and Power Efficient Object Recognition in Autonomous Driving , 2021, 2020 25th International Conference on Pattern Recognition (ICPR).

[19]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[20]  Andrew McCallum,et al.  Energy and Policy Considerations for Deep Learning in NLP , 2019, ACL.

[21]  Hermann Winner,et al.  Handbook of Driver Assistance Systems , 2014 .

[22]  A. Khan,et al.  Obstacle avoidance and model‐free tracking control for home automation using bio‐inspired approach , 2021, Advanced Control for Applications.

[23]  Shobha Sundar Ram,et al.  Radar cross-sections of pedestrians at automotive radar frequencies using ray tracing and point scatterer modelling , 2020 .

[24]  Hermann Rohling,et al.  Radar CFAR Thresholding in Clutter and Multiple Target Situations , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[25]  Edith Beigné,et al.  Spiking Neural Networks Hardware Implementations and Challenges , 2019, ACM J. Emerg. Technol. Comput. Syst..

[26]  Michael Schmitt,et al.  On the Complexity of Learning for Spiking Neurons with Temporal Coding , 1999, Inf. Comput..

[27]  Elena Cerezuela-Escudero,et al.  A Binaural Neuromorphic Auditory Sensor for FPGA: A Spike Signal Processing Approach , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[28]  L. B. Larsen,et al.  Event-based PID controller fully realized in neuromorphic hardware: a one DoF study , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[29]  Raúl Rojas.  The Complexity of Learning , 1996 .

[30]  Daniel Auge,et al.  Resonate-and-Fire Neurons as Frequency Selective Input Encoders for Spiking Neural Networks , 2020 .

[31]  Alan D George,et al.  A Neuro-inspired Approach to Intelligent Collision Avoidance and Navigation , 2020, 2020 AIAA/IEEE 39th Digital Avionics Systems Conference (DASC).

[32]  Steven G. Johnson,et al.  The Design and Implementation of FFTW3 , 2005, Proceedings of the IEEE.