A Comparison of FPGA and GPGPU Designs for Bayesian Occupancy Filters

Grid-based perception techniques in the automotive sector based on fusing information from different sensors and their robust perceptions of the environment are proliferating in the industry. However, one of the main drawbacks of these techniques is the traditionally prohibitive, high computing performance that is required for embedded automotive systems. In this work, the capabilities of new computing architectures that embed these algorithms are assessed in a real car. The paper compares two ad hoc optimized designs of the Bayesian Occupancy Filter; one for General Purpose Graphics Processing Unit (GPGPU) and the other for Field-Programmable Gate Array (FPGA). The resulting implementations are compared in terms of development effort, accuracy and performance, using datasets from a realistic simulator and from a real automated vehicle.

[1]  Hans P. Moravec Sensor Fusion in Certainty Grids for Mobile Robots , 1988, AI Mag..

[2]  Amnon Shashua,et al.  A Computer Vision System on a Chip: a case study from the automotive domain , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Manuel Yguel,et al.  Efficient GPU-based Construction of Occupancy Grids Using several Laser Range-finders , 2008 .

[5]  Christian Laugier,et al.  Bayesian Occupancy Filtering for Multitarget Tracking: An Automotive Application , 2006, Int. J. Robotics Res..

[6]  Christian Laugier,et al.  Bayesian Occupancy Filter based "Fast Clustering-Tracking" algorithm , 2008 .

[7]  Ulrich Brunsmann,et al.  FPGA-GPU architecture for kernel SVM pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[8]  Dominique Lavenier,et al.  A Reconfigurable Disparity Engine for Stereovision in Advanced Driver Assistance Systems , 2010, ARC.

[9]  Darius Burschka,et al.  Efficient occupancy grid computation on the GPU with lidar and radar for road boundary detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[10]  S. Bauer,et al.  FPGA Implementation of a HOG-based Pedestrian Recognition System , 2010 .

[11]  Mathias Perrollaz,et al.  Computing occupancy grids from multiple sensors using linear opinion pools , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Xiangjing An,et al.  Real-time lane departure warning system based on a single FPGA , 2013, EURASIP J. Image Video Process..

[13]  Cheng Xu,et al.  GPU and CPU Cooperative Accelerated Road Detection , 2013 .

[14]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[15]  Kamel Besbes,et al.  Efficient algorithm for automatic road sign recognition and its hardware implementation , 2013, Journal of Real-Time Image Processing.

[16]  Christophe Bobda,et al.  A hardware/software prototyping system for driving assistance investigations , 2016, Journal of Real-Time Image Processing.

[17]  Mathias Perrollaz,et al.  A Robust Motion Detection Technique for Dynamic Environment Monitoring: A Framework for Grid-Based Monitoring of the Dynamic Environment , 2014, IEEE Robotics & Automation Magazine.

[18]  Jiun-In Guo,et al.  A forward collision avoidance system adopting multi-feature vehicle detection , 2014, 2014 IEEE International Conference on Consumer Electronics - Taiwan.

[19]  Max Grossman,et al.  Professional CUDA C Programming , 2014 .

[20]  Guangzhi Qu,et al.  Deploying and Scheduling Vision Based Advanced Driver Assistance Systems (ADAS) on Heterogeneous Multicore Embedded Platform , 2015, 2015 Ninth International Conference on Frontier of Computer Science and Technology.

[21]  Yunju Baek,et al.  Design and Implementation of Real-Time Vehicular Camera for Driver Assistance and Traffic Congestion Estimation , 2015, Sensors.

[22]  Lingjiang Kong,et al.  Vision-based multi-scaled vehicle detection and distance relevant mix tracking for driver assistance system , 2015 .

[23]  Shyan-Ming Yuan,et al.  Real-time pedestrian detection technique for embedded driver assistance systems , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[24]  David Johnson,et al.  Radar Sensing for Intelligent Vehicles in Urban Environments , 2015, Sensors.

[25]  Michael Hübner,et al.  FPGA based traffic sign detection for automotive camera systems , 2015, 2015 10th International Symposium on Reconfigurable Communication-centric Systems-on-Chip (ReCoSoC).

[26]  Christian Laugier,et al.  Real-time power-efficient integration of multi-sensor occupancy grid on many-core , 2015, 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO).

[27]  Lukas Rummelhard,et al.  Intelligent Vehicle Perception: Toward the Integration on Embedded Many-core , 2015, PARMA-DITAM '15.

[28]  Sebastien Glaser,et al.  PerSEE: A central sensors fusion electronic control unit for the development of perception-based ADAS , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[29]  Christoph Stiller,et al.  The Role of Machine Vision for Intelligent Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[30]  Christian Laugier,et al.  Multi-sensor fusion of occupancy grids based on integer arithmetic , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Jorge Villagra,et al.  Footprint-based classification of road moving objects using occupancy grids , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[32]  Antonio Martínez-Álvarez,et al.  A Review of the Bayesian Occupancy Filter , 2017, Sensors.

[33]  Oihana Otaegui,et al.  Embedding vision-based advanced driver assistance systems: a survey , 2017 .