A Novel Multi-Sensor Environmental Perception Method Using Low-Rank Representation and a Particle Filter for Vehicle Reversing Safety

Environmental perception and information processing are two key steps of active safety for vehicle reversing. Single-sensor environmental perception cannot meet the need for vehicle reversing safety due to its low reliability. In this paper, we present a novel multi-sensor environmental perception method using low-rank representation and a particle filter for vehicle reversing safety. The proposed system consists of four main steps, namely multi-sensor environmental perception, information fusion, target recognition and tracking using low-rank representation and a particle filter, and vehicle reversing speed control modules. First of all, the multi-sensor environmental perception module, based on a binocular-camera system and ultrasonic range finders, obtains the distance data for obstacles behind the vehicle when the vehicle is reversing. Secondly, the information fusion algorithm using an adaptive Kalman filter is used to process the data obtained with the multi-sensor environmental perception module, which greatly improves the robustness of the sensors. Then the framework of a particle filter and low-rank representation is used to track the main obstacles. The low-rank representation is used to optimize an objective particle template that has the smallest L-1 norm. Finally, the electronic throttle opening and automatic braking is under control of the proposed vehicle reversing control strategy prior to any potential collisions, making the reversing control safer and more reliable. The final system simulation and practical testing results demonstrate the validity of the proposed multi-sensor environmental perception method using low-rank representation and a particle filter for vehicle reversing safety.

[1]  Li Bai,et al.  Minimum error bounded efficient ℓ1 tracker with occlusion detection , 2011, CVPR 2011.

[2]  Bart Kosko,et al.  Adaptive fuzzy systems for backing up a truck-and-trailer , 1992, IEEE Trans. Neural Networks.

[3]  K. Wright Research notes , 2003, Nature Biotechnology.

[4]  S. Sankarasrinivasan,et al.  Robust target tracking algorithm for MAV navigation system , 2015, 2015 International Conference on Industrial Instrumentation and Control (ICIC).

[5]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[6]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[7]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[9]  Bo Wang,et al.  Rapid target recognition and tracking under large scale variation using Semi-Naive Bayesian , 2010, Proceedings of the 29th Chinese Control Conference.

[10]  徐梦溪,et al.  Network video monitoring system based on OpenCV (open source computer vision library) , 2011 .

[11]  Dong-Sun Kim,et al.  Moving Object Detection on a Vehicle Mounted Back-Up Camera , 2015, Sensors.

[12]  Sang Hun Lee,et al.  Human-Automation Interaction Design for Adaptive Cruise Control Systems of Ground Vehicles , 2015, Sensors.

[13]  Li Bai,et al.  A Sensor Fusion Framework Using Multiple Particle Filters for Video-Based Navigation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[14]  Ming-Shi Wang,et al.  A Vision Based Top-View Transformation Model for a Vehicle Parking Assistant , 2012, Sensors.

[15]  C. Laurgeau,et al.  Vehicle detection combining gradient analysis and AdaBoost classification , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[16]  Marinus Maris,et al.  A multi-agent systems approach to distributed bayesian information fusion , 2010, Inf. Fusion.

[17]  Xuqiang Zhao,et al.  Vision based ground target tracking for rotor UAV , 2013, 2013 10th IEEE International Conference on Control and Automation (ICCA).

[18]  Amaury Nègre,et al.  Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving Safety , 2011, IEEE Intelligent Transportation Systems Magazine.

[19]  Wei Zhang,et al.  An Algorithm of Feather and Down Target Detection and Tracking Method Based on Sparse Representation , 2015, 2015 Seventh International Conference on Measuring Technology and Mechatronics Automation.

[20]  Syed Talha Ali Hamdani,et al.  The Application of a Piezo-Resistive Cardiorespiratory Sensor System in an Automobile Safety Belt , 2015, Sensors.

[21]  Antonio Barrientos,et al.  Human Detection from a Mobile Robot Using Fusion of Laser and Vision Information , 2013, Sensors.

[22]  Jorge L. Martínez,et al.  Driver Assistance System for Passive Multi-Trailer Vehicles with Haptic Steering Limitations on the Leading Unit , 2013, Sensors.

[23]  Jian Xu,et al.  A Vehicle Active Safety Model: Vehicle Speed Control Based on Driver Vigilance Detection Using Wearable EEG and Sparse Representation , 2016, Sensors.

[24]  Zu Tao Zhang,et al.  A Novel Vehicle Speed Control Based on Driver’s Vigilance Detection Using EEG and Sparse Representation , 2014 .

[25]  Yung-Cheng Chu,et al.  An Efficient Traffic Information Forwarding Solution for Vehicle Safety Communications on Highways , 2012, IEEE Transactions on Intelligent Transportation Systems.

[26]  B. Widrow,et al.  The truck backer-upper: an example of self-learning in neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[27]  Rajesh Rajamani,et al.  Model predictive control of transitional maneuvers for adaptive cruise control vehicles , 2004, IEEE Transactions on Vehicular Technology.

[28]  Kwong-Sak Leung,et al.  A genetic algorithm for determining nonadditive set functions in information fusion , 1999, Fuzzy Sets Syst..

[29]  Zhipeng Li,et al.  Multi-Sensor Based Perception Network for Vehicle Driving Assistance , 2009, 2009 2nd International Congress on Image and Signal Processing.

[30]  Kok Kiong Tan,et al.  Autonomous Reverse Parking System Based on Robust Path Generation and Improved Sliding Mode Control , 2015, IEEE Transactions on Intelligent Transportation Systems.

[31]  G. C. Nandi,et al.  Tracking of a target person using face recognition by surveillance robot , 2012, 2012 International Conference on Communication, Information & Computing Technology (ICCICT).

[32]  Xiaoyan Sun,et al.  Preceding Vehicle Detection and Tracking Adaptive to Illumination Variation in Night Traffic Scenes Based on Relevance Analysis , 2014, Sensors.

[33]  Li Bai,et al.  Robust infrared vehicle tracking across target pose change using L1 regularization , 2010, 2010 13th International Conference on Information Fusion.

[34]  Juan Antonio Cabrera Carrillo,et al.  Robust Road Condition Detection System Using In-Vehicle Standard Sensors , 2015, Sensors.

[35]  Kai-Yew Lum,et al.  Multiagent Information Fusion and Cooperative Control in Target Search , 2013, IEEE Transactions on Control Systems Technology.

[36]  Jong-Hun Lee,et al.  Stereo vision-based vehicle detection using a road feature and disparity histogram , 2011 .

[37]  M.M. Trivedi,et al.  Human Behavior Based Predictive Brake Assistance , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[38]  Jie Wen,et al.  Multi-targets recognition for surface moving platform vision system based on combined features , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[39]  W. Art Chaovalitwongse,et al.  Optimization of Spatiotemporal Clustering for Target Tracking From Multisensor Data , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[40]  M. Kumar,et al.  A Method for Judicious Fusion of Inconsistent Multiple Sensor Data , 2007, IEEE Sensors Journal.

[41]  Yuan-Hsiang Chang,et al.  A study of 3D feature tracking and localization using a stereo vision system , 2010, 2010 International Computer Symposium (ICS2010).

[42]  Keyu Lu,et al.  Vision Sensor-Based Road Detection for Field Robot Navigation , 2015, Sensors.

[43]  Yi Wang,et al.  Camshift algorithm -based moving target recognition and tracking system , 2012, 2012 IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS) Proceedings.

[44]  James A. Rodger,et al.  Toward reducing failure risk in an integrated vehicle health maintenance system: A fuzzy multi-sensor data fusion Kalman filter approach for IVHMS , 2012, Expert Syst. Appl..

[45]  Linda Ng Boyle,et al.  Drivers' Adaptation to Adaptive Cruise Control: Examination of Automatic and Manual Braking , 2012, IEEE Transactions on Intelligent Transportation Systems.

[46]  Hyung-Sup Jung,et al.  Multi-Sensor Fusion of Landsat 8 Thermal Infrared (TIR) and Panchromatic (PAN) Images , 2014, Sensors.

[47]  Hong Xu,et al.  A Novel Vehicle Reversing Speed Control Based on Obstacle Detection and Sparse Representation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[48]  Esko Keskinen,et al.  Has the difference in accident patterns between male and female drivers changed between 1984 and 2000? , 2004, Accident; analysis and prevention.

[49]  Jia Li,et al.  Probabilistic Multi-Sensor Fusion Based Indoor Positioning System on a Mobile Device , 2015, Sensors.