Polarization-Based Car Detection

Road scene understanding is a vital task for driving assistance systems. Robust vehicle detection is a precondition for diverse applications particularly for obstacle avoidance and secure navigation. Color images provide limited information about the physical properties of the object. This results in unstable vehicle detection caused mainly from road scene complexity (strong reflexions, noises and radiometric distortions). Instead, polarimetric images, characteristic of the light wave, can robustly describe important physical properties of the object (e.g., the surface geometric structure, material and roughness etc). This modality gives rich physical informations which could be complementary to classical color images features. In order to improve the robustness of the vehicle detection purpose, we propose in this paper a fusion model using polarization information and color image attributes. Our method is based on a feature selection procedure to get the most informative polarization feature and color-based ones. The proposed method, based on the Deformable Part based Models (DPM), has been evaluated on our self-collected database, showing good performances and encouraging results about the use of the polarimetric modality for road scenes analysis.

[1]  Martin J How,et al.  Polarization distance: a framework for modelling object detection by polarization vision systems , 2014, Proceedings of the Royal Society B: Biological Sciences.

[2]  Arturo de la Escalera,et al.  Sensor Fusion Methodology for Vehicle Detection , 2017, IEEE Intelligent Transportation Systems Magazine.

[3]  Lawrence B. Wolff,et al.  Surface Orientation From Polarization Images , 1988, Other Conferences.

[4]  Song-Chun Zhu,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Learning And-or Model to Represent Context and Occlusion for Car Detection and Viewpoint Estimation , 2022 .

[5]  Thierry Chateau,et al.  Deep MANTA: A Coarse-to-Fine Many-Task Network for Joint 2D and 3D Vehicle Analysis from Monocular Image , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[7]  M. E. Cox Handbook of Optics , 1980 .

[8]  Fabrice Meriaudeau,et al.  Polarization imaging applied to 3D reconstruction of specular metallic surfaces , 2005, IS&T/SPIE Electronic Imaging.

[9]  M. Schmid Principles Of Optics Electromagnetic Theory Of Propagation Interference And Diffraction Of Light , 2016 .

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Tong Boon Tang,et al.  Vehicle Detection Techniques for Collision Avoidance Systems: A Review , 2015, IEEE Transactions on Intelligent Transportation Systems.

[12]  David Fofi,et al.  Adaptive processing of catadioptric images using polarization imaging: towards a pola-catadioptric model , 2013 .

[13]  Fabrice Mériaudeau,et al.  Optimization of a polarization imaging system for 3D measurements of transparent objects. , 2009, Optics express.

[14]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  David Fofi,et al.  Calibration of Catadioptric Sensors by Polarization Imaging , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Fan Wang,et al.  Polarization-based specularity removal method with global energy minimization , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[18]  Lawrence B. Wolff,et al.  Polarization vision: a new sensory approach to image understanding , 1997, Image Vis. Comput..

[19]  Lawrence B. Wolff,et al.  Polarization-Based Material Classification from Specular Reflection , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..