A Vision-Based Driver Nighttime Assistance and Surveillance System Based on Intelligent Image Sensing Techniques and a Heterogamous Dual-Core Embedded System Architecture

This study proposes a vision-based intelligent nighttime driver assistance and surveillance system (VIDASS system) implemented by a set of embedded software components and modules, and integrates these modules to accomplish a component-based system framework on an embedded heterogamous dual-core platform. Therefore, this study develops and implements computer vision and sensing techniques of nighttime vehicle detection, collision warning determination, and traffic event recording. The proposed system processes the road-scene frames in front of the host car captured from CCD sensors mounted on the host vehicle. These vision-based sensing and processing technologies are integrated and implemented on an ARM-DSP heterogamous dual-core embedded platform. Peripheral devices, including image grabbing devices, communication modules, and other in-vehicle control devices, are also integrated to form an in-vehicle-embedded vision-based nighttime driver assistance and surveillance system.

[1]  L. Davis,et al.  Real-time multiple vehicle detection and tracking from a moving vehicle , 2000, Machine Vision and Applications.

[2]  Bing-Fei Wu,et al.  A Discriminant Analysis Based Recursive Automatic Thresholding Approach for Image Segmentation , 2005, IEICE Trans. Inf. Syst..

[3]  Peter H. A. Sneath,et al.  Numerical Taxonomy: The Principles and Practice of Numerical Classification , 1973 .

[4]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[5]  Touradj Ebrahimi,et al.  Christopoulos: Thc Jpeg2000 Still Image Coding System: an Overview the Jpeg2000 Still Image Coding System: an Overview , 2022 .

[6]  Li-Chen Fu,et al.  A Portable Vision-Based Real-Time Lane Departure Warning System: Day and Night , 2009, IEEE Transactions on Vehicular Technology.

[7]  R. Danescu,et al.  High accuracy stereo vision system for far distance obstacle detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[8]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Luis Rueda.  An Efficient Algorithm for Optimal Multilevel Thresholding of Irregularly Sampled Histograms , 2008, SSPR/SPR.

[10]  Hiroshi Murase,et al.  DETECTION OF RAINDROPS ON A WINDSHIELD FROM AN IN-VEHICLE VIDEO CAMERA , 2007 .

[11]  K. Shadan,et al.  Available online: , 2012 .

[12]  Amnon Shashua,et al.  Vision-based ACC with a single camera: bounds on range and range rate accuracy , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[13]  Tieniu Tan,et al.  A real-time object detecting and tracking system for outdoor night surveillance , 2008, Pattern Recognit..

[14]  Bao Rong Chang,et al.  Vehicle collision avoidance system using embedded hybrid intelligent prediction based on vision/GPS sensing , 2009 .

[15]  Li-Chen Fu,et al.  CMOS Image Sensor with a Built-in Lane Detector , 2009, Sensors.

[16]  Aurelio Piazzi,et al.  Visual perception of obstacles and vehicles for platooning , 2000, IEEE Trans. Intell. Transp. Syst..

[17]  Kenji Suzuki,et al.  Linear-time connected-component labeling based on sequential local operations , 2003, Comput. Vis. Image Underst..

[18]  Hanbyeog Cho,et al.  Smart Roadside System for Driver Assistance and Safety Warnings: Framework and Applications , 2010, 2010 Proceedings of the 5th International Conference on Ubiquitous Information Technologies and Applications.

[19]  David S. Taubman,et al.  High performance scalable image compression with EBCOT. , 2000, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[20]  Toby P. Breckon,et al.  Real-time video analysis for vehicle lights detection using temporal information , 2007, IET 4th European Conference on Visual Media Production (CVMP 2007).

[21]  Edward Jones,et al.  Rear-Lamp Vehicle Detection and Tracking in Low-Exposure Color Video for Night Conditions , 2010, IEEE Transactions on Intelligent Transportation Systems.

[22]  Bing-Fei Wu,et al.  A multi-plane approach for text segmentation of complex document images , 2009, Pattern Recognit..

[23]  C..  Vision-based Vehicle Guidance , 1992, Springer Series in Perception Engineering.

[24]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[25]  Hiroshi Murase,et al.  Improvement of a Traffic Sign Detector by Retrospective Gathering of Training Samples from In-Vehicle Camera Image Sequences , 2010, ACCV Workshops.

[26]  Shipeng Li,et al.  Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding , 2000, IEEE Trans. Circuits Syst. Video Technol..

[27]  Gianni Conte,et al.  Automatic Vehicle Guidance: the Experience of the ARGO Autonomous Vehicle , 1999 .

[28]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[29]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[30]  Alioune Ngom,et al.  Efficient Optimal Multi-level Thresholding for Biofilm Image Segmentation , 2009, PRIB.

[31]  Fernando García,et al.  Identifying and Tracking Pedestrians Based on Sensor Fusion and Motion Stability Predictions , 2010, Sensors.

[32]  스탬 조지프에스.,et al.  Image processig syste to control vehicle haedlamps or other vehicle equipment , 2002 .

[33]  Bing-Fei Wu,et al.  A new fast approach of single-pass perceptual embedded zero-tree coding , 2011 .

[34]  Bing-Fei Wu,et al.  Dynamic Calibration and Occlusion Handling Algorithms for Lane Tracking , 2009, IEEE Transactions on Industrial Electronics.

[35]  Shyan-Ming Yuan,et al.  Vision-Based Finger Detection, Tracking, and Event Identification Techniques for Multi-Touch Sensing and Display Systems , 2011, Sensors.