Design and Implementation of Real-Time Vehicular Camera for Driver Assistance and Traffic Congestion Estimation

As society has developed, the number of vehicles has increased and road conditions have become complicated, increasing the risk of crashes. Therefore, a service that provides safe vehicle control and various types of information to the driver is urgently needed. In this study, we designed and implemented a real-time traffic information system and a smart camera device for smart driver assistance systems. We selected a commercial device for the smart driver assistance systems, and applied a computer vision algorithm to perform image recognition. For application to the dynamic region of interest, dynamic frame skip methods were implemented to perform parallel processing in order to enable real-time operation. In addition, we designed and implemented a model to estimate congestion by analyzing traffic information. The performance of the proposed method was evaluated using images of a real road environment. We found that the processing time improved by 15.4 times when all the proposed methods were applied in the application. Further, we found experimentally that there was little or no change in the recognition accuracy when the proposed method was applied. Using the traffic congestion estimation model, we also found that the average error rate of the proposed model was 5.3%.

[1]  Mohan M. Trivedi,et al.  Part-Based Pedestrian Detection and Feature-Based Tracking for Driver Assistance: Real-Time, Robust Algorithms, and Evaluation , 2013, IEEE Transactions on Intelligent Transportation Systems.

[2]  Philomina Simon,et al.  Advanced Driver Assistance System , 2020, International Journal of Recent Technology and Engineering.

[3]  Jack J. Dongarra,et al.  From CUDA to OpenCL: Towards a performance-portable solution for multi-platform GPU programming , 2012, Parallel Comput..

[4]  Bernt Schiele,et al.  A Performance Evaluation of Single and Multi-feature People Detection , 2008, DAGM-Symposium.

[5]  Kosin Chamnongthai,et al.  The recognition of car license plate for automatic parking system , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Sungdae Cho,et al.  Implementation and optimization of image processing algorithms on handheld GPU , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Dan Levi,et al.  Part-Based Feature Synthesis for Human Detection , 2010, ECCV.

[9]  Joseph R. Cavallaro,et al.  Accelerating computer vision algorithms using OpenCL framework on the mobile GPU - A case study , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  S Draghici,et al.  A NEURAL NETWORK BASED ARTIFICIAL VISION SYSTEM FOR LICENSE PLATE RECOGNITION , 1997 .

[11]  Larry S. Davis,et al.  A Pose-Invariant Descriptor for Human Detection and Segmentation , 2008, ECCV.

[12]  Zhuowen Tu,et al.  Feature Mining for Image Classification , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Kari Pulli,et al.  Real-time computer vision with OpenCV , 2012, Commun. ACM.

[14]  Sorin Draghici,et al.  A Neural Network Based Artificial Vision System for Licence Plate Recognition , 1997, Int. J. Neural Syst..

[15]  Sunghoon Kim,et al.  A robust license-plate extraction method under complex image conditions , 2002, Object recognition supported by user interaction for service robots.

[16]  Bai Hongliang,et al.  A hybrid license plate extraction method based on edge statistics and morphology , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[17]  John D. Owens,et al.  GPU Computing , 2008, Proceedings of the IEEE.

[18]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[19]  Sei-Wang Chen,et al.  Automatic license plate recognition , 2004, IEEE Transactions on Intelligent Transportation Systems.

[20]  Jingping Jiang,et al.  An adaptive approach to vehicle license plate localization , 2003, IECON'03. 29th Annual Conference of the IEEE Industrial Electronics Society (IEEE Cat. No.03CH37468).

[21]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  L. Burns.  Sustainable mobility: A vision of our transport future , 2013, Nature.

[23]  Fazli Erbas.  Wireless Ad Hoc Networking , 2005, Encyclopedia of Information Science and Technology.

[24]  Se-Young Oh,et al.  Three-feature based automatic lane detection algorithm (TFALDA) for autonomous driving , 2003, IEEE Trans. Intell. Transp. Syst..

[25]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Yoshiko Kojima,et al.  CADAS: A multimodal advanced driver assistance system for normal urban streets based on road context understanding , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[30]  Miha Mraz,et al.  The fuzzy logic approach to the car number plate locating problem , 1997, Proceedings Intelligent Information Systems. IIS'97.

[31]  Irfan A. Essa,et al.  Detecting regions of interest in dynamic scenes with camera motions , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.

[33]  Raymond J. Kiefer,et al.  Development of a Camera-Based Forward Collision Alert System , 2011 .

[34]  Paolo Ferragina,et al.  Optical recognition of motor vehicle license plates , 1995 .

[35]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[36]  Bart De Schutter,et al.  Adaptive Cruise Control for a SMART Car: A Comparison Benchmark for MPC-PWA Control Methods , 2008, IEEE Transactions on Control Systems Technology.