Vision-based parking-slot detection: A benchmark and a learning-based approach

Recent years have witnessed a growing interest in developing automatic parking systems in the field of intelligent vehicle. However, how to effectively and efficiently locating parking-slots using a vision-based system is still an unresolved issue. In this paper, we attempt to fill this research gap to some extent and our contributions are twofold. Firstly, to facilitate the study of vision-based parking-slot detection, a large-scale parking-slot image database is established. For each image in this database, the marking-points and parking-slots are carefully labelled. Such a database can serve as a benchmark to design and validate parking-slot detection algorithms. Secondly, a learning based parking-slot detection approach is proposed. With this approach, given a test image, the marking-points will be detected at first and then the valid parking-slots can be inferred. Its efficacy and efficiency have been corroborated on our database. The labeled database and the source codes are publicly available at http://sse.tongji.edu.cn/linzhang/ps/index.htm.

[1]  Hui Chen,et al.  Surround view based parking lot detection and tracking , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[2]  Ho Gi Jung,et al.  Uniform User Interface for Semiautomatic Parking Slot Marking Recognition , 2010, IEEE Transactions on Vehicular Technology.

[3]  Kok Kiong Tan,et al.  Autonomous Reverse Parking System Based on Robust Path Generation and Improved Sliding Mode Control , 2015, IEEE Transactions on Intelligent Transportation Systems.

[4]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Toshiaki Kakinami,et al.  Evaluation of a Vision-Based Parking Assistance System , 2005 .

[6]  Seung-Woo Seo,et al.  Available Parking Slot Recognition Based on Slot Context Analysis , 2016 .

[7]  Kyungbok Sung,et al.  Vehicle control system for automatic valet parking with infrastructure sensors , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[8]  Kwae-Hi Lee,et al.  Low cost design of parallel parking assist system based on an ultrasonic sensor , 2010 .

[9]  Ho Gi Jung,et al.  Full-automatic recognition of various parking slot markings using a hierarchical tree structure , 2013 .

[10]  Ho Gi Jung,et al.  Sensor Fusion-Based Vacant Parking Slot Detection and Tracking , 2014, IEEE Transactions on Intelligent Transportation Systems.

[11]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[12]  Jiri Matas,et al.  Robust Detection of Lines Using the Progressive Probabilistic Hough Transform , 2000, Comput. Vis. Image Underst..

[13]  Jürgen Dickmann,et al.  Detection of parked vehicles from a radar based occupancy grid , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[14]  Jonas Larsson,et al.  A semi-automated parallel parking system for passenger cars , 2006 .

[15]  Sheng-Jyh Wang,et al.  Vacant Parking Space Detection Based on Plane-Based Bayesian Hierarchical Framework , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Hisashi Satonaka,et al.  DEVELOPMENT OF PARKING SPACE DETECTION USING AN ULTRASONIC SENSOR , 2006 .

[17]  Ho Gi Jung,et al.  Light-Stripe-Projection-Based Target Position Designation for Intelligent Parking-Assist System , 2010, IEEE Transactions on Intelligent Transportation Systems.

[18]  Eric Wahl,et al.  Parking assistance using dense motion-stereo , 2011, Machine Vision and Applications.

[19]  Y. Suzuki,et al.  Parking assistance using multi-camera infrastructure , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[20]  Luis Salgado,et al.  Robust multiple lane road modeling based on perspective analysis , 2008, 2008 15th IEEE International Conference on Image Processing.

[21]  Ho Gi Jung,et al.  Scanning Laser Radar-Based Target Position Designation for Parking Aid System , 2008, IEEE Transactions on Intelligent Transportation Systems.

[22]  Byung-Sung Kim,et al.  Parking space detection using ultrasonic sensor in parking assistance system , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[23]  Larry S. Davis,et al.  Human detection using partial least squares analysis , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Ho Gi Jung,et al.  Parking Slot Markings Recognition for Automatic Parking Assist System , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[26]  Piotr Dollár,et al.  Crosstalk Cascades for Frame-Rate Pedestrian Detection , 2012, ECCV.

[27]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[29]  Ho Gi Jung,et al.  Automatic Parking Space Detection and Tracking for Underground and Indoor Environments , 2016, IEEE Transactions on Industrial Electronics.

[30]  Ming Yang,et al.  Automatic Parking Based on a Bird's Eye View Vision System , 2014 .

[31]  Hideki Hashimoto,et al.  Development of advanced parking assistance system , 2003, IEEE Trans. Ind. Electron..

[32]  Ho Gi Jung,et al.  Structure Analysis Based Parking Slot Marking Recognition for Semi-automatic Parking System , 2006, SSPR/SPR.

[33]  Thomas Fechner,et al.  Parking lot measurement with 24 GHz short range automotive radar , 2015, 2015 16th International Radar Symposium (IRS).

[34]  N. Mattern,et al.  Free space determination for parking slots using a 3D PMD sensor , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[35]  Martial Hebert,et al.  Detection of parking spots using 2D range data , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[36]  Jürgen Dickmann,et al.  Parking space detection with hierarchical dynamic occupancy grids , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[37]  Subhransu Maji,et al.  Classification using intersection kernel support vector machines is efficient , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[39]  Ho Gi Jung,et al.  Automatic free parking space detection by using motion stereo-based 3D reconstruction , 2010, Machine Vision and Applications.

[40]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[41]  Alois Knoll,et al.  Towards autonomous driving in a parking garage: Vehicle localization and tracking using environment-embedded LIDAR sensors , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[42]  Sarah Eichmann,et al.  The Radon Transform And Some Of Its Applications , 2016 .

[43]  Luiz Eduardo Soares de Oliveira,et al.  PKLot - A robust dataset for parking lot classification , 2015, Expert Syst. Appl..

[44]  Myoungho Sunwoo,et al.  Development of Autonomous Car—Part I: Distributed System Architecture and Development Process , 2014, IEEE Transactions on Industrial Electronics.

[45]  Luc Van Gool,et al.  Seeking the Strongest Rigid Detector , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Ho Gi Jung,et al.  3D VISION SYSTEM FOR THE RECOGNITION OF FREE PARKING SITE LOCATION , 2006 .

[47]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[48]  Gongjun Yan,et al.  SmartParking: A Secure and Intelligent Parking System , 2011, IEEE Intelligent Transportation Systems Magazine.

[49]  Ming Xie,et al.  Vision-guided automatic parking for smart car , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[50]  Myoungho Sunwoo,et al.  Development of Autonomous Car—Part II: A Case Study on the Implementation of an Autonomous Driving System Based on Distributed Architecture , 2015, IEEE Transactions on Industrial Electronics.

[51]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[52]  David Barber,et al.  Bayesian reasoning and machine learning , 2012 .

[53]  Bernt Schiele,et al.  A Performance Evaluation of Single and Multi-feature People Detection , 2008, DAGM-Symposium.

[54]  Ito Takahiro,et al.  Histogram of oriented gradients for human detection in video , 2018, 2018 5th International Conference on Business and Industrial Research (ICBIR).