A Reinforcement Learning based Path Guidance Scheme for Long-range Autonomous Valet Parking in Smart Cities

Finding a parking slot in the city centre has always been a great challenge. In many cases, drivers spend a lot of time roaming around looking for an empty and suitable parking slot. The emerging machine learning technologies in intelligent transport system has made it more flexible for Electric Autonomous Vehicle (EAV) to find a parking slot and get parked. The Long-range Autonomous Valet Parking (LAVP) allows an EAV to drop user at a suitable drop-off spot and select an economical parking slot. With the evolution of battery operated vehicles, the primary concern is efficient use of battery resources. This can be done either by maximizing battery capacity or by smartly using battery with existing capacity. During the parking process, most of the energy is consumed by finding an optimal path to parking slot. The work proposed in this paper guides EAV from a random starting point to nearest drop-off spot and CP. A Reinforcement Learning based Autonomous Valet Parking technique (RL-LAVP) has been designed to guide EAV to drop-off spot, CP and minimize the total distance covered during this process. The RL-LAVP results show a significant improvement towards minimizing covered distance and consumed energy when compared with RaNdom (RN) parking and LAVP parking techniques.

[1]  Xiaodong Lin,et al.  Toward Privacy-Preserving Valet Parking in Autonomous Driving Era , 2019, IEEE Transactions on Vehicular Technology.

[2]  Nauman Aslam,et al.  AVPark: Reservation and Cost Optimization-Based Cyber-Physical System for Long-Range Autonomous Valet Parking (L-AVP) , 2019, IEEE Access.

[3]  Geoffrey Ye Li,et al.  Toward Intelligent Vehicular Networks: A Machine Learning Framework , 2018, IEEE Internet of Things Journal.

[4]  Prof Arun S Tigadi.  ADVANCED DRIVER ASSISTANCE SYSTEMS , 2022 .

[5]  Kai Ma,et al.  Chance-Constrained Optimization in D2D-Based Vehicular Communication Network , 2019, IEEE Transactions on Vehicular Technology.

[6]  Liehuang Zhu,et al.  ASAP: An Anonymous Smart-Parking and Payment Scheme in Vehicular Networks , 2020, IEEE Transactions on Dependable and Secure Computing.

[7]  Joeri Van Mierlo,et al.  Energy Consumption Prediction for Electric Vehicles Based on Real-World Data , 2015 .

[8]  Yi Huang,et al.  Smart Parking Guidance, Monitoring and Reservations: A Review , 2017, IEEE Intelligent Transportation Systems Magazine.

[9]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[10]  Enrique Alba,et al.  Evolutionary Deep Learning for Car Park Occupancy Prediction in Smart Cities , 2018, LION.

[11]  Claudio Gennaro,et al.  Car parking occupancy detection using smart camera networks and Deep Learning , 2016, 2016 IEEE Symposium on Computers and Communication (ISCC).

[12]  Yi Qian,et al.  Misbehavior Detection using Machine Learning in Vehicular Communication Networks , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[13]  Gaoxi Xiao,et al.  A Robust Optimization Approach for Energy Generation Scheduling in Microgrids , 2015 .

[14]  D. Shoup.  Cruising for Parking , 2006 .

[15]  Muhammad Arshad,et al.  A survey of local/cooperative-based malicious information detection techniques in VANETs , 2018, EURASIP J. Wirel. Commun. Netw..

[16]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[17]  Geoffrey Ye Li,et al.  Machine Learning for Vehicular Networks: Recent Advances and Application Examples , 2018, IEEE Vehicular Technology Magazine.

[18]  Donald Shoup,et al.  The High Cost of Free Parking: Updated Edition , 2011 .

[19]  Vijay Paidi,et al.  Smart parking sensors, technologies and applications for open parking lots: a review , 2018 .

[20]  Binsu C. Kovoor,et al.  A Genetic Algorithm Approach to Autonomous Smart Vehicle Parking system , 2018 .

[21]  Eduardo Bejar,et al.  Reverse Parking a Car-Like Mobile Robot with Deep Reinforcement Learning and Preview Control , 2019, 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC).

[22]  Barak A. Pearlmutter,et al.  Automatic differentiation in machine learning: a survey , 2015, J. Mach. Learn. Res..

[23]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[24]  Christos G. Cassandras,et al.  New “Smart Parking” System Based on Resource Allocation and Reservations , 2013, IEEE Transactions on Intelligent Transportation Systems.

[25]  Robert Shorten,et al.  Parked cars as a service delivery platform , 2014, 2014 International Conference on Connected Vehicles and Expo (ICCVE).

[26]  Demis Hassabis,et al.  Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm , 2017, ArXiv.

[27]  Liangliang Lou,et al.  An Improved Roadside Parking Space Occupancy Detection Method Based on Magnetic Sensors and Wireless Signal Strength , 2019, Sensors.

[28]  Scott Le Vine,et al.  Optimal storage and loading zones within surface parking facilities for privately owned automated vehicles , 2019, IET Intelligent Transport Systems.