Intelligent traffic control for autonomous vehicle systems based on machine learning

Abstract This study aimed to resolve a real-world traffic problem in a large-scale plant. Autonomous vehicle systems (AVSs), which are designed to use multiple vehicles to transfer materials, are widely used to transfer wafers in semiconductor manufacturing. Traffic control is a significant challenge with AVSs because all vehicles must be monitored and controlled in real time, to cope with uncertainties such as congestion. However, existing traffic control systems, which are primarily designed and controlled by human experts, are insufficient to prevent heavy congestion that impedes production. In this study, we developed a traffic control system based on machine learning predictions, and a routing method that dynamically determines AVS routes with reduced congestion rates. We predicted congestion for critical bottleneck areas, and utilized the predictions for adaptive routing control of all vehicles to avoid congestion. We conducted an experimental evaluation to compare the predictive performance of four popular algorithms. We performed a simulation study based on data from semiconductor fabrication to demonstrate the utility and superiority of the proposed method. The experimental results showed that AVSs with the proposed approach outperformed the existing approach in terms of delivery time, transfer time, and queuing time. We found that adopting machine learning-based traffic control can enhance the performance of existing AVSs and reduce the burden on the human experts who monitor and control AVSs.

[1]  A. Koike,et al.  High-speed AMHS and its operation method for 300-mm QTAT fab , 2004, IEEE Transactions on Semiconductor Manufacturing.

[2]  Yuzhuo Qiu,et al.  A simulation optimization method for vehicles dispatching among multiple container terminals , 2015, Expert Syst. Appl..

[3]  Joel W. Burdick,et al.  Robot Motion Planning in Dynamic, Uncertain Environments , 2012, IEEE Transactions on Robotics.

[4]  Seoung Bum Kim,et al.  Iterative two-stage hybrid algorithm for the vehicle lifter location problem in semiconductor manufacturing , 2019, Journal of Manufacturing Systems.

[5]  Morton B. Brown,et al.  The Small Sample Behavior of Some Statistics Which Test the Equality of Several Means , 1974 .

[6]  Shi-Chung Chang,et al.  Decentralized dispatching for blocking avoidance in automate material handling systems , 2016, 2016 Winter Simulation Conference (WSC).

[7]  Kyung-Sup Kim,et al.  The deadlock detection and resolution method for a unified transport system , 2010 .

[8]  Yi-Kuei Lin,et al.  A Novel Reliability Evaluation Technique for Stochastic-Flow Manufacturing Networks With Multiple Production Lines , 2013, IEEE Transactions on Reliability.

[9]  Frédéric Thiesse,et al.  On the value of location information to lot scheduling in complex manufacturing processes , 2008 .

[10]  Sebastian Rank,et al.  Evaluating Automated Guided Vehicle System Characteristics in Semiconductor Fab Automated Material Handling Systems , 2019, 2019 30th Annual SEMI Advanced Semiconductor Manufacturing Conference (ASMC).

[11]  Henry Y. K. Lau,et al.  An agent-based dynamic routing strategy for automated material handling systems , 2008, Int. J. Comput. Integr. Manuf..

[12]  Taho Yang,et al.  Simulation study for a proposed segmented automated material handling system design for 300-mm semiconductor fabs , 2012, Simul. Model. Pract. Theory.

[13]  Junho Lee,et al.  Practical Routing Algorithm Using a Congestion Monitoring System in Semiconductor Manufacturing , 2018, IEEE Transactions on Semiconductor Manufacturing.

[14]  Marco A. Contreras-Cruz,et al.  Mobile robot path planning using artificial bee colony and evolutionary programming , 2015, Appl. Soft Comput..

[15]  Qi Zhou,et al.  An impending deadlock-free scheduling method in the case of unified automated material handling systems in 300 mm wafer fabrications , 2018, J. Intell. Manuf..

[16]  Sai Ho Chung,et al.  Survey of Green Vehicle Routing Problem: Past and future trends , 2014, Expert Syst. Appl..

[17]  Byung-In Kim,et al.  Effective overhead hoist transport dispatching based on the Hungarian algorithm for a large semiconductor FAB , 2009 .

[18]  Karl Henrik Johansson,et al.  A hybrid machine-learning and optimization method for contraflow design in post-disaster cases and traffic management scenarios , 2019, Expert Syst. Appl..

[19]  Brett A. Peters,et al.  Batch picking in narrow-aisle order picking systems with consideration for picker blocking , 2012, Eur. J. Oper. Res..

[20]  Lu Xi,et al.  The free step length ant colony algorithm in mobile robot path planning , 2016, Adv. Robotics.

[21]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[22]  Yoshinori Suzuki,et al.  Comparative analysis of different routing heuristics for the battery management of automated guided vehicles , 2018, Int. J. Prod. Res..

[23]  Ali Mohades,et al.  Multi-Robot Path Planning Based on Multi-Objective Particle Swarm Optimization , 2019, IEEE Access.

[24]  Iraj Mahdavi,et al.  A six sigma based multi-objective optimization for machine grouping control in flexible cellular manufacturing systems with guide-path flexibility , 2010, Adv. Eng. Softw..

[25]  D. Siegmund,et al.  Using the Generalized Likelihood Ratio Statistic for Sequential Detection of a Change-Point , 1995 .

[26]  André Langevin,et al.  Scheduling and routing of automated guided vehicles: A hybrid approach , 2007, Comput. Oper. Res..

[27]  Chia-Nan Wang,et al.  The heuristic preemptive dispatching method of material transportation system in 300 mm semiconductor fabrication , 2012, J. Intell. Manuf..

[28]  George L. Nemhauser,et al.  Congestion-aware dynamic routing in automated material handling systems , 2014, Comput. Ind. Eng..

[29]  George L. Nemhauser,et al.  Lot targeting and lot dispatching decision policies for semiconductor manufacturing: optimisation under uncertainty with simulation validation , 2018 .

[30]  D. Siegmund,et al.  Sequential Detection of a Change in a Normal Mean when the Initial Value is Unknown , 1991 .

[31]  I. Jerin Leno,et al.  Layout Design for Efficient Material Flow Path , 2012 .

[32]  Adem Tuncer,et al.  Dynamic path planning of mobile robots with improved genetic algorithm , 2012, Comput. Electr. Eng..

[33]  B. K. Panigrahi,et al.  Multi-robot path planning in a dynamic environment using improved gravitational search algorithm , 2016 .

[34]  Makoto Yamamoto,et al.  Novel Approaches to Optimizing Carrier Logistics in Semiconductor Manufacturing , 2015, IEEE Transactions on Semiconductor Manufacturing.

[35]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[36]  Byung-In Kim,et al.  Idle vehicle circulation policies in a semiconductor FAB , 2009, J. Intell. Manuf..

[37]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[38]  Francesco Marcelloni,et al.  Detection of traffic congestion and incidents from GPS trace analysis , 2017, Expert Syst. Appl..

[39]  Thiago F. Noronha,et al.  Iterated local search heuristics for the Vehicle Routing Problem with Cross-Docking , 2014, Expert Syst. Appl..

[40]  Young Jae Jang,et al.  Q(λ) learning-based dynamic route guidance algorithm for overhead hoist transport systems in semiconductor fabs , 2020, Int. J. Prod. Res..

[41]  John Canny,et al.  The complexity of robot motion planning , 1988 .

[42]  Pu-Tai Yang,et al.  Change detection model for sequential cause-and-effect relationships , 2018, Decis. Support Syst..

[43]  Min Zhang,et al.  Modeling of Workflow Congestion and Optimization of Flow Routing in a Manufacturing/Warehouse Facility , 2009, Manag. Sci..

[44]  Fu-Kwun Wang,et al.  Performance evaluation of an automated material handling system for a wafer fab , 2004 .