A Reinforcement Learning-assisted Genetic Programming Algorithm for Team Formation Problem Considering Person-Job Matching

An efficient team is essential for the company to successfully complete new projects. To solve the team formation problem considering person-job matching (TFP-PJM), a 0-1 integer programming model is constructed, which considers both person-job matching and team members' willingness to communicate on team efficiency, with the person-job matching score calculated using intuitionistic fuzzy numbers. Then, a reinforcement learning-assisted genetic programming algorithm (RL-GP) is proposed to enhance the quality of solutions. The RL-GP adopts the ensemble population strategies. Before the population evolution at each generation, the agent selects one from four population search modes according to the information obtained, thus realizing a sound balance of exploration and exploitation. In addition, surrogate models are used in the algorithm to evaluate the formation plans generated by individuals, which speeds up the algorithm learning process. Afterward, a series of comparison experiments are conducted to verify the overall performance of RL-GP and the effectiveness of the improved strategies within the algorithm. The hyper-heuristic rules obtained through efficient learning can be utilized as decision-making aids when forming project teams. This study reveals the advantages of reinforcement learning methods, ensemble strategies, and the surrogate model applied to the GP framework. The diversity and intelligent selection of search patterns along with fast adaptation evaluation, are distinct features that enable RL-GP to be deployed in real-world enterprise environments.

[1]  Mengjie Zhang,et al.  Explainable Artificial Intelligence by Genetic Programming: A Survey , 2023, IEEE Transactions on Evolutionary Computation.

[2]  Dayong Shen,et al.  Self-Attentional Multi-Field Features Representation and Interaction Learning for Person–Job Fit , 2023, IEEE Transactions on Computational Social Systems.

[3]  K. Sörensen,et al.  A general deep reinforcement learning hyperheuristic framework for solving combinatorial optimization problems , 2023, Eur. J. Oper. Res..

[4]  Jiting Li,et al.  An Improved Genetic Algorithm for Team Formation Problem , 2022, IEEE Symposium Series on Computational Intelligence.

[5]  Mengjie Zhang,et al.  Genetic Programming With Knowledge Transfer and Guided Search for Uncertain Capacitated Arc Routing Problem , 2022, IEEE Transactions on Evolutionary Computation.

[6]  Mengjie Zhang,et al.  Genetic Programming With Niching for Uncertain Capacitated Arc Routing Problem , 2022, IEEE Transactions on Evolutionary Computation.

[7]  Carlos A. Brizuela,et al.  A Comprehensive Review and a Taxonomy Proposal of Team Formation Problems , 2021, ACM Comput. Surv..

[8]  Abdollah Kavousi-Fard,et al.  Reinforcement Learning-Based Load Forecasting of Electric Vehicle Charging Station Using Q-Learning Technique , 2021, IEEE Transactions on Industrial Informatics.

[9]  Jun Moon Generalized Risk-Sensitive Optimal Control and Hamilton–Jacobi–Bellman Equation , 2021, IEEE Transactions on Automatic Control.

[10]  Lining Xing,et al.  A Data-Driven Analysis of Employee Development Based on Working Expertise , 2021, IEEE Transactions on Computational Social Systems.

[11]  Mengjie Zhang,et al.  Multitask Genetic Programming-Based Generative Hyperheuristics: A Case Study in Dynamic Scheduling , 2021, IEEE Transactions on Cybernetics.

[12]  Yi Mei,et al.  A Cooperative Coevolution Genetic Programming Hyper-Heuristics Approach for On-Line Resource Allocation in Container-Based Clouds , 2020, IEEE Transactions on Cloud Computing.

[13]  Mengjie Zhang,et al.  Genetic Programming with Delayed Routing for Multiobjective Dynamic Flexible Job Shop Scheduling , 2020, Evolutionary Computation.

[14]  Miguel Ángel Pérez-Toledano,et al.  Players’ selection for basketball teams, through Performance Index Rating, using multiobjective evolutionary algorithms , 2019, PloS one.

[15]  Guohua Wu,et al.  Ensemble strategies for population-based optimization algorithms - A survey , 2019, Swarm Evol. Comput..

[16]  Xiaofeng Zhu,et al.  Efficient kNN Classification With Different Numbers of Nearest Neighbors , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Wenxing Ye,et al.  A novel multi-swarm particle swarm optimization with dynamic learning strategy , 2017, Appl. Soft Comput..

[18]  Ahmad Makui,et al.  A New Optimization Model for Reliable Team Formation Problem Considering Experts’ Collaboration Network , 2017, IEEE Transactions on Engineering Management.

[19]  Alfredo Candia-Véjar,et al.  The multiple team formation problem using sociometry , 2016, Comput. Oper. Res..

[20]  Alexander G. Nikolaev,et al.  Social structure optimization in team formation , 2016, Comput. Oper. Res..

[21]  Katsumi Inoue,et al.  Mission Oriented Robust Multi-Team Formation and Its Application to Robot Rescue Simulation , 2016, IJCAI.

[22]  Jürgen Branke,et al.  On Using Surrogates with Genetic Programming , 2015, Evolutionary Computation.

[23]  Wilfred Ng,et al.  A Comparative Study of Team Formation in Social Networks , 2015, DASFAA.

[24]  Pedro Ferreira,et al.  An MDP Model-Based Reinforcement Learning Approach for Production Station Ramp-Up Optimization: Q-Learning Analysis , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Xiang Zhang,et al.  Multi-objective team formation optimization for new product development , 2013, Comput. Ind. Eng..

[26]  Manuela M. Veloso,et al.  Modeling and learning synergy for team formation with heterogeneous agents , 2012, AAMAS.

[27]  Damjan Strnad,et al.  A fuzzy-genetic decision support system for project team formation , 2010, Appl. Soft Comput..

[28]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Mooyoung Jung,et al.  A team formation model based on knowledge and collaboration , 2009, Expert Syst. Appl..

[30]  Zeshui Xu,et al.  Intuitionistic Fuzzy Aggregation Operators , 2007, IEEE Transactions on Fuzzy Systems.

[31]  Türkay Dereli,et al.  PROJECT TEAM SELECTION USING FUZZY OPTIMIZATION APPROACH , 2007, Cybern. Syst..

[32]  Ronald G. Askin,et al.  Forming effective worker teams with multi-functional skill requirements , 2005, Comput. Ind. Eng..

[33]  Gerard Sierksma,et al.  Team formation: Matching quality supply and quality demand , 2003, Eur. J. Oper. Res..

[34]  Pierre Hansen,et al.  Variable neighborhood search , 1997, Eur. J. Oper. Res..

[35]  Marcelo A. C. Fernandes,et al.  Parallel Implementation of Reinforcement Learning Q-Learning Technique for FPGA , 2019, IEEE Access.

[36]  G. Swetha,et al.  A genetic approach for tri-objective optimization in team formation , 2017, 2016 Eighth International Conference on Advanced Computing (ICoAC).

[37]  Dejian Yu,et al.  Intuitionistic fuzzy multi-criteria decision making with application to job hunting: A comparative perspective , 2016, J. Intell. Fuzzy Syst..

[38]  Vivek S. Borkar,et al.  Submodularity in Team Formation Problem , 2014, SDM.

[39]  Kalyanmoy Deb,et al.  Multi-objective optimization and decision making approaches to cricket team selection , 2013, Appl. Soft Comput..

[40]  Jian Ma,et al.  Modeling Researchers' Characteristics For The Formation Of Research Team , 2012, PACIS.

[41]  Hisham M. E. Abdelsalam,et al.  Multi-objective Team Forming Optimization for Integrated Product Development Projects , 2009, Foundations of Computational Intelligence.