A Novel Monarch Butterfly Optimization with Global Position Updating Operator for Large-Scale 0-1 Knapsack Problems

As a significant subset of the family of discrete optimization problems, the 0-1 knapsack problem (0-1 KP) has received considerable attention among the relevant researchers. The monarch butterfly optimization (MBO) is a recent metaheuristic algorithm inspired by the migration behavior of monarch butterflies. The original MBO is proposed to solve continuous optimization problems. This paper presents a novel monarch butterfly optimization with a global position updating operator (GMBO), which can address 0-1 KP known as an NP-complete problem. The global position updating operator is incorporated to help all the monarch butterflies rapidly move towards the global best position. Moreover, a dichotomy encoding scheme is adopted to represent monarch butterflies for solving 0-1 KP. In addition, a specific two-stage repair operator is used to repair the infeasible solutions and further optimize the feasible solutions. Finally, Orthogonal Design (OD) is employed in order to find the most suitable parameters. Two sets of low-dimensional 0-1 KP instances and three kinds of 15 high-dimensional 0-1 KP instances are used to verify the ability of the proposed GMBO. An extensive comparative study of GMBO with five classical and two state-of-the-art algorithms is carried out. The experimental results clearly indicate that GMBO can achieve better solutions on almost all the 0-1 KP instances and significantly outperforms the rest.

[1]  Minghao Yin,et al.  Animal migration optimization: an optimization algorithm inspired by animal migration behavior , 2014, Neural Computing and Applications.

[2]  Yong Zhang,et al.  Brain storm optimization for feature selection using new individual clustering and updating mechanism , 2019, Applied Intelligence.

[3]  Xingjuan Cai,et al.  Artificial Plant Optimization Algorithm , 2013 .

[4]  Jianhua Wu,et al.  Solving 0-1 knapsack problem by a novel global harmony search algorithm , 2011, Appl. Soft Comput..

[5]  He Yichao,et al.  A Binary Differential Evolution Algorithm with Hybrid Encoding , 2007 .

[6]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[7]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[8]  Banaja Mohanty,et al.  Performance analysis of dual‐mode PI controller using quasi‐oppositional whale optimization algorithm for load frequency control , 2019 .

[9]  Amir Hossein Gandomi,et al.  Hybridizing harmony search algorithm with cuckoo search for global numerical optimization , 2014, Soft Computing.

[10]  Yongquan Zhou,et al.  A Complex-valued Encoding Bat Algorithm for Solving 0–1 Knapsack Problem , 2015, Neural Processing Letters.

[11]  Sankaran Mahadevan,et al.  Solving 0-1 knapsack problems based on amoeboid organism algorithm , 2013, Appl. Math. Comput..

[12]  David Pisinger,et al.  An expanding-core algorithm for the exact 0-1 knapsack problem , 1995 .

[13]  Ali Husseinzadeh Kashan,et al.  DisABC: A new artificial bee colony algorithm for binary optimization , 2012, Appl. Soft Comput..

[14]  Ying Tan,et al.  Improving Metaheuristic Algorithms With Information Feedback Models , 2019, IEEE Transactions on Cybernetics.

[15]  Günther R. Raidl,et al.  The Core Concept for the Multidimensional Knapsack Problem , 2006, EvoCOP.

[16]  Suash Deb,et al.  A Novel Monarch Butterfly Optimization with Greedy Strategy and Self-Adaptive , 2015, 2015 Second International Conference on Soft Computing and Machine Intelligence (ISCMI).

[17]  Zhao Xinchao A perturbed particle swarm algorithm for numerical optimization , 2010 .

[18]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[19]  George Mavrotas,et al.  Selection among ranked projects under segmentation, policy and logical constraints , 2008, Eur. J. Oper. Res..

[20]  Steven Li,et al.  A simplified binary harmony search algorithm for large scale 0-1 knapsack problems , 2015, Expert Syst. Appl..

[21]  Xiao-Yan Sun,et al.  A discrete artificial bee colony algorithm incorporating differential evolution for the flow-shop scheduling problem with blocking , 2015 .

[22]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[23]  Ding-Zhu Du,et al.  Design and Analysis of Approximation Algorithms , 2011 .

[24]  D. Wiesmann,et al.  Evolutionary Optimization Algorithms in Computational Optics , 1999 .

[25]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[26]  Xizhao Wang,et al.  Discrete differential evolutions for the discounted {0-1} knapsack problem , 2017, Int. J. Bio Inspired Comput..

[27]  Dalila Boughaci,et al.  A self-adaptive harmony search combined with a stochastic local search for the 0-1 multidimensional knapsack problem , 2016, Int. J. Bio Inspired Comput..

[28]  Gaige Wang,et al.  Moth search algorithm: a bio-inspired metaheuristic algorithm for global optimization problems , 2016, Memetic Computing.

[29]  Ilya Pavlyukevich Lévy flights, non-local search and simulated annealing , 2007, J. Comput. Phys..

[30]  Chou-Yuan Lee,et al.  A New Approach for Solving 0/1 Knapsack Problem , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[31]  Yu Xue,et al.  Improved bat algorithm with optimal forage strategy and random disturbance strategy , 2016, Int. J. Bio Inspired Comput..

[32]  Suash Deb,et al.  Solving 0–1 knapsack problem by a novel binary monarch butterfly optimization , 2017, Neural Computing and Applications.

[33]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[34]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[35]  Jian Cheng,et al.  Multi-Objective Particle Swarm Optimization Approach for Cost-Based Feature Selection in Classification , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[36]  Panos M. Pardalos,et al.  A human learning optimization algorithm and its application to multi-dimensional knapsack problems , 2015, Appl. Soft Comput..

[37]  Jun-Qing Li,et al.  An effective invasive weed optimization algorithm for scheduling semiconductor final testing problem , 2018, Swarm Evol. Comput..

[38]  G. Dantzig Discrete-Variable Extremum Problems , 1957 .

[39]  David Pisinger,et al.  Where are the hard knapsack problems? , 2005, Comput. Oper. Res..

[40]  Marek Gutowski L\'evy flights as an underlying mechanism for global optimization algorithms , 2001 .

[41]  M. Fatih Tasgetiren,et al.  A discrete artificial bee colony algorithm for the multi-objective flexible job-shop scheduling problem with maintenance activities , 2014 .

[42]  Haifeng Li,et al.  Ensemble of differential evolution variants , 2018, Inf. Sci..

[43]  Xin-She Yang,et al.  A new hybrid method based on krill herd and cuckoo search for global optimisation tasks , 2016, Int. J. Bio Inspired Comput..

[44]  F. Sibel Salman,et al.  Pre-disaster investment decisions for strengthening a highway network , 2010, Comput. Oper. Res..

[45]  Dunwei Gong,et al.  Binary differential evolution with self-learning for multi-objective feature selection , 2020, Inf. Sci..

[46]  Bhupinder Singh,et al.  A novel adaptive butterfly optimization algorithm , 2018, International Journal of Computational Materials Science and Engineering.

[47]  Ke Jia,et al.  An Improved Hybrid Encoding Cuckoo Search Algorithm for 0-1 Knapsack Problems , 2014, Comput. Intell. Neurosci..

[48]  Justin Yates,et al.  A constrained binary knapsack approximation for shortest path network interdiction , 2011, Comput. Ind. Eng..

[49]  Zhihua Cui,et al.  Monarch butterfly optimization , 2015, Neural Computing and Applications.

[50]  Leandro dos Santos Coelho,et al.  A new metaheuristic optimisation algorithm motivated by elephant herding behaviour , 2016, Int. J. Bio Inspired Comput..

[51]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[52]  Xin-She Yang,et al.  Attraction and diffusion in nature-inspired optimization algorithms , 2015, Neural Computing and Applications.

[53]  Qing Wang,et al.  A filter-based bare-bone particle swarm optimization algorithm for unsupervised feature selection , 2019, Applied Intelligence.

[54]  Vili Podgorelec,et al.  Swarm Intelligence Algorithms for Feature Selection: A Review , 2018, Applied Sciences.

[55]  Xiangtao Li,et al.  A perturb biogeography based optimization with mutation for global numerical optimization , 2011, Appl. Math. Comput..

[56]  Liu Zhiming,et al.  Solving 0-1 Knapsack Problems by a Discrete Binary Version of Differential Evolution , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[57]  Leandro dos Santos Coelho,et al.  Earthworm optimisation algorithm: a bio-inspired metaheuristic algorithm for global optimisation problems , 2018, Int. J. Bio Inspired Comput..

[58]  Qi Wang,et al.  Nonnegative Laplacian embedding guided subspace learning for unsupervised feature selection , 2019, Pattern Recognit..

[59]  Quan-Ke Pan,et al.  An effective hybrid tabu search algorithm for multi-objective flexible job-shop scheduling problems , 2010, Comput. Ind. Eng..

[60]  Amir Hossein Gandomi,et al.  Stud krill herd algorithm , 2014, Neurocomputing.

[61]  Vijander Singh,et al.  A novel nature-inspired algorithm for optimization: Squirrel search algorithm , 2019, Swarm Evol. Comput..

[62]  Anne L. Olsen Penalty functions and the knapsack problem , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[63]  Leandro dos Santos Coelho,et al.  A new metaheuristic optimisation algorithm motivated by elephant herding behaviour , 2017 .

[64]  S. Martello,et al.  A New Algorithm for the 0-1 Knapsack Problem , 1988 .

[65]  Sarada Prasad Sarmah,et al.  Shuffled frog leaping algorithm and its application to 0/1 knapsack problem , 2014, Appl. Soft Comput..

[66]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[67]  Yu Xue,et al.  A self-adaptive artificial bee colony algorithm based on global best for global optimization , 2017, Soft Computing.

[68]  Mohamed H. Haggag,et al.  A novel chaotic salp swarm algorithm for global optimization and feature selection , 2018, Applied Intelligence.

[69]  Amir Hossein Gandomi,et al.  A new hybrid method based on krill herd and cuckoo search for global optimisation tasks , 2016, Int. J. Bio Inspired Comput..

[70]  Wei Shih,et al.  A Branch and Bound Method for the Multiconstraint Zero-One Knapsack Problem , 1979 .

[71]  Gaige Wang,et al.  An Effective Hybrid Cuckoo Search Algorithm with Improved Shuffled Frog Leaping Algorithm for 0-1 Knapsack Problems , 2014, Comput. Intell. Neurosci..

[72]  Xiang Li,et al.  Algorithms for randomized time-varying knapsack problems , 2016, J. Comb. Optim..

[73]  Amir Hossein Gandomi,et al.  Opposition-based krill herd algorithm with Cauchy mutation and position clamping , 2016, Neurocomputing.

[74]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[75]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[76]  Kusum Deep,et al.  A Modified Binary Particle Swarm Optimization for Knapsack Problems , 2012, Appl. Math. Comput..

[77]  S. Voß,et al.  Some Experiences On Solving Multiconstraint Zero-One Knapsack Problems With Genetic Algorithms , 1994 .

[78]  Seyed Mohammad Mirjalili,et al.  Moth-Flame Optimization Algorithm: Theory, Literature Review, and Application in Optimal Nonlinear Feedback Control Design , 2019, Nature-Inspired Optimizers.

[79]  Paolo Toth,et al.  Dynamic programming algorithms for the Zero-One Knapsack Problem , 1980, Computing.