Collective decision optimization algorithm: A new heuristic optimization method

Recently, inspired by nature, diversiform successful and effective optimization methods have been proposed for solving many complex and challenging applications in different domains. This paper proposes a new meta-heuristic technique, collective decision optimization algorithm (CDOA), for training artificial neural networks. It simulates the social behavior of human based on their decision-making characteristics including experience-based phase, others'-based phase, group thinking-based phase, leader-based phase and innovation-based phase. Different corresponding operators are designed in the methodology. Experimental results carried out on a comprehensive set of benchmark functions and two nonlinear function approximation examples demonstrate that CDOA is competitive with respect to other state-of-art optimization algorithms.

[1]  I. Erev,et al.  Small feedback‐based decisions and their limited correspondence to description‐based decisions , 2003 .

[2]  Andrew Lewis,et al.  Let a biogeography-based optimizer train your Multi-Layer Perceptron , 2014, Inf. Sci..

[3]  A. Nahavandi.  The Art and Science of Leadership , 2005 .

[4]  Harry Howe Ransom,et al.  Victims of Groupthink: A Psychological Study of Foreign-Policy Decisions and Fiascoes . By Irving L. Janis. (Boston: Houghton Mifflin Co., 1972. Pp. viii, 277. $4.50 paper.) , 1974 .

[5]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[6]  Hiroki Sayama,et al.  Collective decision making, leadership, and collective intelligence: Tests with agent-based simulations and a Field study , 2016 .

[7]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[8]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[9]  E. Yechiam,et al.  On the robustness of description and experience based decision tasks to social desirability , 2010 .

[10]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[11]  Yang Xiao-zong.  A Novel Multi-Step Position-Selectable Updating Particle Swarm Optimization Algorithm , 2009 .

[12]  Shmuel Nitzan,et al.  On two properties of the marginal contribution of individual decisional skills , 1997 .

[13]  Lei Wang,et al.  The performance comparison of a new version of artificial raindrop algorithm on global numerical optimization , 2016, Neurocomputing.

[14]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[15]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[16]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[17]  I. Janis.  Victims of Groupthink: A psychological study of foreign-policy decisions and fiascoes. By Irving L. Janis. (Boston: Houghton Mifflin, 1972. viii + 276 pp. Map, illustrations, chart, notes, sources, bibliography, and index. Cloth, $7.95; paper $4.50.) , 1973 .

[18]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[19]  Alireza Askarzadeh,et al.  Bird mating optimizer: An optimization algorithm inspired by bird mating strategies , 2014, Commun. Nonlinear Sci. Numer. Simul..

[20]  A. Gandomi.  Interior search algorithm (ISA): a novel approach for global optimization. , 2014, ISA transactions.

[21]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[22]  Wayne K. Hoy,et al.  Swift and smart decision making: heuristics that work , 2010 .

[23]  Frédéric Adam,et al.  Creativity and Innovation in Decision Making and Decision Support , 2006 .

[24]  Xin-She Yang,et al.  Flower Pollination Algorithm for Global Optimization , 2012, UCNC.

[25]  Scott L. Feld,et al.  Collective Decision Making: An Economic Outlook , 1986, American Political Science Review.

[26]  S. Roper,et al.  The innovation decision: an economic analysis , 2007 .

[27]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[28]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[29]  A. Kaveh,et al.  A new meta-heuristic method: Ray Optimization , 2012 .

[30]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[31]  F. Wiebe,et al.  Toward a Process Theory of Groupthink , 1996 .

[32]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[33]  Ramon J. Aldag,et al.  Beyond fiasco: A reappraisal of the groupthink phenomenon and a new model of group decision processes. , 1993 .

[34]  E. Gutierrez,et al.  Innovation and decision making: Understanding selection and prioritization of development projects , 2008, 2008 4th IEEE International Conference on Management of Innovation and Technology.

[35]  Scott Kirkpatrick,et al.  Optimization by Simmulated Annealing , 1983, Sci..

[36]  Emre Soyer,et al.  Sequentially simulated outcomes: kind experience versus nontransparent description. , 2011, Journal of experimental psychology. General.

[37]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[38]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[39]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .