HETEROGENEOUS SIMULATED ANNEALING TEAMS: AN OPTIMIZING SEARCH ALGORITHM INSPIRED BY ENGINEERING DESIGN TEAMS

Although insights uncovered by design cognition are often utilized to develop the methods used by human designers, using such insights to inform computational methodologies also has the potential to improve the performance of design algorithms. This paper uses insights from research on design cognition and design teams to inform a better simulated annealing search algorithm. Simulated annealing has already been established as a model of individual problem solving. This paper introduces the Heterogeneous Simulated Annealing Team (HSAT) algorithm, a multi-agent simulated annealing algorithm. Each agent controls an adaptive annealing schedule, allowing the team develop heterogeneous search strategies. Such diversity is a natural part of engineering design, and boosts performance in other multi-agent algorithms. Further, interaction between agents in HSAT is structured to mimic interaction between members of a design team. Performance is compared to several other simulated annealing algorithms, a random search algorithm, and a gradient-based algorithm. Compared to other algorithms, the team-based HSAT algorithm returns better average results with lower variance.

[1]  Josef Schwarz,et al.  HYBRID PARALLEL SIMULATED ANNEALING USING GENETIC OPERATIONS , 2004 .

[2]  Jonathan Cagan,et al.  Design Team Convergence: The Influence of Example Solution Quality , 2009 .

[3]  Seth D. Guikema,et al.  A derivation of the number of minima of the Griewank function , 2008, Appl. Math. Comput..

[4]  Jonathan Cagan,et al.  Cognitive-Based Search Strategies for Complex Bio-Nanotechnology Design Derived Through Symbiotic Human and Agent-Based Approaches , 2014 .

[5]  John R. Dixon,et al.  A review of research in mechanical engineering design. Part I: Descriptive, prescriptive, and computer-based models of design processes , 1989 .

[6]  Linden J. Ball,et al.  Structured and opportunistic processing in design: a critical discussion , 1995, Int. J. Hum. Comput. Stud..

[7]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[8]  Saeed Zolfaghari,et al.  Adaptive temperature control for simulated annealing: a comparative study , 2004, Comput. Oper. Res..

[9]  Ashok K. Goel,et al.  Cognitive, collaborative, conceptual and creative - Four characteristics of the next generation of knowledge-based CAD systems: A study in biologically inspired design , 2012, Comput. Aided Des..

[10]  Jonathan Cagan,et al.  Protocol-Based Multi-Agent Systems: Examining the Effect of Diversity, Dynamism, and Cooperation in Heuristic Optimization Approaches , 2011 .

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[13]  A. Griewank.  Generalized descent for global optimization , 1981 .

[14]  Jami J. Shah,et al.  Empirical Studies of Design Thinking: Past, Present, Future , 2013 .

[15]  Jonathan Cagan,et al.  Concurrent Optimization of Computationally Learned Stylistic Form and Functional Goals , 2012 .

[16]  Jonathan Cagan,et al.  A-Design: An Agent-Based Approach to Conceptual Design in a Dynamic Environment , 1999 .

[17]  Hui Zhang,et al.  Multi-agent simulated annealing algorithm based on differential evolution algorithm , 2012, Int. J. Bio Inspired Comput..

[18]  Panos Y. Papalambros,et al.  Principles of Optimal Design: Author Index , 2000 .

[19]  Takeshi Yoshida,et al.  Energy Minimization of Protein Tertiary Structure by Parallel Simulated Annealing using Genetic Crossover , 2002 .

[20]  Huang,et al.  AN EFFICIENT GENERAL COOLING SCHEDULE FOR SIMULATED ANNEALING , 1986 .

[21]  Christopher McComb,et al.  Rolling with the punches: An examination of team performance in a design task subject to drastic changes , 2015 .

[22]  Patrick Siarry,et al.  A theoretical study on the behavior of simulated annealing leading to a new cooling schedule , 2005, Eur. J. Oper. Res..

[23]  Matthew D. Wood,et al.  The Role of Design Team Interaction Structure on Individual and Shared Mental Models , 2014 .

[24]  Nigel Cross,et al.  Expertise in Design: an overview , 2004 .

[25]  Jonathan Cagan,et al.  Simulated Annealing and the Generation of the Objective Function: A Model of Learning During Problem Solving , 1997, Comput. Intell..

[26]  Mirko Krivánek,et al.  Simulated Annealing: A Proof of Convergence , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Alice M. Agogino,et al.  A Document Analysis Method for Characterizing Design Team Performance , 2004 .

[28]  Lester Ingber,et al.  Adaptive simulated annealing (ASA): Lessons learned , 2000, ArXiv.

[29]  Hui Zhang,et al.  Multi-agent simulated annealing algorithm based on particle swarm optimisation algorithm , 2012, Int. J. Comput. Appl. Technol..