Modeling Data: Analogies in Neural Networks, Simulated Annealing and Genetic Algorithms

This paper examines several analogies employed in computational data analysis techniques: the analogy to the brain for artificial neural networks, the analogy to statistical mechanics for simulated annealing and the analogy to evolution for genetic algorithms. After exploring these analogies, we compare them to analogies in scientific models and highlight that scientific models address specific empirical phenomena, whereas data analysis models are application-neutral: they can be used whenever a set of data meets certain formal requirements, regardless of what phenomenon these data pertain to. Through the analogy, computational data analysis techniques inherit a conceptual idea from which the principle of the technique is developed. In all cases of computational data analysis techniques, the analogies used - and the metaphors generated by them - help us to understand the technique by providing a more concrete framework for understanding what is otherwise an abstract method. In the different examples, however, the significance of the analogies varies. Analogy can, though need not, be indispensable for a technique.