This paper analyzes the elastic net approach (Durbin and Willshaw 1987) to the traveling salesman problem of finding the shortest path through a set of cities. The elastic net approach jointly minimizes the length of an arbitrary path in the plane and the distance between the path points and the cities. The tradeoff between these two requirements is controlled by a scale parameter K. A global minimum is found for large K, and is then tracked to a small value. In this paper, we show that (1) in the small K limit the elastic path passes arbitrarily close to all the cities, but that only one path point is attracted to each city, (2) in the large K limit the net lies at the center of the set of cities, and (3) at a critical value of K the energy function bifurcates. We also show that this method can be interpreted in terms of extremizing a probability distribution controlled by K. The minimum at a given K corresponds to the maximum a posteriori (MAP) Bayesian estimate of the tour under a natural statistical interpretation. The analysis presented in this paper gives us a better understanding of the behavior of the elastic net, allows us to better choose the parameters for the optimization, and suggests how to extend the underlying ideas to other domains.
[1]
D J Willshaw,et al.
A marker induction mechanism for the establishment of ordered neural mappings: its application to the retinotectal problem.
,
1979,
Philosophical transactions of the Royal Society of London. Series B, Biological sciences.
[2]
David J. Burr,et al.
Elastic Matching of Line Drawings
,
1981,
IEEE Transactions on Pattern Analysis and Machine Intelligence.
[3]
C. D. Gelatt,et al.
Optimization by Simulated Annealing
,
1983,
Science.
[4]
Richard Durbin,et al.
An analogue approach to the travelling salesman problem using an elastic net method
,
1987,
Nature.
[5]
Bernard Angéniol,et al.
Self-organizing feature maps and the travelling salesman problem
,
1988,
Neural Networks.
[6]
Teuvo Kohonen,et al.
Self-organization and associative memory: 3rd edition
,
1989
.
[7]
Carsten Peterson,et al.
Parallel Distributed Approaches to Combinatorial Optimization: Benchmark Studies on Traveling Salesman Problem
,
1990,
Neural Computation.
[8]
Geoffrey E. Hinton,et al.
The Bootstrap Widrow-Hoff Rule as a Cluster-Formation Algorithm
,
1990,
Neural Computation.