The parameterless self-organizing map algorithm

The parameterless self-organizing map (PLSOM) is a new neural network algorithm based on the self-organizing map (SOM). It eliminates the need for a learning rate and annealing schemes for learning rate and neighborhood size. We discuss the relative performance of the PLSOM and the SOM and demonstrate some tasks in which the SOM fails but the PLSOM performs satisfactory. Finally we discuss some example applications of the PLSOM and present a proof of ordering under certain limited conditions.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  M. Cottrell,et al.  Etude d'un processus d'auto-organisation , 1987 .

[3]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[4]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[5]  T. Takahashi,et al.  The neural coding of auditory space. , 1989, The Journal of experimental biology.

[6]  Ron Cole,et al.  The ISOLET spoken letter database , 1990 .

[7]  Ronald A. Cole,et al.  Spoken Letter Recognition , 1990, HLT.

[8]  Thomas G. Dietterich,et al.  Error-Correcting Output Codes: A General Method for Improving Multiclass Inductive Learning Programs , 1991, AAAI.

[9]  J. Kaas.  Plasticity of sensory and motor maps in adult mammals. , 1991, Annual review of neuroscience.

[10]  Chih-Cheng Chen,et al.  A combined optimization method for solving the inverse kinematics problems of mechanical manipulators , 1991, IEEE Trans. Robotics Autom..

[11]  Helge J. Ritter,et al.  Neural computation and self-organizing maps - an introduction , 1992, Computation and neural systems series.

[12]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[13]  Tomohiro Nakatani,et al.  Auditory Stream Segregation in Auditory Scene Analysis with a Multi-Agent System , 1994, AAAI.

[14]  N. Ohnishi,et al.  A biomimetic system for localization and separation of multiple sound sources , 1994, Conference Proceedings. 10th Anniversary. IMTC/94. Advanced Technologies in I & M. 1994 IEEE Instrumentation and Measurement Technolgy Conference (Cat. No.94CH3424-9).

[15]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[16]  Christopher M. Bishop,et al.  GTM: A Principled Alternative to the Self-Organizing Map , 1996, NIPS.

[17]  Wolfgang Rosenstiel,et al.  Varying cooperation in SOM for improved function approximation , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[18]  James L. Flanagan,et al.  DSP implementation of source location using microphone arrays , 1996, Optics & Photonics.

[19]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[20]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[21]  Gilles Pagès,et al.  Theoretical aspects of the SOM algorithm , 1998, Neurocomputing.

[22]  Karin Haese,et al.  Kalman Filter Implementation of Self-Organizing Feature Maps , 1999, Neural Computation.

[23]  William M. Hartmann,et al.  How we localize sound , 1999 .

[24]  Gerald M. Edelman,et al.  Adaptation of orienting behavior: from the barn owl to a robotic system , 1999, IEEE Trans. Robotics Autom..

[25]  Senén Barro,et al.  SOAN: Self Organizing with Adaptive Neighborhood Neural Network , 1999, IWANN.

[26]  Reza Safabakhsh,et al.  TASOM: the time adaptive self-organizing map , 2000, Proceedings International Conference on Information Technology: Coding and Computing (Cat. No.PR00540).

[27]  Hiroaki Kitano,et al.  Active audition system and humanoid exterior design , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[28]  H. Kitano,et al.  Humanoid Active Audition System , 2000 .

[29]  Hiroaki Kitano,et al.  Active Audition for Humanoid , 2000, AAAI/IAAI.

[30]  Geoffrey J. Goodhill,et al.  Auto-SOM: Recursive Parameter Estimation for Guidance of Self-Organizing Feature Maps , 2001, Neural Computation.

[31]  J. Cruysberg,et al.  Two-dimensional sound-localization behavior of early-blind humans , 2001, Experimental Brain Research.

[32]  Kevin Warwick,et al.  The plastic self organising map , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[33]  Noboru Ohnishi,et al.  Self-organization of a sound source localization robot by perceptual cycle , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[34]  Hiroaki Kitano,et al.  Real-time sound source localization and separation for robot audition , 2002, INTERSPEECH.

[35]  Reza Safabakhsh,et al.  TASOM: a new time adaptive self-organizing map , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[36]  A. Piperno,et al.  2003 , 2003, Intensive Care Medicine.

[37]  Paulo J. G. Lisboa,et al.  Selective smoothing of the generative topographic mapping , 2003, IEEE Trans. Neural Networks.

[38]  Hiroaki Kitano,et al.  Robot recognizes three simultaneous speech by active audition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[39]  E. Berglund,et al.  The Parameter-Less SOM Algorithm , 2003 .

[40]  Kate Smith-Miles,et al.  A noisy self-organizing neural network with bifurcation dynamics for combinatorial optimization , 2004, IEEE Transactions on Neural Networks.

[41]  Zhen Zhu,et al.  Self-organizing learning array , 2005, IEEE Transactions on Neural Networks.

[42]  Frédéric Maire,et al.  Bearing Similarity Measures for Self-organizing Feature Maps , 2005, IDEAL.

[43]  Erik Berglund,et al.  Graphics Hardware Implementation of the Parameter-Less Self-organising Map , 2005, IDEAL.

[44]  Noboru Ohnishi,et al.  Building ears for robots: Sound localization and separation , 1997, Artificial Life and Robotics.

[45]  H. Robbins.  A Stochastic Approximation Method , 1951 .