Large Datasets: A Mixed Method to Adapt and Improve Their Learning by Neural Networks Used in Regression Contexts

The purpose of this work is to further study the relevance of accelerating the Monte-Carlo calculations for the gamma rays external radiotherapy through feed-forward neural networks. We have previously presented a parallel incremental algorithm that builds neural networks of reduced size, while providing high quality approximations of the dose deposit [4]. Our parallel algorithm consists in an optimized decomposition of the initial learning dataset (also called learning domain) in as much subsets as available processors. However, although that decomposition provides subsets of similar signal complexities, their sizes may be quite different, still implying potential differences in their learning times. This paper presents an efficient data extraction allowing a good and balanced training without any loss of signal information. As will be shown, the resulting irregular decomposition permits an important improvement in the learning time of the global network.

[1]  Charles Soussen,et al.  Efficient Domain Decomposition for a Neural Network Learning Algorithm, Used for the Dose Evaluation in External Radiotherapy , 2010, ICANN.

[2]  Marek Grochowski,et al.  Comparison of Instance Selection Algorithms II. Results and Comments , 2004, ICAISC.

[3]  Jacques M. Bahi,et al.  An incremental learning algorithm for function approximation , 2009, Adv. Eng. Softw..

[4]  Steve W Blake Artificial neural network modelling of megavoltage photon dose distributions. , 2004, Physics in medicine and biology.

[5]  Lazaros S. Iliadis,et al.  Artificial Neural Networks - ICANN 2010 - 20th International Conference, Thessaloniki, Greece, September 15-18, 2010, Proceedings, Part I , 2010, International Conference on Artificial Neural Networks.

[6]  Keith J. Burnham,et al.  Intelligent and Adaptive Systems in Medicine , 2008 .

[7]  Michel Salomon,et al.  Avenir des nouveaux concepts des calculs dosimétriques basés sur les méthodes de Monte Carlo , 2009 .

[8]  John H. Goodband,et al.  Artificial neural networks in radiation therapy , 2008 .

[9]  Jacques M. Bahi,et al.  A Parallel Incremental Learning Algorithm for Neural Networks with Fault Tolerance , 2008, VECPAR.

[10]  Marc Toussaint,et al.  Extracting Motion Primitives from Natural Handwriting Data , 2006, ICANN.

[11]  Marek Grochowski,et al.  Comparison of Instances Seletion Algorithms I. Algorithms Survey , 2004, ICAISC.

[12]  Sylvain Contassot-Vivier,et al.  Dose calculations using artificial neural networks: A feasibility study for photon beams , 2008 .

[13]  Jacques M. Bahi,et al.  Neural Network Based Algorithm for Radiation Dose Evaluation in Heterogeneous Environments , 2006, ICANN.

[14]  Jörg H. Siekmann,et al.  Artificial Intelligence and Soft Computing - ICAISC 2004 , 2004, Lecture Notes in Computer Science.

[15]  Anthony K. H. Tung,et al.  Finding representative set from massive data , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[16]  William W. Hsieh,et al.  Neural network forecasts of the tropical Pacific sea surface temperatures , 2006, Neural Networks.

[17]  Jiang-She Zhang,et al.  A method to sparsify the solution of support vector regression , 2009, Neural Computing and Applications.

[18]  C. K. Chu,et al.  An interpolation method for adapting to sparse design in multivariate nonparametric regression , 2003 .