Concepts, Methods, and Performances of Particle Swarm Optimization, Backpropagation, and Neural Networks

With the advancement of Machine Learning, since its beginning and over the last years, a special attention has been given to the Artificial Neural Network. As an inspiration from natural selection of animal groups and human’s neural system, the Artificial Neural Network also known as Neural Networks has become the new computational power which is used for solving real world problems. Neural Networks alone as a concept involve various methods for achieving their success; thus, this review paper describes an overview of such methods called Particle Swarm Optimization, Backpropagation, and Neural Network itself, respectively. A brief explanation of the concepts, history, performances, advantages, and disadvantages is given, followed by the latest researches done on these methods. A description of solutions and applications on various industrial sectors such as Medicine or Information Technology has been provided. The last part briefly discusses the directions, current, and future challenges of Neural Networks towards achieving the highest success rate in solving real world problems.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Subhi R. M. Zeebaree,et al.  A Survey and Analysis of the Image Encryption Methods , 2017 .

[3]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[4]  Andries Petrus Engelbrecht,et al.  Cooperative learning in neural networks using particle swarm optimizers , 2000, South Afr. Comput. J..

[5]  Siti Mariyam Shamsuddin,et al.  Particle Swarm Optimization: Technique, System and Challenges , 2011 .

[6]  Sonali,et al.  Research Paper on Basic of Artificial Neural Network , 2014 .

[7]  Mohammed Hazim Alkawaz,et al.  Lip syncing method for realistic expressive 3D face model , 2018, Multimedia Tools and Applications.

[8]  Muhammad Moinuddin,et al.  Automatic classification of speech and music using neural networks , 2004, MMDB '04.

[9]  Tai-Hoon Cho,et al.  Fast backpropagation learning using steep activation functions and automatic weight reinitialization , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[10]  R. Stephenson.  A and V , 1962, The British journal of ophthalmology.

[11]  Man Ieee Systems.  IEEE transactions on systems, man and cybernetics , 1971 .

[12]  Christian Blum,et al.  Swarm Intelligence: Introduction and Applications , 2008, Swarm Intelligence.

[13]  Siti Zaiton Mohd Hashim,et al.  Improved SpikeProp for using particle swarm optimization , 2013 .

[14]  Samy Bengio,et al.  Understanding deep learning requires rethinking generalization , 2016, ICLR.

[15]  Rabab Alayham Abbas Helmi,et al.  Improving Time Series' Forecast Errors by Using Recurrent Neural Networks , 2018, ICSCA.

[16]  C.K. Mohan,et al.  Training feedforward neural networks using multi-phase particle swarm optimization , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[17]  Ghazali Sulong,et al.  Detection of copy-move image forgery based on discrete cosine transform , 2016, Neural Computing and Applications.

[18]  Siti Zaiton Mohd Hashim,et al.  Automated kinship verification and identification through human facial images: a survey , 2015, Multimedia Tools and Applications.

[19]  Angelos P. Markopoulos,et al.  On the use of back propagation and radial basis function neural networks in surface roughness prediction , 2016 .

[20]  Halenar Igor,et al.  on Intelligent Manufacturing and Automation , 2013 Application of Neural Networks in Computer Security , 2014 .