Advanced Learning Algorithms of Neural Networks

......................................................................................................................................... ii Acknowledgments ......................................................................................................................... iv List of Tables .............................................................................................................................. viii List of Figures ................................................................................................................................ x Chapter 1 Why Neural Networks ................................................................................................... 1 1.

[1]  Bogdan M. Wilamowski,et al.  Solving parity-N problems with feedforward neural networks , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[2]  M. R. Osborne.  Fisher's Method of Scoring , 1992 .

[3]  Frank L. Lewis,et al.  Adaptive Approximation Based Control-Unifying Neural, Fuzzy and Traditional Adaptive Approximation Approaches-[Book review; J. A. Farrell and M. M. Polycarpou] , 2007 .

[4]  Rong-Jong Wai,et al.  Real-Time PID Control Strategy for Maglev Transportation System via Particle Swarm Optimization , 2011, IEEE Transactions on Industrial Electronics.

[5]  Bogdan Wilamowski,et al.  Replacing fuzzy systems with neural networks , 2010, 3rd International Conference on Human System Interaction.

[6]  Bimal K. Bose,et al.  Neural Network Applications in Power Electronics and Motor Drives—An Introduction and Perspective , 2007, IEEE Transactions on Industrial Electronics.

[7]  Howard B. Demuth,et al.  Neutral network toolbox for use with Matlab , 1995 .

[8]  Sheng Wan,et al.  Parameter Incremental Learning Algorithm for Neural Networks , 2006, IEEE Transactions on Neural Networks.

[9]  P. S. Sastry,et al.  Analysis of the back-propagation algorithm with momentum , 1994, IEEE Trans. Neural Networks.

[10]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[11]  George W. Irwin,et al.  A New Jacobian Matrix for Optimal Learning of Single-Layer Neural Networks , 2008, IEEE Transactions on Neural Networks.

[12]  Hao Yu,et al.  Neural Network Learning Without Backpropagation , 2010, IEEE Transactions on Neural Networks.

[13]  Zengqiang Chen,et al.  New Chaotic PSO-Based Neural Network Predictive Control for Nonlinear Process , 2007, IEEE Transactions on Neural Networks.

[14]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[15]  Kok-Meng Lee,et al.  Thermohydraulic Dynamics and Fuzzy Coordination Control of a Microchannel Cooling Network for Space Electronics , 2011, IEEE Transactions on Industrial Electronics.

[16]  Bogdan M. Wilamowski,et al.  Compensation of Nonlinearities Using Neural Networks Implemented on Inexpensive Microcontrollers , 2011, IEEE Transactions on Industrial Electronics.

[17]  Roy Batruni,et al.  A multilayer neural network with piecewise-linear structure and back-propagation learning , 1991, IEEE Trans. Neural Networks.

[18]  S. Sathiya Keerthi,et al.  Parallel sequential minimal optimization for the training of support vector machines , 2006, IEEE Trans. Neural Networks.

[19]  Derong Liu,et al.  Solving the N-bit parity problem using neural networks , 1999, Neural Networks.

[20]  Hao Yu,et al.  Levenberg—Marquardt Training , 2011 .

[21]  Kit Po Wong,et al.  A Self-Adaptive RBF Neural Network Classifier for Transformer Fault Analysis , 2010, IEEE Transactions on Power Systems.

[22]  Bogdan M. Wilamowski,et al.  Human factor and computational intelligence limitations in resilient control systems , 2010, 2010 3rd International Symposium on Resilient Control Systems.

[23]  Robert B. Allen,et al.  Learning of stable states in stochastic asymmetric networks , 1990, IEEE Trans. Neural Networks.

[24]  Hao Yu,et al.  Neural Network Trainer through Computer Networks , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[25]  Hao Yu,et al.  Neural Network Training with Second Order Algorithms , 2012 .

[26]  Damian Giaouris,et al.  Sensorless Control of Induction Motor Drives at Very Low and Zero Speeds Using Neural Network Flux Observers , 2009, IEEE Transactions on Industrial Electronics.

[27]  Yeon Ju Lee,et al.  Nonlinear Image Upsampling Method Based on Radial Basis Function Interpolation , 2010, IEEE Transactions on Image Processing.

[28]  Tommy W. S. Chow,et al.  Induction machine fault detection using SOM-based RBF neural networks , 2004, IEEE Transactions on Industrial Electronics.

[29]  Edward A. Rietman,et al.  Back-propagation learning and nonidealities in analog neural network hardware , 1991, IEEE Trans. Neural Networks.

[30]  Kok Kiong Tan,et al.  Fault Detection and Diagnosis Based on Modeling and Estimation Methods , 2009, IEEE Transactions on Neural Networks.

[31]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[32]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[33]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[34]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[35]  Fayez F. M. El-Sousy,et al.  Hybrid ${\rm H}^{\infty}$-Based Wavelet-Neural-Network Tracking Control for Permanent-Magnet Synchronous Motor Servo Drives , 2010, IEEE Transactions on Industrial Electronics.

[36]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[37]  Snehasis Mukhopadhyay,et al.  Associative learning in random environments using neural networks , 1991, IEEE Trans. Neural Networks.

[38]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[39]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[40]  Alexander Gammerman,et al.  Ridge Regression Learning Algorithm in Dual Variables , 1998, ICML.

[41]  J. Farrell,et al.  Adaptive Approximation Based Control: Unifying Neural, Fuzzy and Traditional Adaptive Approximation Approaches (Adaptive and Learning Systems for Signal Processing, Communications and Control Series) , 2006 .

[42]  Bogdan Wilamowski,et al.  Comparison of different neural network architectures for digit image recognition , 2011, 2011 4th International Conference on Human System Interactions, HSI 2011.

[43]  Wei Qiao,et al.  Fault-Tolerant Indirect Adaptive Neurocontrol for a Static Synchronous Series Compensator in a Power Network With Missing Sensor Measurements , 2008, IEEE Transactions on Neural Networks.

[44]  Hao Yu,et al.  Advantages of Radial Basis Function Networks for Dynamic System Design , 2011, IEEE Transactions on Industrial Electronics.

[45]  Kay Chen Tan,et al.  Hybrid Multiobjective Evolutionary Design for Artificial Neural Networks , 2008, IEEE Transactions on Neural Networks.

[46]  Hao Yu,et al.  Neuro-Fuzzy System , 2011, IEEE International Conference on Intelligent Systems.

[47]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[48]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[49]  Patrick A. Shoemaker,et al.  A note on least-squares learning procedures and classification by neural network models , 1991, IEEE Trans. Neural Networks.

[50]  P. J. Werbos,et al.  Backpropagation: past and future , 1988, IEEE 1988 International Conference on Neural Networks.

[51]  Frank L. Lewis,et al.  Disturbance and Friction Compensations in Hard Disk Drives Using Neural Networks , 2010, IEEE Transactions on Industrial Electronics.

[52]  M. Azizur Rahman,et al.  Implementation of a Wavelet-Based MRPID Controller for Benchmark Thermal System , 2010, IEEE Transactions on Industrial Electronics.

[53]  Vincenzo Piuri,et al.  A Hierarchical RBF Online Learning Algorithm for Real-Time 3-D Scanner , 2010, IEEE Transactions on Neural Networks.

[54]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[55]  Xiao-Jun Zeng,et al.  An Instance-Based Algorithm With Auxiliary Similarity Information for the Estimation of Gait Kinematics From Wearable Sensors , 2008, IEEE Transactions on Neural Networks.

[56]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[57]  Bogdan Wilamowski,et al.  Comparison between traditional neural networks and radial basis function networks , 2011, 2011 IEEE International Symposium on Industrial Electronics.

[58]  Stephen I. Gallant,et al.  Perceptron-based learning algorithms , 1990, IEEE Trans. Neural Networks.

[59]  Changliang Xia,et al.  A Neural-Network-Identifier and Fuzzy-Controller-Based Algorithm for Dynamic Decoupling Control of Permanent-Magnet Spherical Motor , 2010, IEEE Transactions on Industrial Electronics.

[60]  Bogdan M. Wilamowski,et al.  Challenges in applications of computational intelligence in industrial electronics , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[61]  Jae Wook Jeon,et al.  Neural-Network-Based Low-Speed-Damping Controller for Stepper Motor With an FPGA , 2010, IEEE Transactions on Industrial Electronics.

[62]  Mehmet Fatih Tasgetiren,et al.  A discrete particle swarm optimization algorithm for the no-wait flowshop scheduling problem , 2008, Comput. Oper. Res..

[63]  R. Hecht-Nielsen,et al.  Theory of the Back Propagation Neural Network , 1989 .

[64]  Helge J. Ritter,et al.  Three-dimensional neural net for learning visuomotor coordination of a robot arm , 1990, IEEE Trans. Neural Networks.

[65]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[66]  Mohd Amran Mohd Radzi,et al.  Neural Network and Bandless Hysteresis Approach to Control Switched Capacitor Active Power Filter for Reduction of Harmonics , 2009, IEEE Transactions on Industrial Electronics.

[67]  Hao Yu,et al.  Fast and Efficient Second-Order Method for Training Radial Basis Function Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[68]  Abdellatif Miraoui,et al.  Current Harmonic Compensation by a Single-Phase Shunt Active Power Filter Controlled by Adaptive Neural Filtering , 2009, IEEE Transactions on Industrial Electronics.

[69]  Han-Pang Huang,et al.  Development and Fuzzy Control of a Pipe Inspection Robot , 2010, IEEE Transactions on Industrial Electronics.

[70]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[71]  Bogdan M. Wilamowski,et al.  Efficient and reliable training of neural networks , 2009, 2009 2nd Conference on Human System Interactions.

[72]  Bogdan M. Wilamowski,et al.  C++ implementation of neural networks trainer , 2009, 2009 International Conference on Intelligent Engineering Systems.

[73]  Abdesselam Bouzerdoum,et al.  Efficient training algorithms for a class of shunting inhibitory convolutional neural networks , 2005, IEEE Transactions on Neural Networks.

[74]  B.M. Wilamowski,et al.  Neural network architectures and learning algorithms , 2009, IEEE Industrial Electronics Magazine.

[75]  Hao Yu,et al.  Improved Computation for Levenberg–Marquardt Training , 2010, IEEE Transactions on Neural Networks.

[76]  Bogdan M. Wilamowski,et al.  Compensation of Sensors Nonlinearity with Neural Networks , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[77]  Tianyou Chai,et al.  Neural-Network-Based Terminal Sliding-Mode Control of Robotic Manipulators Including Actuator Dynamics , 2009, IEEE Transactions on Industrial Electronics.

[78]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[79]  Okyay Kaynak,et al.  Computing Gradient Vector and Jacobian Matrix in Arbitrarily Connected Neural Networks , 2008, IEEE Transactions on Industrial Electronics.

[80]  Jenq-Neng Hwang,et al.  Query-based learning applied to partially trained multilayer perceptrons , 1991, IEEE Trans. Neural Networks.

[81]  Hao Yu,et al.  Fast and efficient and training of neural networks , 2010, 3rd International Conference on Human System Interaction.

[82]  Adrião Duarte Dória Neto,et al.  A Neural Network Multiagent Architecture Applied to Industrial Networks for Dynamic Allocation of Control Strategies Using Standard Function Blocks , 2010, IEEE Transactions on Industrial Electronics.

[83]  R. Hecht-Nielsen.  Counterpropagation networks. , 1987, Applied optics.

[84]  Zheng Li.  Robust Control of PM Spherical Stepper Motor Based on Neural Networks , 2009, IEEE Transactions on Industrial Electronics.

[85]  Hao Yu,et al.  Parity- N Problems as a Vehicle to Compare Efficiencies of Neural Network Architectures , 2011 .

[86]  B.M. Wilamowski,et al.  Neural Network Trainer with Second Order Learning Algorithms , 2007, 2007 11th International Conference on Intelligent Engineering Systems.

[87]  Teresa Riesgo,et al.  Reconfigurable Hardware Architecture of a Shape Recognition System Based on Specialized Tiny Neural Networks With Online Training , 2009, IEEE Transactions on Industrial Electronics.

[88]  Hicham Chaoui,et al.  ANN-Based Adaptive Control of Robotic Manipulators With Friction and Joint Elasticity , 2009, IEEE Transactions on Industrial Electronics.

[89]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[90]  Bogdan M. Wilamowski.  Modified EBP algorithm with instant training of the hidden layer , 1997, Proceedings of the IECON'97 23rd International Conference on Industrial Electronics, Control, and Instrumentation (Cat. No.97CH36066).