Quaternionic Multilayer Perceptron with Local Analyticity

A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons' states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights of the network.

[1]  Naotake Kamiura,et al.  On the Scheme of Quaternionic Multistate Hopfield Neural Network , 2008 .

[2]  Thomas L. Hankins,et al.  Sir William Rowan Hamilton , 1980 .

[3]  T. Nitta,et al.  A Solution to the 4-bit Parity Problem with a Single Quaternary Neuron , 2004 .

[4]  Gerald Sommer,et al.  Quaternionic spinor MLP , 2000, ESANN.

[5]  William Rowan Hamilton,et al.  Lectures on quaternions , 1853 .

[6]  Danilo P. Mandic,et al.  Quaternion-Valued Nonlinear Adaptive Filtering , 2011, IEEE Transactions on Neural Networks.

[7]  C. Schwartz.  Calculus with a quaternionic variable , 2008, 0812.1185.

[8]  Akira Hirose,et al.  Complex-Valued Neural Networks: Theories and Applications , 2003 .

[9]  Nobuyuki Matsui,et al.  Quaternionic Neural Networks: Fundamental Properties and Applications , 2009 .

[10]  W. Wirtinger.  Zur formalen Theorie der Funktionen von mehr komplexen Veränderlichen , 1927 .

[11]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[12]  Soo-Chang Pei,et al.  Commutative reduced biquaternions and their Fourier transform for signal and image processing applications , 2004, IEEE Transactions on Signal Processing.

[13]  Paolo Zampetti,et al.  An Introduction to Commutative Quaternions , 2006 .

[14]  Naotake Kamiura,et al.  Associative Memory in quaternionic Hopfield Neural Network , 2008, Int. J. Neural Syst..

[15]  Nobuyuki Matsui,et al.  On the fundamental properties of fully quaternionic hopfield network , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[16]  廣瀬 明,et al.  Complex-valued neural networks : theories and applications , 2003 .

[17]  Naotake Kamiura,et al.  Dynamics of Discrete-Time Quaternionic Hopfield Neural Networks , 2007, ICANN.

[18]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[19]  Ben Kenwright.  From Classical Mechanics to Computer Graphics and Beyond , 2012 .

[20]  R. Mukundan.  Quaternions : From Classical Mechanics to Computer Graphics , and Beyond , 2002 .

[21]  John A. Vince.  Mathematics for Computer Graphics , 2014, Undergraduate Topics in Computer Science.

[22]  Akira Hirose,et al.  Continuous complex-valued back-propagation learning , 1992 .

[23]  Tülay Adali,et al.  Approximation by Fully Complex Multilayer Perceptrons , 2003, Neural Computation.

[24]  Jack B. Kuipers,et al.  Quaternions and Rotation Sequences: A Primer with Applications to Orbits, Aerospace and Virtual Reality , 2002 .

[25]  Naotake Kamiura,et al.  Fundamental Properties of Quaternionic Hopfield Neural Network , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[26]  Yasuaki Kuroe,et al.  Models of hopfield-type quaternion neural networks and their energy functions , 2005, Int. J. Neural Syst..

[27]  Tohru Nitta.  Complex-valued Neural Networks: Utilizing High-dimensional Parameters , 2009 .

[28]  S. Leo,et al.  Local Hypercomplex Analyticity , 1997, funct-an/9703002.

[29]  C. M. Davenport,et al.  A commutative hypercomplex algebra with associated function theory , 1996 .

[30]  Nobuyuki Matsui,et al.  An iterative learning scheme for multistate complex-valued and quaternionic Hopfield neural networks , 2009, 2009 International Joint Conference on Neural Networks.

[31]  T. Nitta.  An Extension of the Back-propagation Algorithm to Quaternions , 1996 .

[32]  Giovanni Muscato,et al.  Multilayer Perceptrons to Approximate Quaternion Valued Functions , 1997, Neural Networks.

[33]  Akira Hirose,et al.  Complex-Valued Neural Networks , 2006, Studies in Computational Intelligence.

[34]  Cris Koutsougeras,et al.  Complex domain backpropagation , 1992 .

[35]  Nobuyuki Matsui,et al.  Quaternion neural network with geometrical operators , 2004, J. Intell. Fuzzy Syst..

[36]  Hiromi Kusamichi,et al.  A New Scheme for Color Night Vision by Quaternion Neural Network , 2004 .

[37]  Nobuyuki Matsui,et al.  Commutative quaternion and multistate Hopfield neural networks , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[38]  Danilo P. Mandic,et al.  A Quaternion Gradient Operator and Its Applications , 2011, IEEE Signal Processing Letters.