Differential Calculus, Tensor Products and the Importance of Notation

An efficient coordinate-free notation is elucidated for differentiating matrix expressions and other functions between higher-dimensional vector spaces. This method of differentiation is known, but not explained well, in the literature. Teaching it early in the curriculum would avoid the tedium of element-wise differentiation and provide a better footing for understanding more advanced applications of calculus. Additionally, it is shown to lead naturally to tensor products, a topic previously considered too difficult to motivate quickly in elementary ways.

[1]  L. Fraenkel.  Formulae for high derivatives of composite functions , 1978, Mathematical Proceedings of the Cambridge Philosophical Society.

[2]  Jonathan H. Manton,et al.  Optimization algorithms exploiting unitary constraints , 2002, IEEE Trans. Signal Process..

[3]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[4]  U. Helmke,et al.  Optimization and Dynamical Systems , 1994, Proceedings of the IEEE.

[5]  Alex D. D. Craik,et al.  Prehistory of Faà di Bruno's Formula , 2005, Am. Math. Mon..

[6]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[7]  R. Ryan.  Introduction to Tensor Products of Banach Spaces , 2002 .

[8]  M. Marias.  Analysis on Manifolds , 2005 .

[9]  Michel McKiernan.  On the nth Derivative of Composite Functions , 1956 .

[10]  W. L. Burke.  Applied Differential Geometry , 1985 .

[11]  Michele Pavon,et al.  On the Geometry of Maximum Entropy Problems , 2011, SIAM Rev..

[12]  H. Piaggio.  Mathematical Analysis , 1955, Nature.

[13]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[14]  J. Robbin,et al.  Transversal mappings and flows , 2008 .

[15]  J. Langley,et al.  ON THE DERIVATIVES OF COMPOSITE FUNCTIONS , 2007 .

[16]  A. Bruckner,et al.  Some aspects of products of derivatives , 1992 .

[17]  Warren P. Johnson.  The Curious History of Faà di Bruno's Formula , 2002, Am. Math. Mon..

[18]  T. Yokonuma.  Tensor Spaces and Exterior Algebra , 1992 .

[19]  Harley Flanders,et al.  From Ford to Faà , 2001, Am. Math. Mon..

[20]  Formulas for higher-order Fre´chet derivatives of composite maps, implicitly defined maps and solutions of differential equations , 1991 .