On calculating gradient matrices

The purpose of this correspondence is to give mnemotechnic rules for calculating gradient matrices, i.e., the first derivative of a scalar-valued function with respect to a matrix.