Matrix and tensor witnesses of hidden symmetry algebras