Self-adjunctions and matrices