Hidden structures of knot invariants