Linear Chern-Simons-matter theories in the planar limit