Gravity and the non-linear growth of structure in the Carnegie-Spitzer-IMACS Redshift Survey