Overparameterization from Computational Constraints