Small Models are Valuable Plug-ins for Large Language Models