Facing the Elephant in the Room: Visual Prompt Tuning or Full Finetuning?