Surface Brightness Evolution of Galaxies in the CANDELS GOODS Fields up to z ∼ 6: High-z Galaxies Are Unique or Remain Undetected