Mass-dependent Color Evolution of Field Galaxies back to z ~ 3 over the Wide Range of Stellar Mass