THE GROWTH OF GALAXY STELLAR MASS WITHIN DARK MATTER HALOS