The Rest-Frame Ultraviolet Luminosity Density of Star-forming Galaxies at Redshifts z > 3.5