The Different Physical Mechanisms that Drive the Star-Formation Histories of Giant and Dwarf Galaxies