Natural downsizing in hierarchical galaxy formation