Origin of the large-scale galaxy peculiar velocity field: a minimal isocurvature model