Ballistic aggregation for one-sided Brownian initial velocity