N-Particle-Simulations of Dust Growth: I. Growth Driven by Brownian Motion