A microscopic model of ballistic-diffusive crossover