Two scales in asynchronous ballistic annihilation