Fast quantum control and light-matter interactions at the 10,000 quanta level