The tail at scale

Software techniques that tolerate latency variability are vital to building responsive large-scale Web services.