Operator growth from global out-of-time-order correlators