Asymptotics of work distributions in a stochastically driven system