Control of Stochastic Service Systems Based on Present Delay.

Abstract : Optimization of two service systems is studied. Both are described by linear stochastic difference equations, with the performance interval terminating at the first passage of the state out of a specified region. The waiting time (for repair of parts or for vehicles to pass a traffic jam) is observed by a controller which decides between two possible modes of service. In one case an extra repairman can be employed, with an extra cost, to speed the emptying of the repair waiting line. In the absence of control the busy waiting line duration is a linear function of the state. In the other case, the traffic controller may divert vehicles from the road having the jam, with a corresponding penalty cost, to reduce the total delay to all drivers caught in the jam. (Modified author abstract)