Average-Case and Smoothed Competitive Analysis of the Multilevel Feedback Algorithm

In this paper, we introduce the notion of smoothed competitive analysis of online algorithms. Smoothed analysis has been proposed by Spielman and Teng [25] to explain the behavior of algorithms that work well in practice while performing very poorly from a worst-case analysis point of view. We apply this notion to analyze the multilevel feedback algorithm (MLF) to minimize the total flow time on a sequence of jobs released over time when the processing time of a job is only known at time of completion. The initial processing times are integers in the range [1, 2K]. We use a partial bit randomization model, i.e., the initial processing times are smoothed by changing the k least significant bits under a quite general class of probability distributions. We show that MLF admits a smoothed competitive ratio of O((2k/)3 (2k/)2 2K-k), where denotes the standard deviation of the distribution. In particular, we obtain a competitive ratio of O(2K-k) if (2k). We also prove an (2K-k) lower bound for any deterministic algorithm that is run on processing times smoothed according to the partial bit randomization model. For various other smoothing models, including the additive symmetric smoothing one, which is a variant of the model used by Spielman and Teng [25], we give a higher lower bound of (2K). A direct consequence of our result is also the first average-case analysis of MLF. We show a constant expected ratio of the total flow time of MLF to the optimum under several distributions including the uniform one.

[1]  Stefano Leonardi,et al.  Approximating total flow time on parallel machines , 1997, STOC '97.

[2]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[3]  René Beier,et al.  Typical properties of winners and losers in discrete optimization , 2004, STOC '04.

[4]  Shang-Hua Teng,et al.  Smoothed analysis of termination of linear programming algorithms , 2003, Math. Program..

[5]  Gary J. Nutt Operating system projects using Windows NT , 1998 .

[6]  Kurt Mehlhorn,et al.  Smoothed Analysis of Three Combinatorial Problems , 2003, MFCS.

[7]  Robert E. Tarjan,et al.  Amortized efficiency of list update and paging rules , 1985, CACM.

[8]  Edward G. Coffman,et al.  Synthesis of a Feedback Queueing Discipline for Computer Operation , 1974, JACM.

[9]  Bala Kalyanasundaram,et al.  Speed is as powerful as clairvoyance , 2000, JACM.

[10]  Bala Kalyanasundaram,et al.  Minimizing flow time nonclairvoyantly , 2003, JACM.

[11]  Allan Borodin,et al.  Competitive paging with locality of reference , 1991, STOC '91.

[12]  Rajeev Motwani,et al.  Non-clairvoyant scheduling , 1994, SODA '93.

[13]  René Beier,et al.  Computing equilibria for congestion games with (im)perfect information , 2004, SODA '04.

[14]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[15]  Angelika Steger,et al.  A new average case analysis for completion time scheduling , 2002, STOC '02.

[16]  Noga Alon,et al.  The Probabilistic Method, Second Edition , 2004 .

[17]  René Beier,et al.  Random knapsack in expected polynomial time , 2004, J. Comput. Syst. Sci..

[18]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[19]  Christos H. Papadimitriou,et al.  Beyond competitive analysis [on-line algorithms] , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[20]  Luca Becchetti,et al.  Nonclairvoyant scheduling to minimize the total flow time on single and parallel machines , 2004, JACM.

[21]  G. Grimmett,et al.  Probability and random processes , 2002 .

[22]  Daniel A. Spielman The Smoothed Analysis of Algorithms , 2005, FCT.

[23]  John Dunagan,et al.  Smoothed analysis of the perceptron algorithm for linear programming , 2002, SODA '02.

[24]  D. Spielman,et al.  Smoothed analysis of algorithms: Why the simplex algorithm usually takes polynomial time , 2004 .

[25]  René Beier,et al.  Typical Properties of Winners and Losers in Discrete Optimization , 2006, SIAM J. Comput..

[26]  Linus Schrage,et al.  Letter to the Editor - A Proof of the Optimality of the Shortest Remaining Processing Time Discipline , 1968, Oper. Res..

[27]  Luca Becchetti,et al.  Average case and smoothed competitive analysis of the multi-level feedback algorithm , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..