Statistical-Based WCET Estimation and Validation

In this paper we present a measurement-based approach that produces both a WCET (Worst Case Execution Time) estimate, and a prediction of the probability that a future execution time will exceed our estimate. Our statistical-based approach uses extreme value theory to build a model of the tail behavior of the measured execution time value. We validate our approach using an industrial data set comprised of over 150 sampled components and nearly 200 million sample execution times. Each trace is divided into two segments, with one used to make the WCET estimate, and the second used check our prediction of the fraction of future execution time samples that exceed our WCET estimate. We show that compared to WCET estimates derived from the worst-case observed time, our WCET estimates significantly improve the ability to predict the probability that our WCET estimate is exceeded.

[1]  Alan Burns,et al.  Pipelined processors and worst case execution times , 1993, Real-Time Systems.

[2]  Daniel Plakosh,et al.  Predicting the Behavior of a Highly Configurable Component Based Real-Time System , 2008, 2008 Euromicro Conference on Real-Time Systems.

[3]  E. Gumbel,et al.  Statistics of extremes , 1960 .

[4]  J. Teugels,et al.  Statistics of Extremes , 2004 .

[5]  Sang Lyul Min,et al.  An Accurate Worst Case Timing Analysis for RISC Processors , 1995, IEEE Trans. Software Eng..

[6]  Guillem Bernat,et al.  WCET analysis of probabilistic hard real-time systems , 2002, 23rd IEEE Real-Time Systems Symposium, 2002. RTSS 2002..

[7]  Stefan M. Petters.  How much Worst Case is Needed in WCET Estimation ? , 2009 .

[8]  Kelly Leahy,et al.  Efficient Estimation of Tighter Bounds for Worst Case Execution Time of Programs , 2005 .

[9]  Nat Hillary,et al.  You Can ’ t Control what you Can ’ t Measure , OR Why it ’ s Close to Impossible to Guarantee Real-time Software Performance on a CPU with on-chip cache , 2002 .

[10]  Guillem Bernat,et al.  pWCET: a Tool for Probabilistic Worst-Case Execution Time Analysis of Real-Time Systems , 2003 .

[11]  Stefan M. Petters,et al.  Static analysis support for measurement-based WCET analysis , 2006 .

[12]  George Lima,et al.  Estimating Execution Time Probability Distributions in Component-based Real-Time Systems , 2008 .

[13]  Alan Burns,et al.  Statistical analysis of WCET for scheduling , 2001, Proceedings 22nd IEEE Real-Time Systems Symposium (RTSS 2001) (Cat. No.01PR1420).