Restrained utilization of idleness for transparent scheduling of background tasks

A common practice in system design is to treat features intended to enhance performance and reliability as low priority tasks by scheduling them during idle periods, with the goal to keep these features transparent to the user. In this paper, we present an algorithmic framework that determines the schedulability of non-preemptable low priority tasks in storage systems. The framework estimates when and for how long idle times can be utilized by low priority background tasks, without violating pre-defined performance targets of user foreground tasks. The estimation is based on monitored system information that includes the histogram of idle times. This histogram captures accurately important statistical characteristics of the complex demands of the foreground activity. The robustness and the effectiveness of the proposed framework is corroborated via extensive trace driven simulations under a wide range of system conditions and background activities, and via experimentation on a Linux kernel 2.6.22 prototype.

[1]  M. Dahlin,et al.  TCP Nice: a mechanism for background transfers , 2002, OSDI '02.

[2]  Alma Riska,et al.  Disk Drive Level Workload Characterization , 2006, USENIX Annual Technical Conference, General Track.

[3]  Spencer W. Ng,et al.  Disk scrubbing in large archival storage systems , 2004, The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings..

[4]  William J. Bolosky,et al.  Progress-based regulation of low-importance processes , 1999, SOSP.

[5]  Darrell D. E. Long,et al.  Adaptive disk spin‐down for mobile computers , 2000, Mob. Networks Appl..

[6]  Michael K. Reiter,et al.  Lazy verification in fault-tolerant distributed storage systems , 2005, 24th IEEE Symposium on Reliable Distributed Systems (SRDS'05).

[7]  Joseph D. Touch,et al.  Idletime scheduling with preemption intervals , 2005, SOSP '05.

[8]  Gregory R. Ganger,et al.  Awarded Best Student Paper! -- A Framework for Building Unobtrusive Disk Maintenance Applications , 2004 .

[9]  Alma Riska,et al.  Idle Read After Write - IRAW , 2008, USENIX Annual Technical Conference.

[10]  Qi Zhang,et al.  Efficient management of idleness in storage systems , 2009, TOS.

[11]  Shankar Pasupathy,et al.  An analysis of latent sector errors in disk drives , 2007, SIGMETRICS '07.

[12]  Evangelos Eleftheriou,et al.  Disk scrubbing versus intra-disk redundancy for high-reliability raid storage systems , 2008, SIGMETRICS '08.

[13]  Eitan Bachmat,et al.  Analysis of methods for scheduling low priority disk drive tasks , 2002, SIGMETRICS '02.

[14]  Fred Douglis,et al.  Adaptive Disk Spin-Down Policies for Mobile Computers , 1995, Comput. Syst..

[15]  Qi Zhang,et al.  Efficient management of idleness in systems , 2007, SIGMETRICS '07.

[16]  Philip S. Yu,et al.  An Analytical Model of Reconstruction Time in Mirrored Disks , 1994, Perform. Evaluation.

[17]  Peter J. Varman,et al.  pClock: an arrival curve based approach for QoS guarantees in shared storage systems , 2007, SIGMETRICS '07.

[18]  Jae-Myung Kim,et al.  A case for flash memory ssd in enterprise database applications , 2008, SIGMOD Conference.

[19]  Adam Leventhal,et al.  Flash storage memory , 2008, CACM.

[20]  Andrea C. Arpaci-Dusseau,et al.  Association Proceedings of the Third USENIX Conference on File and Storage Technologies San Francisco , CA , USA March 31 – April 2 , 2004 , 2004 .

[21]  Kang G. Shin,et al.  FS2: dynamic data replication in free disk space for improving disk performance and energy consumption , 2005, SOSP '05.

[22]  Gregory R. Ganger,et al.  A Framework for Building Unobtrusive Disk Maintenance Applications (CMU-CS-03-192) , 2004 .

[23]  Andrea C. Arpaci-Dusseau,et al.  Awarded Best Student Paper! -- Improving Storage System Availability with D-GRAID , 2004 .

[24]  Carl Staelin,et al.  Idleness is Not Sloth , 1995, USENIX.

[25]  Zhisheng Niu,et al.  A vacation queue with setup and close-down times and batch Markovian arrival processes , 2003, Perform. Evaluation.