Improving throughput via slowdowns

Many service-oriented systems are not well equipped to guarantee that service time is optimized. We have specifically examined two industrial systems which implement service-oriented architectures in real, field environments. We discovered that both were not engineered to properly address surges in service request rate. In the absence of an integral solution, it is difficult and costly to (re-) engineer such a solution in the field. The challenge faced by this study was to deliver a low cost solution, without re-engineering the target systems. This paper introduces such a generic solution. The solution slows-down some components to deliver improvement in request service time. It was implemented, tested, and successfully applied to two industrial systems with no need to modify their logic or architecture. Experiments with those systems exhibited significant improvement in performance. These results have validated our solution and its industrial applicability across systems and environments.

[1]  Shmuel Ur,et al.  ConTest listeners: a concurrency-oriented infrastructure for Java test and heal tools , 2007, SOQUA '07.

[2]  David E. Culler,et al.  SEDA: an architecture for well-conditioned, scalable internet services , 2001, SOSP.

[3]  Kwei-Jay Lin.  Introduction by Editor-In-Chief , 2007, Service Oriented Computing and Applications.

[4]  Onn Shehory,et al.  PANACEA Towards a Self-healing Development Framework , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.

[5]  Sugih Jamin,et al.  A measurement-based admission-controlled Web server , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[6]  Thomas Erl,et al.  SOA Principles of Service Design , 2007 .

[7]  Pedro Furtado,et al.  Deadline and Throughput-Aware Control for Request Processing Systems , 2007, ISPA.

[8]  Markus G. Kuhn,et al.  Analysis of a denial of service attack on TCP , 1997, Proceedings. 1997 IEEE Symposium on Security and Privacy (Cat. No.97CB36097).

[9]  Gero Mühl,et al.  Fair overload handling using proof-of-work functions , 2006, International Symposium on Applications and the Internet (SAINT'06).

[10]  Chandra Kopparapu,et al.  Load Balancing Servers, Firewalls, and Caches , 2002 .

[11]  Eitan Farchi,et al.  Multithreaded Java program test generation , 2001, JGI '01.

[12]  John Zic,et al.  Explicitly Controlling the Fair Service for Busy Web Servers , 2007, 2007 Australian Software Engineering Conference (ASWEC'07).