Testing Architectures for Large Scale Systems

Typical distributed testing architectures decompose test cases in actions and dispatch them to different nodes. They use a central test controller to synchronize the action execution sequence. This architecture is not fully adapted to large scale distributed systems, since the central controller does not scale up. This paper presents two approaches to synchronize the action execution sequence in a distributed manner. The first approach organizes the testers in a B-tree manner synchronizing through messages exchanged among parents and children. The second approach synchronizes through gossiping messages exchanged among consecutive testers. We compare these two approaches and discuss their advantages and drawbacks.

[1]  Kai Chen,et al.  A new method of generating synchronizable test sequences that detect output-shifting faults based on multiple UIO sequences , 2006, SAC '06.

[2]  Francisco Brasileiro,et al.  GridUnit : Using the Computational Grid to Speed up Software Testing , 2005 .

[3]  Jean-Marc Jézéquel,et al.  Test Synthesis from UML Models of Distributed Software , 2007, IEEE Transactions on Software Engineering.

[4]  Karl Aberer,et al.  P-Grid: a self-organizing structured P2P system , 2003, SGMD.

[5]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[6]  Ian T. Foster,et al.  On Death, Taxes, and the Convergence of Peer-to-Peer and Grid Computing , 2003, IPTPS.

[7]  Aggelos Kiayias,et al.  Polynomial Reconstruction Based Cryptography , 2001, Selected Areas in Cryptography.

[8]  Hartmut König,et al.  Architectures for Testing Distributed Systems , 1999, IWTCS.

[9]  Xiao Qin,et al.  Dynamic, reliability-driven scheduling of parallel real-time jobs in heterogeneous systems , 2001, International Conference on Parallel Processing, 2001..

[10]  Ina Schieferdecker,et al.  Conformance Testing of TINA Service Components - The TTCN/ CORBA Gateway , 1998, IS&N.

[11]  Rudolf Bayer,et al.  Organization and maintenance of large ordered indexes , 1972, Acta Informatica.

[12]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[13]  Hasan Ural,et al.  Synchronizable test sequences based on multiple UIO sequences , 1995, TNET.

[14]  Ion Stoica,et al.  Peer-to-Peer Systems II , 2003, Lecture Notes in Computer Science.

[15]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[16]  Francisco Vilar Brasileiro,et al.  GridUnit: software testing on the grid , 2006, ICSE.

[17]  Erik Hagersten,et al.  THROOM — Supporting POSIX Multithreaded Binaries on a Cluster , 2003 .

[18]  Gregory M. Kapfhammer.  Automatically and Transparently Distributing the Execution of Regression Test Suites , 2000 .

[19]  Claude Jard.  Principles of Distributed Test Synthesis based on True-concurrency Models , 2002, TestCom.

[20]  P. Sadayappan,et al.  Distributed job scheduling on computational Grids using multiple simultaneous requests , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[21]  Francisco Vilar Brasileiro,et al.  Trading Cycles for Information: Using Replication to Schedule Bag-of-Tasks Applications on Computational Grids , 2003, Euro-Par.

[22]  Jianmin Wang,et al.  GFS-Btree: A Scalable Peer-to-Peer Overlay Network for Lookup Service , 2003, GCC.

[23]  Arun Jagatheesan,et al.  Data grid management systems , 2003, SIGMOD '03.

[24]  Patrick Valduriez,et al.  Action synchronization in P2P system testing , 2008, DaMaP '08.

[25]  Robert M. Hierons.  Testing a distributed system: generating minimal synchronised test sequences that detect output-shifting faults , 2001, Inf. Softw. Technol..

[26]  Thierry Jéron,et al.  A tool for the automatic synthesis of conformance test cases for non-deterministic reactive systems , 2005 .

[27]  Mario Lauria,et al.  The organic grid: self-organizing computation on a peer-to-peer network , 2004 .

[28]  Gunther Chrobok-Diening,et al.  Test Architectures for Testing Distributed Systems , 1999 .

[29]  Jean-Marc Jézéquel,et al.  Design by Contract to Improve Software Vigilance , 2006, IEEE Transactions on Software Engineering.