Debugging complex software systems by means of pathfinder networks

This paper introduces a new methodology based on the use of Pathfinder networks (PFNETs) for the debugging of multi-agent systems (MASs). This methodology is specifically designed to develop a forensic analysis (i.e. a debugging process performed on previously recorded data of the MAS run) of MASs showing complex tissues of relationships between agents (i.e. a high complexity in their social level). Like previous works in the field of forensic analysis of MASs, our approach is performed by considering displays of the system activity which aim to be understandable by human beings. These displays allow us to understand the social behavior of the system, discover emergent behaviors, and debug possible undesirable behaviors. However, it is well known that the visualization of information in a humanly comprehensible way becomes a complex task when large amounts of information have to be represented, as is the case of the social behavior of large-scale MASs. Our methodology tackles this problem through the use of PFNETs, which are considered to reduce the data complexity in order to obtain simple representations that show only the most important global interactions in the system. In addition, the proposed methodology is customizable thanks to the use of two thresholds allowing the user to define the desired specificity level in the display. The proposal is illustrated with a detailed case study considering a complex customer-seller MAS.

[1]  Alan S. Perelson,et al.  Agent-based modeling of host–pathogen systems: The successes and challenges , 2008, Information Sciences.

[2]  Nicholas R. Jennings,et al.  Developing Agent Interaction Protocols Using Graphical and Logical Methodologies , 2003, PROMAS.

[3]  William Zhu,et al.  Relationship between generalized rough sets based on binary relation and covering , 2009, Inf. Sci..

[4]  Uirá Kulesza,et al.  Unit testing in multi-agent systems using mock agents and aspects , 2006, SELMAS '06.

[5]  Arnaud Quirin,et al.  A quick MST-based algorithm to obtain Pathfinder networks (∞, n - 1) , 2008 .

[6]  Ana-Ramona Lupu Agent-Oriented Methodologies - A Comparative Analysis , 2004 .

[7]  Karl N. Levitt,et al.  The Design of GrIDS: A Graph-Based Intrusion Detection System , 2007 .

[8]  Michael Winikoff,et al.  Debugging multi-agent systems using design artifacts: the case of interaction protocols , 2002, AAMAS '02.

[9]  H. Van Dyke Parunak,et al.  Visualizing Agent Conversations: Using Enhanced Dooley Graphs for Agent Design and Analysis , 1996 .

[10]  Steven Johnson,et al.  Emergence: The Connected Lives of Ants, Brains, Cities, and Software , 2001 .

[11]  Félix de Moya Anegón,et al.  Visualizing the structure of science , 2007 .

[12]  Vikram Manikonda,et al.  Graph-based methods for the analysis of large-scale multiagent systems , 2009, AAMAS.

[13]  Abraham Kandel,et al.  The data mining approach to automated software testing , 2003, KDD '03.

[14]  Michael Winikoff,et al.  An exploration of bugs and debugging in multi-agent systems , 2003, AAMAS '03.

[15]  Russell Miles Aspectj Cookbook , 2004 .

[16]  Eugene H. Spafford,et al.  An Application of Pattern Matching in Intrusion Detection , 1994 .

[17]  Oscar Cordón,et al.  A new variant of the Pathfinder algorithm to generate large visual science maps in cubic time , 2008, Inf. Process. Manag..

[18]  Oscar Cordón,et al.  A quick MST-based algorithm to obtain Pathfinder networks (∞,n-1) , 2008, J. Assoc. Inf. Sci. Technol..

[19]  Martijn C. Schut,et al.  On model design for simulation of collective intelligence , 2010, Inf. Sci..

[20]  Rayford B. Vaughn,et al.  Software requirement understanding using Pathfinder networks: discovering and evaluating mental models , 2005, J. Syst. Softw..

[21]  Wei-Tek Tsai,et al.  On Testing and Evaluating Service-Oriented Software , 2008, Computer.

[22]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[23]  Satoru Kawai,et al.  An Algorithm for Drawing General Undirected Graphs , 1989, Inf. Process. Lett..

[24]  Chaomei Chen,et al.  Visualizing evolving networks: minimum spanning trees versus pathfinder networks , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[25]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.

[26]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[27]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[28]  Dahlia Malkhi,et al.  Using visualization tools to understand concurrency , 1992, IEEE Software.

[29]  Lori A. Clarke,et al.  Data flow analysis for verifying properties of concurrent programs , 1994, SIGSOFT '94.

[30]  HERBERT A. SIMON,et al.  The Architecture of Complexity , 1991 .

[31]  John Scott Social Network Analysis , 1988 .

[32]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[33]  Chaomei Chen,et al.  Information Visualization: Beyond the Horizon , 2006 .

[34]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[35]  Nancy J. Cooke,et al.  Using Pathfinder to Generate Communication Networks in a Cognitive Task Analysis , 2004 .

[36]  Michael Wooldridge,et al.  A software engineering perspective on multi-agent system design: experience in the development of MADE , 1992 .

[37]  Álvaro F. Moreira,et al.  MAS-SOC: a Social Simulation Platform Based on Agent-Oriented Programming , 2005, J. Artif. Soc. Soc. Simul..

[38]  Kenneth H. Rosen,et al.  Discrete Mathematics and its applications , 2000 .

[39]  Jorge J. Gómez-Sanz,et al.  Using Semantic Causality Graphs to Validate MAS Models , 2008, Innovations in Hybrid Intelligent Systems.

[40]  Emal Pasarly Time , 2011, Encyclopedia of Evolutionary Psychological Science.

[41]  K. Suzanne Barber,et al.  Comprehending agent software , 2005, AAMAS '05.

[42]  Juan A. Botía Blaya,et al.  Infrastructure for Forensic Analysis of Multi-Agent Systems , 2009, ProMAS.

[43]  Yun Peng,et al.  Using Colored Petri Nets for Conversation Modeling , 2000, Issues in Agent Communication.

[44]  Hyacinth S. Nwana,et al.  Visualising and debugging distributed multi-agent systems , 1999, AGENTS '99.

[45]  Daniel A. Keim,et al.  Information Visualization and Visual Data Mining , 2002, IEEE Trans. Vis. Comput. Graph..

[46]  Ray J. Paul,et al.  Visualizing latent domain knowledge , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[47]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[48]  Sean Peisert,et al.  A model of forensic analysis using goal-oriented logging , 2007 .

[49]  Dina Q. Goldin,et al.  Indirect Interaction in Environments for Multi-agent Systems , 2005, E4MAS.

[50]  Guillermo Vigueras,et al.  Tracking Causality by Visualization of Multi-Agent Interactions Using Causality Graphs , 2007, PROMAS.

[51]  Francis T. Durso,et al.  Network Structures in Proximity Data , 1989 .

[52]  David G. Stork,et al.  Pattern Classification , 1973 .

[53]  Antonio F. Gómez-Skarmeta,et al.  On the Application of Clustering Techniques to Support Debugging Large-Scale Multi-Agent Systems , 2006, PROMAS.

[54]  Chaomei Chen,et al.  Information Visualisation and Virtual Environments , 1999 .

[55]  Tae Ryu,et al.  Automated Defect Prevention with Visual Studio Team System: a Case Study for Software Engineering , 2008, Software Engineering Research and Practice.

[56]  Jorge J. Gómez-Sanz,et al.  Intelligent data analysis applied to debug complex software systems , 2009, Neurocomputing.

[57]  David Harel,et al.  Modeling Reactive Systems With Statecharts : The Statemate Approach , 1998 .

[58]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[59]  Yen-Liang Chen,et al.  Mining typical patterns from databases , 2008, Inf. Sci..

[60]  D. W. Dearholt,et al.  Properties of pathfinder networks , 1990 .

[61]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[62]  Zaida Chinchilla-Rodríguez,et al.  Visualizing the marrow of science , 2007 .

[63]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[64]  Rocío Gómez Crisóstomo,et al.  Binary Pathfinder: An improvement to the Pathfinder algorithm , 2006, Inf. Process. Manag..

[65]  Martin K. Purvis,et al.  Modelling and visualizing agent conversations , 2001, AGENTS '01.

[66]  Jorge J. Gómez-Sanz,et al.  Testing and Debugging of MAS Interactions with INGENIAS , 2009, AOSE.