Collaborative Modeling: Towards a Meta-model for Analysis and Evaluation

In this paper we discuss a meta-model for the analysis and evaluation of collaborative modeling sessions. In the first part of the meta-model, we use an analysis framework which reveals a triad of rules, interactions and models. This framework, which is central in driving the modeling process, helps us look inside the modeling process with the aim of understanding it better. The second part of the meta-model is based on an evaluation framework using a multi-criteria decision analysis (MCDA) method. Central to this framework, is how modelers' quality priorities and preferences can, through a group decision-making and negotiation process, be traced back to the interactions and rules in the analysis framework. The meta model not only helps us find out what takes place during the modeling process but also the quality of the different modeling artifacts used in, and produced during, the modeling process. Illustrative examples, from real modeling sessions, are given to demonstrate the theoretical significance and practical importance of the meta-model.

[1]  Terry Winograd,et al.  Understanding computers and cognition , 1986 .

[2]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[3]  Adel Guitouni,et al.  Tentative guidelines to help choosing an appropriate MCDA method , 1998, Eur. J. Oper. Res..

[4]  Peter McBurney,et al.  A Dialogue Game Protocol for Agent Purchase Negotiations , 2003, Autonomous Agents and Multi-Agent Systems.

[5]  John Krogstie,et al.  Participatory Development of Enterprise Process Models , 2005, Information Modeling Methods and Methodologies.

[6]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[7]  K. Hindriks,et al.  Negotiation Dynamics: Analysis, Concession Tactics, and Outcomes , 2007, 2007 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT'07).

[8]  Victor R. Lesser,et al.  Issues in Automated Negotiation and Electronic Commerce: Extending the Contract Net Framework , 1997, ICMAS.

[9]  Stijn Hoppenbrouwers,et al.  Evaluating Modeling Sessions Using the Analytic Hierarchy Process , 2009, PoEM.

[10]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[11]  Henri Prade,et al.  Generation and evaluation of different types of arguments in negotiation , 2004, NMR.

[12]  Göran Goldkuhl,et al.  Conversational Analysis as a Theoretical Foundation for Language Action Approaches , 2003 .

[13]  Carles Sierra,et al.  Agent-Mediated Electronic Commerce , 2004, Autonomous Agents and Multi-Agent Systems.

[14]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[15]  B. Roy.  THE OUTRANKING APPROACH AND THE FOUNDATIONS OF ELECTRE METHODS , 1991 .

[16]  Chris Reed,et al.  Argumentation Machines, New Frontiers in Argument and Computation , 2004, Argumentation Machines.

[17]  Victor R. Lesser,et al.  A Generic Model for Intelligent Negotiating Agents , 1992, Int. J. Cooperative Inf. Syst..

[18]  Douglas R. Vogel,et al.  Modeling with a group modeling tool: group support, model quality, and validation , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[19]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[20]  Janis Stirna,et al.  Ten Years Plus with EKD: Reflections from Using an Enterprise Modeling Method in Practice , 2007, EMMSAD.

[21]  Gerhard Weiss,et al.  A Generic Framework for Argumentation-Based Negotiation , 2007, CIA.

[22]  Simon Peck,et al.  Group Model Building: Facilitating Team Learning Using System Dynamics , 1996, J. Oper. Res. Soc..

[23]  Stijn Hoppenbrouwers,et al.  Interactions, Goals and Rules in a Collaborative Modelling Session , 2009, PoEM.

[24]  Gwendolyn L. Kolfschoten,et al.  Collaborative Enterprise Modeling , 2009, PRET.

[25]  J. Sadock.  Speech acts , 2007 .

[26]  Nicholas R. Jennings,et al.  Agents That Reason and Negotiate by Arguing , 1998, J. Log. Comput..

[27]  Terry Halpin,et al.  Information modeling and relational databases: from conceptual analysis to logical design , 2001 .

[28]  Nicholas R. Jennings,et al.  Neogotiation Through Argumentation - A Preliminary Report , 1996 .

[29]  Nikolaos M. Avouris,et al.  On tools for analysis of collaborative problem solving , 2003, Proceedings 3rd IEEE International Conference on Advanced Technologies.

[30]  D. Walton,et al.  Commitment in Dialogue: Basic Concepts of Interpersonal Reasoning , 1995 .

[31]  George P. Richardson,et al.  Group model building: problem structuring, policy simulation and decision support , 2007, J. Oper. Res. Soc..

[32]  Jacques L. Koko,et al.  The Art and Science of Negotiation , 2009 .

[33]  Peter Rittgen,et al.  Negotiating Models , 2007, CAiSE.

[34]  Joseph Barjis.  Collaborative, Participative and Interactive Enterprise Modeling , 2009, ICEIS.

[35]  Henderik Alex Proper,et al.  System Development as a Rational Communicative Process , 2003 .