Assessing Representation Theory with a Framework for Pursuing Success and Failure

Representation theory (RT) is one of few long-standing, native theories in the Information Systems discipline. Over the past 30 years, RT has spawned a wide program of research, primarily on modeling of information systems but also on other phenomena such as data quality, system alignment, security, and effective system use. Nonetheless, descriptions of RT are splintered across many papers over many years. RT has also attracted repeated criticisms about assumptions, tests, and results. As a result, the nature of RT, its merits (or lack thereof), and how best to progress it, are unclear. Motivated by these issues, this paper provides a much-needed overview of RT. It further offers an evaluation of RT and explains how research on RT can improve, using a novel framework for evaluating theoretical programs. Our analysis shows that RT's merits (or lack thereof) remain inconclusive because prior research has not proceeded systematically enough. In this light, we explain and illustrate how research can proceed more systematically.

[1]  Andrew Burton-Jones,et al.  From Use to Effective Use: A Representation Theory Perspective , 2013, Inf. Syst. Res..

[2]  Jan Recker,et al.  Ontology- Versus Pattern-Based Evaluation of Process Modeling Languages: A Comparison , 2007, Commun. Assoc. Inf. Syst..

[3]  Anne-Wil Harzing,et al.  The Publish or Perish Book: Your guide to effective and responsible citation analysis , 2010 .

[4]  Sia Siew Kien,et al.  An assessment of package–organisation misalignment: institutional and ontological structures , 2007, Eur. J. Inf. Syst..

[5]  Marta Indulska,et al.  Using ontology for the representational analysis of process modelling techniques , 2009, Int. J. Bus. Process. Integr. Manag..

[6]  Boris Wyssusek,et al.  On Ontological Foundations of Conceptual Modelling , 2006, Scand. J. Inf. Syst..

[7]  Samuel B. Bacharach,et al.  Organizational Theories: Some Criteria for Evaluation , 1989 .

[8]  Guy Paré,et al.  A Framework for Guiding and Evaluating Literature Reviews , 2015, Commun. Assoc. Inf. Syst..

[9]  Dieter Christian,et al.  The Conceptual Framework for Financial Reporting , 2012 .

[10]  Ron Weber,et al.  Ontological Clarity, Cognitive Engagement, and Conceptual Model Quality Evaluation: An Experimental Investigation , 2012, J. Assoc. Inf. Syst..

[11]  Yair Wand,et al.  Guidelines for Designing Visual Ontologies to Support Knowledge Identification , 2011, MIS Q..

[12]  Leyland F. Pitt,et al.  Potential Research Space in MIS: A Framework for Envisioning and Evaluating Research Replication, Extension, and Generation , 2002, Inf. Syst. Res..

[13]  Yair Wand,et al.  Research Note - How Semantics and Pragmatics Interact in Understanding Conceptual Models , 2014, Inf. Syst. Res..

[14]  D. E. Stokes Pasteur's Quadrant: Basic Science and Technological Innovation , 1997 .

[15]  Ron Weber,et al.  Are Attributes Entities? A Study of Database Designers' Memory Structures , 1996, Inf. Syst. Res..

[16]  Stephen R. Rockwell,et al.  COGEVAL: Applying Cognitive Theories to Evaluate Conceptual Models , 2005 .

[17]  Zhuozhi Chen,et al.  Rediscovering Zachman Framework Using Ontology from a Requirement Engineering Perspective , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[18]  Rudy Hirschheim,et al.  A paradigmatic and methodological examination of information systems research from 1991 to 2001 , 2004, Inf. Syst. J..

[19]  L. Laudan Science as Problem-Solving. (Book Reviews: Progress and Its Problems. Toward a Theory of Scientific Growth) , 1977 .

[20]  Mary Tate,et al.  Introduction to the Special Issue: The Literature Review in Information Systems , 2015, Commun. Assoc. Inf. Syst..

[21]  Kalle Lyytinen,et al.  Information Systems Development and Data Modeling: Philosophical Foundations , 1995 .

[22]  Ron Weber,et al.  Evaluating and Developing Theories in the Information Systems Discipline , 2012, J. Assoc. Inf. Syst..

[23]  Salvatore T. March,et al.  A Critical Assessment of the Bunge-Wand-Weber Ontology for Conceptual Modeling , 2007 .

[24]  Ron Weber,et al.  Understanding relationships with attributes in entity-relationship diagrams , 1999, ICIS.

[25]  Michael Rosemann,et al.  Perceived Ontological Weaknesses Of Process Modeling Techniques : Further Evidence , 2002, ECIS.

[26]  J. Searle The Construction of Social Reality , 1997 .

[27]  John R. Searle,et al.  Social ontology , 2006 .

[28]  Lior Limonad,et al.  What ‘good’ looks like: Understanding records ontologically in the context of the global financial crisis , 2011, J. Inf. Sci..

[29]  Arash Saghafi,et al.  Do Ontological Guidelines Improve Understandability of Conceptual Models? A Meta-analysis of Empirical Work , 2014, 2014 47th Hawaii International Conference on System Sciences.

[30]  Joerg Evermann,et al.  Ontology based object-oriented domain modelling: fundamental concepts , 2005, Requirements Engineering.

[31]  Brian Henderson-Sellers,et al.  A Template for Defining Enterprise Modeling Constructs , 2004, J. Database Manag..

[32]  Peter Meso,et al.  The Effects of Decomposition Quality and Multiple Forms of Information on Novices' Understanding of a Domain from a Conceptual Model , 2008, J. Assoc. Inf. Syst..

[33]  Michael Rosemann,et al.  Enhancing the Expressiveness of the Bunge-Wand-Weber Ontology , 2005, AMCIS.

[34]  Jan Mendling,et al.  Extending the Discussion of Model Quality: Why Clarity and Completeness may not always be enough , 2007, EMMSAD.

[35]  Michael Rosemann,et al.  Developing a meta model for the Bunge-Wand-Weber ontological constructs , 2002, Inf. Syst..

[36]  Graeme G. Shanks,et al.  Representing part-whole relations in conceptual modeling: an empirical evaluation , 2008 .

[37]  Michael Rosemann,et al.  Exploring proposed ontological issues of ARIS with different categories of modellers , 2004 .

[38]  Boris Wyssusek,et al.  On the Foundation of the Ontological Foundation of Conceptual Modeling Grammars: The Construction of the Bunge-Wand-Weber Ontology , 2005, CAiSE Workshops.

[39]  Ron Weber,et al.  Research Commentary: Information Systems and Conceptual Modeling - A Research Agenda , 2002, Inf. Syst. Res..

[40]  Chris F. Kemerer,et al.  A Metrics Suite for Object Oriented Design , 2015, IEEE Trans. Software Eng..

[41]  Graeme G. Shanks,et al.  The Hole in the Whole: A Response to Allen and March , 2012, MIS Q..

[42]  Chad Anderson,et al.  Journal Quality and Citations: Common Metrics and Considerations about Their Use , 2010 .

[43]  J. Edwards,et al.  The Presence of Something or the Absence of Nothing: Increasing Theoretical Precision in Management Research , 2010 .

[44]  Pär J. Ågerfalk Embracing diversity through mixed methods research , 2013, Eur. J. Inf. Syst..

[45]  Michael Rosemann,et al.  Toward Improving the Relevance of Information Systems Research to Practice: The Role of Applicability Checks , 2008, MIS Q..

[46]  Salvatore T. March,et al.  Ontological Foundations for Active Information Systems , 2007, Int. J. Intell. Inf. Technol..

[47]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[48]  Marta Indulska,et al.  Challenging the Philosophical Foundations of Modeling Organizational Reality: The Case of Process Modeling , 2013, ICIS.

[49]  D. Snowden,et al.  A leader's framework for decision making , 2007 .

[50]  K. Weick Theory Construction as Disciplined Imagination , 1989 .

[51]  Michael Rosemann,et al.  Ontological Analysis of Integrated Process Models: testing hypotheses , 2001, Australas. J. Inf. Syst..

[52]  A. Kaplan The Conduct of Inquiry: Methodology for Behavioural Science , 1965 .

[53]  Jeffrey Parsons An Experimental Study of the Effects of Representing Property Precedence on the Comprehension of Conceptual Schemas , 2011, J. Assoc. Inf. Syst..

[54]  Yair Wand,et al.  An Automated Approach to Information Systems Decomposition , 1992, IEEE Trans. Software Eng..

[55]  Jon Heales,et al.  A model of factors affecting an information system's change in state , 2002, J. Softw. Maintenance Res. Pract..

[56]  Sukjin Kang,et al.  Reexamining the Role of Cognitive Conflict in Science Concept Learning , 2004 .

[57]  D. Vermeir,et al.  A procedure to define the object type structure of a conceptual schema , 1982, Inf. Syst..

[58]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[59]  G. Guyatt,et al.  Grading quality of evidence and strength of recommendations , 2004, BMJ : British Medical Journal.

[60]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[61]  Suzanne Rivard,et al.  A Multilevel Model of Resistance to Information Technology Implementation , 2005, MIS Q..

[62]  Andrew Gemino,et al.  Complexity and clarity in conceptual modeling: Comparison of mandatory and optional properties , 2005, Data Knowl. Eng..

[63]  Ron Weber,et al.  Ontological foundations of information systems , 1997 .

[64]  Ron Weber,et al.  On the Ontological Quality and Logical Quality of Conceptual-Modeling Grammars: The Need for a Dual Perspective , 2016, Inf. Syst. Res..

[65]  Lucy A. Suchman,et al.  Making work visible , 1995, CACM.

[66]  E. A. Locke The Case for Inductive Theory Building† , 2007 .

[67]  Börje Langefors,et al.  Theoretical analysis of information systems , 1973 .

[68]  Daniel Kahneman,et al.  Experiences of collaborative research. , 2003, The American psychologist.

[69]  Marta Indulska,et al.  A Reference Methodology for Conducting Ontological Analyses , 2004, ER.

[70]  Giuseppe Berio,et al.  An ontology for enterprise and information systems modelling , 2012, Appl. Ontology.

[71]  M. Walport,et al.  Looking for Landmarks: The Role of Expert Review and Bibliometric Analysis in Evaluating Scientific Publication Outputs , 2009, PloS one.

[72]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[73]  Zhuozhi Chen,et al.  Domain Modeling for Enterprise Information Systems - Formalizing and Extending Zachman Framework Using BWW Ontology , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[74]  Kevin G. Corley,et al.  Building theory about theory building: What constitutes a theoretical contribution? Academy of Management Review, , . , 2011 .

[75]  Ron Weber,et al.  Conceptual Modeling: An Empirical Evaluation1 , 2016 .

[76]  Ron Weber,et al.  An Ontological Model of an Information System , 1990, IEEE Trans. Software Eng..

[77]  Peter Meso,et al.  Conceptualizing Systems for Understanding: An Empirical Test of Decomposition Principles in Object-Oriented Analysis , 2006, Inf. Syst. Res..

[78]  Salvatore T. March,et al.  The Effects of State-Based and Event-Based Data Representation on User Performance in Query Formulation Tasks , 2006, MIS Q..

[79]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[80]  Graeme G. Shanks,et al.  Representing Classes of Things and Properties in General in Conceptual Modelling: An Empirical Evaluation , 2010, J. Database Manag..

[81]  Nicholas Rescher,et al.  Process Metaphysics: An Introduction to Process Philosophy , 1996 .

[82]  Werner Esswein,et al.  Ontological Analyses Reconsidered-A Formal Approach , 2005 .

[83]  Earl H. McKinney,et al.  Information About Information: A Taxonomy of Views , 2010, MIS Q..

[84]  Marta Indulska,et al.  Modeling languages for business processes and business rules: A representational analysis , 2009, Inf. Syst..

[85]  Erich J. Neuhold,et al.  Semantics of data bases: The semantics of data models , 1978, Inf. Syst..

[86]  Marta Indulska,et al.  Complementary Use of Modeling Grammars , 2011, Scand. J. Inf. Syst..

[87]  Dov Dori,et al.  Modelling Off-the-Shelf Information Systems Requirements: An Ontological Approach , 2001, Requirements Engineering.

[88]  Cynthia F. Kurtz,et al.  The new dynamics of strategy: sense-making in a complex and complicated world , 2003, IEEE Engineering Management Review.

[89]  B. Lynch An Empirical Assessment of Perrow's Technology Construct. , 1974 .

[90]  Bernd Carsten Stahl,et al.  Critical Discourse Analysis as a Review Methodology: An Empirical Example , 2015, Commun. Assoc. Inf. Syst..

[91]  R. G. Dromey,et al.  Cornering the Chimera , 1996, IEEE Softw..

[92]  Yair Wand,et al.  Theoretical foundations for conceptual modelling in information systems development , 1995, Decis. Support Syst..

[93]  Diogo R. Ferreira,et al.  Business process analysis in healthcare environments: A methodology based on process mining , 2012, Inf. Syst..

[94]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[95]  Paul L. Bowen,et al.  An Empirical Investigation of End-User Query Development: The Effects of Improved Model Expressiveness vs. Complexity , 2009, Inf. Syst. Res..

[96]  Jan Recker Evaluations of Process Modeling Grammars - Ontological, Qualitative and Quantitative Analyses Using the Example of BPMN , 2011, Lecture Notes in Business Information Processing.

[97]  Csaba Veres,et al.  Cognition and Modeling: Foundations for Research and Practice , 2005 .

[98]  Ron Weber,et al.  Alignment in Enterprise Systems Implementations: The Role of Ontological Distance , 2004, ICIS.

[99]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[100]  Pär J. Ågerfalk Getting pragmatic , 2010, Eur. J. Inf. Syst..

[101]  Ron Weber,et al.  On Ontological Foundations of Conceptual Modelling: A Response to Wyssusek , 2006, Scand. J. Inf. Syst..

[102]  Marta Indulska,et al.  The ontological deficiencies of process modeling in practice , 2010, Eur. J. Inf. Syst..

[103]  Richard Y. Wang,et al.  Anchoring data quality dimensions in ontological foundations , 1996, CACM.

[104]  Simon K. Milton,et al.  An Ontology of Data Modeling Languages: A Study Using a Common-Sense Realistic Ontology , 2004, J. Database Manag..

[105]  Salvatore T. March,et al.  A Research Note on Representing Part-Whole Relations in Conceptual Modeling , 2012, MIS Q..

[106]  Giancarlo Guizzardi,et al.  Ontological foundations for structural conceptual models , 2005 .

[107]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[108]  Andrew Gemino,et al.  Evaluating modeling techniques based on models of learning , 2003, CACM.

[109]  Simon K. Milton,et al.  Ontological Foundations of Representational Information Systems: An Australian Perspective , 2007, Scand. J. Inf. Syst..

[110]  I. Lakatos Falsification and the Methodology of Scientific Research Programmes , 1976 .

[111]  Bill Doolin,et al.  Power and resistance in the implementation of a medical management information system , 2004, Inf. Syst. J..

[112]  Yair Wand,et al.  Goal-Driven Multi-Process Analysis , 2007, J. Assoc. Inf. Syst..

[113]  Ron Weber,et al.  Guidelines for Empirical Evaluations of Conceptual Modeling Grammars , 2009, J. Assoc. Inf. Syst..

[114]  Marta Indulska,et al.  Extending Representational Analysis: BPMN User and Developer Perspectives , 2007, BPM.

[115]  Charles Taylor Theories of meaning , 1980 .

[116]  M. Alvesson,et al.  Reflexive Methodology: New Vistas for Qualitative Research , 2000, QMiP Bulletin.

[117]  Marta Indulska,et al.  Do Ontological Deficiencies in Modeling Grammars Matter? , 2011, MIS Q..

[118]  David Arnott,et al.  Cognitive biases and decision support systems development: a design science approach , 2006, Inf. Syst. J..

[119]  Ron Weber,et al.  An Ontological Analysis of some Fundamental Information Systems Concepts , 1988, ICIS.

[120]  Jeffrey Parsons,et al.  What do the pictures mean? Guidelines for experimental evaluation of representation fidelity in diagrammatical conceptual modeling techniques , 2005, Data Knowl. Eng..

[121]  Frantz Rowe,et al.  What literature review is not: diversity, boundaries and recommendations , 2014, Eur. J. Inf. Syst..

[122]  Jan Recker,et al.  The measurement of perceived ontological deficiencies of conceptual modeling grammars , 2010, Data Knowl. Eng..

[123]  Ron Weber,et al.  On the deep structure of information systems , 1995, Inf. Syst. J..

[124]  Carla L. Wilkin,et al.  Towards an integrated view of IT value measurement , 2010, Int. J. Account. Inf. Syst..

[125]  Daryn Lehoux,et al.  A Revolution of Its Own , 2012, Science.

[126]  Sebastian K. Boell,et al.  On being ‘systematic’ in literature reviews in IS , 2015, J. Inf. Technol..

[127]  Yvonne Rogers Pictorial representations of abstract concepts relating to human-computer interaction , 1986, SGCH.

[128]  Marta Indulska,et al.  Extending the Scope of Representation Theory: A Review and Proposed Research Model , 2007 .

[129]  Mark A. Mone,et al.  Determinants and Development of Schools in Organization Theory , 1999 .

[130]  Venkataraman Ramesh,et al.  Research in Information Systems: An Empirical Study of Diversity in the Discipline and Its Journals , 2002, J. Manag. Inf. Syst..

[131]  Paul L. Bowen,et al.  Analysis of Competing Data Structures: Does Ontological Clarity Produce Better End User Query Performance , 2006, J. Assoc. Inf. Syst..

[132]  J. Searle Making the Social World: The Structure of Human Civilization , 2010 .

[133]  J. Law After Method: Mess in Social Science Research , 2004 .

[134]  Steven Shapin,et al.  The Scientific Revolution , 1997 .

[135]  Irit Hadar,et al.  Variations in Conceptual Modeling: Classification and Ontological Analysis , 2006, J. Assoc. Inf. Syst..

[136]  Joerg Evermann,et al.  Towards a cognitive foundation for knowledge representation , 2005, Inf. Syst. J..

[137]  R. Stamper Information in business and administrative systems , 1973 .

[138]  Boris Wyssusek,et al.  Ontology and Ontologies in Information Systems Analysis and Design: A Critique , 2004, AMCIS.

[139]  Elena Gorbacheva,et al.  Achieving Rigor in Literature Reviews: Insights from Qualitative Data Analysis and Tool-Support , 2015, Commun. Assoc. Inf. Syst..

[140]  Suprateek Sarker,et al.  Does the use of computer-based BPC tools contribute to redesign effectiveness? Insights from a hermeneutic study , 2006, IEEE Transactions on Engineering Management.

[141]  Martin Kilduff,et al.  A Paradigm Too Far? A Dynamic Stability Reconsideration of the Social Network Research Program , 2006 .

[142]  Peter Basch,et al.  Clinical documentation in the 21st century: executive summary of a policy position paper from the American College of Physicians. , 2015, Annals of internal medicine.

[143]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[144]  M. Tushman,et al.  Research and Relevance: Implications of Pasteur'S Quadrant for Doctoral Programs and Faculty Development , 2007 .

[145]  Diane M. Strong,et al.  Understanding Organization-Enterprise System Fit: A Path to Theorizing the Information Technology Artifact , 2010, MIS Q..

[146]  Ron Weber,et al.  On the ontological expressiveness of information systems analysis and design grammars , 1993, Inf. Syst. J..

[147]  Suzanne Rivard,et al.  Editor's comments: the ions of theory construction , 2014 .

[148]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[149]  Susana I. Herrera,et al.  Ontological Modelling of Information Systems from Bunge's Contributions , 2005, CAiSE Workshops.

[150]  Ron Weber,et al.  Stakeholder experiences with conceptual modeling: an empirical investigation , 1998, ICIS '98.

[151]  Guy Paré,et al.  Synthesizing information systems knowledge: A typology of literature reviews , 2015, Inf. Manag..

[152]  Miklos A. Vasarhelyi,et al.  A Field Study on the Use of Process Mining of Event Logs as an Analytical Procedure in Auditing , 2014 .

[153]  Janis A. Bubenko On The Role Of 'Understanding Models' In Conceptual Schema Design , 1979, Fifth International Conference on Very Large Data Bases, 1979..

[154]  Michael Rosemann,et al.  Integrating multi-perspective views into ontological analysis , 2000, ICIS.