Evaluating the comprehension of means-ends maps

AbstractInformation and software systems development is rapidly changing due to exponential technology development. This acceleration is also impacting other technology or engineering domains. Thus, there is a need to identify problems and their solutions, and to reason about new options so as to better arrive at the right decision of which technology or solution should be adopted among various alternatives. In this paper, we argue that such know-how information can be mapped, to ease such tasks. In particular, we examine the hypothesis that know-how mapping, using an approach we call Means-Ends Map (ME-MAP), facilitates analysis in technological domains. We design a controlled experiment to assess the comprehension of ME maps with that of textual summaries in two different domains. We find that subjects exploring a domain using ME maps were able to better identify solutions and better understand the tradeoffs among alternative solutions. Furthermore, these subjects gained that understanding faster compared to those using textual summaries.

[1]  Osmar R. Zaïane,et al.  Current State of Text Sentiment Analysis from Opinion to Emotion Mining , 2017, ACM Comput. Surv..

[2]  Jian Wang,et al.  Mapping and Usage of Know-How Contributions , 2014, CAiSE Forum.

[3]  Eric Yu,et al.  Social Modeling for Requirements Engineering , 2011, Cooperative information systems.

[4]  Iryna Gurevych,et al.  GraphDocExplore: A Framework for the Experimental Comparison of Graph-based Document Exploration Techniques , 2017, EMNLP.

[5]  Jf Sowa,et al.  Semantic Networks, Encyclopedia of Artificial Intelligence, Wiley . , 1992 .

[6]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2000, The Kluwer International Series in Software Engineering.

[7]  Victoria S. Uren,et al.  Sensemaking tools for understanding research literatures: Design, implementation and user evaluation , 2006, Int. J. Hum. Comput. Stud..

[8]  Rob H. Bracewell,et al.  Capturing design rationale , 2009, Comput. Aided Des..

[9]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[10]  John W. Budd,et al.  Mind Maps As Classroom Exercises , 2004 .

[11]  L. Greenstein Assessing 21st Century Skills: A Guide to Evaluating Mastery and Authentic Learning , 2012 .

[12]  Alberto J. Cañas,et al.  A TEORIA SUBJACENTE AOS MAPAS CONCEITUAIS E COMO ELABORÁ-LOS E USÁ-LOS * THE THEORY UNDERLYING CONCEPT MAPS AND HOW TO CONSTRUCT AND USE THEM , 2010 .

[13]  Enrico Motta,et al.  ScholOnto: an ontology-based digital library server for research documents and discourse , 2000, International Journal on Digital Libraries.

[14]  Marco Carvalho,et al.  Enhancing Web Searches from Concept Map-based Knowledge Models , 2001 .

[15]  Richard R. Nelson,et al.  Progress in Know-How: Its Origins and Limits , 2008, Innovations: Technology, Governance, Globalization.

[16]  C. Eden,et al.  The analysis of cause maps , 1992 .

[17]  Ali Balaid,et al.  Knowledge maps: A systematic literature review and directions for future research , 2016, Int. J. Inf. Manag..

[18]  Eric S. K. Yu,et al.  Know-How Mapping - A Goal-Oriented Approach and Evaluation , 2017, BPMDS/EMMSAD@CAiSE.

[19]  Mohammad Alshayeb,et al.  Survey On Software Design-Pattern Specification Languages , 2016, ACM Comput. Surv..

[20]  Daniel L. Moody,et al.  The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering , 2009, IEEE Transactions on Software Engineering.

[21]  Donald F. Dansereau,et al.  Enhancing the recall of text: Knowledge mapping training promotes implicit transfer. , 1998 .

[22]  Sigmar-Olaf Tergan,et al.  Visualizing Knowledge and Information: An Introduction , 2005, Knowledge and Information Visualization.

[23]  Barbara H. Kwasnik,et al.  The Role of Classification in Knowledge Representation and Discovery , 1999, Libr. Trends.

[24]  Iris Vessey,et al.  Cognitive Fit: A Theory‐Based Analysis of the Graphs Versus Tables Literature* , 1991 .

[25]  T. J. Reynolds,et al.  Consumer Understanding and Advertising Strategy: Analysis and Strategic Translation of Laddering Data , 2001 .

[26]  Azzam Maraee,et al.  Formal semantics and analysis tasks for ME-MAP models , 2017, 2017 11th International Conference on Research Challenges in Information Science (RCIS).

[27]  Daniel Gross,et al.  Towards Know-how Mapping Using Goal Modeling , 2013, iStar.

[28]  Andrew Gemino,et al.  A framework for empirical evaluation of conceptual modeling techniques , 2004, Requirements Engineering.

[29]  John F. Sowa,et al.  Conceptual Graphs for a Data Base Interface , 1976, IBM J. Res. Dev..

[30]  Axel van Lamsweerde,et al.  Requirements Engineering: From System Goals to UML Models to Software Specifications , 2009 .

[31]  Jian Wang,et al.  Means-ends based know-how mapping , 2017, J. Knowl. Manag..

[32]  John Mylopoulos,et al.  From object-oriented to goal-oriented requirements analysis , 1999, CACM.