A comprehensive text analysis of lecture slides to generate concept maps

Abstract Current instructional methods widely support verbal learning through linear and sequential teaching materials, focusing on isolated pieces of information. However, an important aspect of learning design is to facilitate students in identifying relationships between information. The transformation of linearity in teaching resources into integrated network models such as concept maps facilitates effective knowledge organisation by constructing relationships between new and existing knowledge. However, the manual construction of concept maps from teaching materials places an additional workload on the academics involved. Consequently, this research investigates the effectiveness of automated approaches in extracting concept maps from lecture slides and the suitability of auto-generated concept maps as a pedagogical tool. We develop a set of Natural Language Processing (NLP) algorithms to support concept-relation-concept triple extraction to form concept maps. Structural and graph-based features are utilised to rank the triples according to their importance. The natural layout of the lecture slides is incorporated to organise the triples in a hierarchy, facilitating highly integrated structure. Our evaluation studies identify promising results, with several case studies demonstrating a statistically significant correlation (r s  > 0.455) between auto-generated concept maps and human experts' judgment. Auto-generated concept maps were rated from ‘good’ to ‘very good’ by the academics on evaluation factors such as coverage, accuracy, and suitability as a pedagogical tool. Thus, auto-generated concept maps from this research can be utilised as a positive alternative to the manual construction of expert concept maps and further, it is possible to utilise these maps for a wider range of applications including knowledge organisation and reflective visualisation of course contents. Our research contributes to bridging the gap between linearity in teaching materials and the necessity of creating integrated network models from teaching resources.

[1]  Robert A. Bartsch,et al.  Effectiveness of PowerPoint presentations in lectures , 2003, Comput. Educ..

[2]  Marko Grobelnik,et al.  Learning Sub-structures of Document Semantic Graphs for Document Summarization , 2004 .

[3]  David B. Leake,et al.  JUMP-STARTING CONCEPT MAP CONSTRUCTION WITH KNOWLEDGE EXTRACTED FROM DOCUMENTS , 2006 .

[4]  Gloria Gomez,et al.  CmapTools: A Knowledge Modeling and Sharing Environment , 2004 .

[5]  Nian-Shing Chen,et al.  Mining e-Learning Domain Concept Map from Academic Articles , 2006 .

[6]  Edward R. Tufte,et al.  The cognitive style of PowerPoint , 2003 .

[7]  Oren Etzioni,et al.  Open Information Extraction from the Web , 2007, CACM.

[8]  Abraham Silberschatz,et al.  Operating System Concepts , 1983 .

[9]  Shian-Shyong Tseng,et al.  A new approach for constructing the concept map , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[10]  Donald F. Dansereau,et al.  Effects of Knowledge Maps and Prior Knowledge on Recall of Science Lecture Content , 1992 .

[11]  Amílcar Cardoso,et al.  Automatic Reading and Learning from Text , 2001 .

[12]  Angela M. O'Donnell,et al.  Cognitive and Affective Outcomes of Learning from Knowledge Maps , 1996 .

[13]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[14]  William Stallings,et al.  Data and Computer Communications , 1985 .

[15]  R. Calvo,et al.  ANALYSIS OF A GOLD STANDARD FOR CONCEPT MAP MINING – HOW HUMANS SUMMARIZE TEXT USING CONCEPT MAPS , 2010 .

[16]  Rafael A. Calvo,et al.  Concept Map Mining: A Definition and a Framework for Its Evaluation , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[17]  Nickolas J. G. Falkner,et al.  Automated Extraction of Semantic Concepts from Semi-structured Data: Supporting Computer-Based Education through the Analysis of Lecture Notes , 2012, DEXA.

[18]  Andrew Olney,et al.  Interactive Concept Maps and Learning Outcomes in Guru , 2012, FLAIRS.

[19]  W. Bruce Croft,et al.  Deriving concept hierarchies from text , 1999, SIGIR '99.

[20]  Yao-Ting Sung,et al.  Learning through computer-based concept mapping with scaffolding aid , 2001, J. Comput. Assist. Learn..

[21]  Yao-Ting Sung,et al.  Learning through computer‐based concept mapping with scaffolding aid , 2001 .

[22]  Nickolas J. G. Falkner,et al.  An Evaluation Methodology for Concept Maps Mined from Lecture Notes: An Educational Perspective , 2014, CSEDU.

[23]  Fan Gao,et al.  Impact of Knowledge Representations on Problem-Oriented Learning in Online Environments , 2015, Int. J. Hum. Comput. Interact..

[24]  Ravi Paul,et al.  Analyzing the structure of expert knowledge , 2006, Inf. Manag..

[25]  R. Clariana,et al.  A computer-based approach for translating text into concept map-like representations , 2004 .

[26]  Andrew Olney,et al.  Generating Concept Map Exercises from Textbooks , 2011, BEA@ACL.

[27]  Johanna Völker,et al.  A Framework for Ontology Learning and Data-driven Change Discovery , 2005 .

[28]  A. All,et al.  Instructional Tools for Nursing Education: CONCEPT MAPS , 2003, Nursing education perspectives.

[29]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[30]  Chun-Hsiung Lee,et al.  Application of automatically constructed concept map of learning to conceptual diagnosis of e-learning , 2009, Expert Syst. Appl..

[31]  Nick Cramer,et al.  Automatic Keyword Extraction from Individual Documents , 2010 .

[32]  Razvan C. Bunescu,et al.  A Shortest Path Dependency Kernel for Relation Extraction , 2005, HLT.

[33]  Philipp Cimiano,et al.  Ontology learning and population from text - algorithms, evaluation and applications , 2006 .

[34]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[35]  Nickolas J. G. Falkner,et al.  Educational Question Answering Motivated by Question-Specific Concept Maps , 2015, AIED.

[36]  Alberto J. Cañas,et al.  Using Automatically Generated Concept Maps for Document Understanding: a Human Subjects Experiment , 2012 .

[37]  David Leake,et al.  Understanding Knowledge Models: Modeling Assessment of Concept Importance in Concept Maps , 2004 .

[38]  Rafael A. Calvo,et al.  Concept Extraction from Student Essays, Towards Concept Map Mining , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[39]  Marti A. Hearst.  Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[40]  Ian M. Kinchin,et al.  Using PowerPoint as a lens to focus on linearity in teaching , 2008 .

[41]  Christopher D. Manning,et al.  Leveraging Linguistic Structure For Open Domain Information Extraction , 2015, ACL.

[42]  R. Shavelson,et al.  Problems and Issues in the Use of Concept Maps in Science Assessment. , 1996 .

[43]  Chi Fai Cheung,et al.  Mining knowledge from natural language texts using fuzzy associated concept mapping , 2008, Inf. Process. Manag..

[44]  Douglas A. Wiegmann,et al.  Receiving information during a cooperative episode: Effects of communication aids and verbal ability , 1993 .

[45]  J. Novak,et al.  Educational Psychology: A Cognitive View , 1969 .

[46]  Nanda Kambhatla,et al.  Combining Lexical, Syntactic, and Semantic Features with Maximum Entropy Models for Information Extraction , 2004, ACL.

[47]  Shyi-Ming Chen,et al.  Using data mining techniques to automatically construct concept maps for adaptive learning systems , 2010, Expert Syst. Appl..

[48]  Amal Zouaq,et al.  Building Domain Ontologies from Text for Educational Purposes , 2007, EC-TEL.

[49]  Hideki Mima,et al.  Automatic recognition of multi-word terms:. the C-value/NC-value method , 2000, International Journal on Digital Libraries.

[50]  Aviv Segev,et al.  Knowledge maps for e-learning , 2011, Comput. Educ..

[51]  Mitsuru Ishizuka,et al.  Keyword extraction from a single document using word co-occurrence statistical information , 2004, Int. J. Artif. Intell. Tools.

[52]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[53]  Jennifer M. Apperson,et al.  An assessment of student preferences for PowerPoint presentation structure in undergraduate courses , 2008, Comput. Educ..

[54]  Ruslan Mitkov,et al.  Robust Pronoun Resolution with Limited Knowledge , 1998, ACL.

[55]  Amal Zouaq,et al.  Building Domain Ontologies from Text for Educational Purposes , 2007, IEEE Transactions on Learning Technologies.

[56]  Ralf Zimmer,et al.  RelEx - Relation extraction using dependency parse trees , 2007, Bioinform..

[57]  Steffen Staab,et al.  Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis , 2005, J. Artif. Intell. Res..

[58]  Dan Klein,et al.  Fast Exact Inference with a Factored Model for Natural Language Parsing , 2002, NIPS.

[59]  Nickolas J. G. Falkner,et al.  Acquisition of Triples of Knowledge from Lecture Notes: A Natural Langauge Processing Approach , 2014, EDM.

[60]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[61]  Raymond Y. K. Lau,et al.  Towards Fuzzy Domain Ontology Based Concept Map Generation for E-Learning , 2007, ICWL.

[62]  Olusola O. Adesope,et al.  Learning With Concept and Knowledge Maps: A Meta-Analysis , 2006 .

[63]  Beat A. Schwendimann.  Critiquing as an Alternative to Generating Concept Maps to Support Knowledge Integration Processes , 2016 .

[64]  Nancy Ide,et al.  Introduction to the Special Issue on Word Sense Disambiguation: The State of the Art , 1998, Comput. Linguistics.

[65]  Gautam Biswas,et al.  Designing Learning by Teaching Agents: The Betty's Brain System , 2008, Int. J. Artif. Intell. Educ..

[66]  Alberto J. Cañas,et al.  A TEORIA SUBJACENTE AOS MAPAS CONCEITUAIS E COMO ELABORÁ-LOS E USÁ-LOS * THE THEORY UNDERLYING CONCEPT MAPS AND HOW TO CONSTRUCT AND USE THEM , 2010 .