A computational model for task-adapted knowledge organisation: improving learning through concept maps extracted from lecture slides.

This thesis presents a framework for automatically generating concept maps from lecture slides. A concept map is recognised as a valuable educational visualisation tool, which assists students in organising, sharing and representing knowledge. Expert maps (also known as expert concept maps) are prepared by domain experts with the intention to serve as scaffolding to facilitate learning. Automated concept map generation provides an alternative solution to the labourintensive and time-consuming process of manually constructing expert maps. Therefore, the main objective of this thesis is to develop techniques to extract maps from lecture slides, ensuring that auto-generated concept maps may be utilised as a positive alternative to expert maps. This process is known as concept map mining (CMM). The particular interest of this thesis is on CMM from lecture slides, due to their wide usage within the teaching context and the poor support of sequentially-structured lecture slides in aiding learners in identifying relationships between information. In general, semantically and syntactically missing and ambiguous text in lecture slides make it undesirable for adopting previously developed algorithms for CMM. Within this thesis, a set of Natural Language Processing (NLP) algorithms are developed to support concept-relation-concept triple extraction to form concept maps. To support knowledge extraction and to overcome the noise associated with text, this work utilises contextual features specific to lecture slides. The natural layout of the lecture slides is incorporated to organise the extracted triples in a hierarchy. Structural (e.g. co-occurrence, term frequency) and graph-based features (e.g. degree of centrality) are utilised to rank the triples according to their importance within the domain. A series of evaluation studies in this thesis identify promising results, with several case studies demonstrating a strong positive correlation between auto-generated concept maps and human generated maps. These results indicate that this research provides an effective and efficient alternative to expert maps. Auto-generated concept maps can be utilised to provide scaffolding in the problem solving context, in particular supporting students who are lacking the required skills. Even though this application has been studied previously, these studies do not specifically focus on the relevance of information to learning. To fill this gap, this thesis investigates an approach to provide more relevant concept maps to a given problem. In pursuit of this goal, a framework capable of automatically extracting concept maps according to the given problems (named task-adapted concept maps) is developed, utilising auto-generated concept maps from lecture slides as domain knowledge. In order to investigate the effect of task-adapted concept maps as scaffolding for learning, an evaluation study was undertaken, with students in the task-adapted concept map scaffolding group demonstrated statistically significant learning gain compared to the students who received lecture slides or full concept maps as scaffolding.

[1]  W. Pankratius Building an Organized Knowledge Base: Concept Mapping and Achievement in Secondary School Physics. , 1990 .

[2]  Anne Morris,et al.  The problem of information overload in business organisations: a review of the literature , 2000, Int. J. Inf. Manag..

[3]  L. Vygotsky Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[4]  Andrew Olney Extraction of Concept Maps from Textbooks for Domain Modeling , 2010, Intelligent Tutoring Systems.

[5]  Jan Elen,et al.  The impact of concept mapping and visualization on the learning of secondary school chemistry students , 2001 .

[6]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[7]  J. Novak Human constructivism: A unification of psychological and epistemological phenomena in meaning making , 1993 .

[8]  Jin Soung Yoo,et al.  Mining concept maps to understand university students’ learning , 2012, EDM 2012.

[9]  Ann Bies,et al.  The Penn Treebank: Annotating Predicate Argument Structure , 1994, HLT.

[10]  V. Dennen COGNITIVE APPRENTICESHIP IN EDUCATIONAL PRACTICE: RESEARCH ON SCAFFOLDING, MODELING, MENTORING, AND COACHING AS INSTRUCTIONAL STRATEGIES , 2003 .

[11]  Nickolas J. G. Falkner,et al.  Task-Adapted Concept Map Scaffolding to Support Quizzes in an Online Environment , 2015, ITiCSE.

[12]  Julian R. Ullmann,et al.  An Algorithm for Subgraph Isomorphism , 1976, J. ACM.

[13]  A. All,et al.  Instructional Tools for Nursing Education: CONCEPT MAPS , 2003, Nursing education perspectives.

[14]  Ruslan Mitkov,et al.  Robust Pronoun Resolution with Limited Knowledge , 1998, ACL.

[15]  Kinshuk,et al.  Mining e-Learning domain concept map from academic articles , 2008, Comput. Educ..

[16]  H. Suen,et al.  Concept Map Assessment of Classroom Learning: Reliability, Validity, and Logistical Practicality , 1999 .

[17]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[18]  Hideki Mima,et al.  Automatic recognition of multi-word terms:. the C-value/NC-value method , 2000, International Journal on Digital Libraries.

[19]  Nada Dabbagh,et al.  Scaffolding: An important teacher competency in online learning , 2003 .

[20]  Chun-Hsiung Lee,et al.  Application of automatically constructed concept map of learning to conceptual diagnosis of e-learning , 2009, Expert Syst. Appl..

[21]  A. L. Woods,et al.  An investigation of the effectiveness of concept mapping as an instructional tool , 1993 .

[22]  Dan Klein,et al.  Fast Exact Inference with a Factored Model for Natural Language Parsing , 2002, NIPS.

[23]  Keith S. Taber,et al.  Student reaction on being introduced to concept mapping , 1994 .

[24]  Marko Grobelnik,et al.  Learning Sub-structures of Document Semantic Graphs for Document Summarization , 2004 .

[25]  Elizabeth A. Davis,et al.  Scaffolding students' knowledge integration: prompts for reflection in KIE , 2000 .

[26]  Marek Hatala,et al.  Voting Theory for Concept Detection , 2012, ESWC.

[27]  Kathleen M. Fisher,et al.  Mapping Biology Knowledge , 2000 .

[28]  Shian-Shyong Tseng,et al.  A new approach for constructing the concept map , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[29]  Paulo Dias,et al.  Understanding navigation and disorientation in hypermedia learning environments , 1997 .

[30]  R. Shavelson,et al.  Comparison of the reliability and validity of scores from two concept‐mapping techniques* , 2001 .

[31]  Bat-Sheva Eylon,et al.  From problem solving to a knowledge structure: An example from the domain of electromagnetism , 1997 .

[32]  F. Paas Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[33]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[34]  David P. Ausubel,et al.  The Acquisition and Retention of Knowledge: A Cognitive View , 2000 .

[35]  Marti A. Hearst Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[36]  John R. Anderson Retrieval of propositional information from long-term memory , 1974 .

[37]  Susan M. Land,et al.  Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions , 2003 .

[38]  Hermann Ebbinghaus,et al.  Memory: a contribution to experimental psychology. , 1987, Annals of neurosciences.

[39]  Ian M. Kinchin,et al.  Concept mapping, PowerPoint, and a pedagogy of access , 2006 .

[40]  J. Mintzes,et al.  Knowledge restructuring in the life sciences: A longitudinal study of conceptual change in biology , 1997 .

[41]  Antonija Mitrovic,et al.  A Comparative Analysis of Cognitive Tutoring and Constraint-Based Modeling , 2003, User Modeling.

[42]  I. Kinchin If concept mapping is so helpful to learning biology, why aren't we all doing it? , 2001 .

[43]  Philippe Andre Martin Use of Semantic Networks as Learning Material and Evaluation of the Approach by Students , 2008 .

[44]  Amílcar Cardoso,et al.  Automatic Reading and Learning from Text , 2001 .

[45]  Kathleen M. Fisher,et al.  Computer-Based Concept Mapping , 1990 .

[46]  J. Macnamara Names for Things: A Study in Human Learning , 1984 .

[47]  G. Bower,et al.  Hierarchical retrieval schemes in recall of categorized word lists , 1969 .

[48]  Katerina T. Frantzi,et al.  Automatic recognition of multi-word terms , 1998 .

[49]  Aida Mustapha,et al.  Structure-Based Algorithm for Presentation Mapping in Graphical Knowledge Display , 2013 .

[50]  Amal Zouaq,et al.  Evaluating the Generation of Domain Ontologies in the Knowledge Puzzle Project , 2009, IEEE Transactions on Knowledge and Data Engineering.

[51]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[52]  Daniel Dominic Sleator,et al.  Parsing English with a Link Grammar , 1995, IWPT.

[53]  Ravi Paul,et al.  Analyzing the structure of expert knowledge , 2006, Inf. Manag..

[54]  Hugh Munby,et al.  Concept mapping and misconceptions: a study of high-school students' understandings of acids and bases , 1991 .

[55]  Nian-Shing Chen,et al.  The effectiveness of using procedural scaffoldings in a paper-plus-smartphone collaborative learning context , 2012, Comput. Educ..

[56]  Ralf Zimmer,et al.  RelEx - Relation extraction using dependency parse trees , 2007, Bioinform..

[57]  Katherine M. Edmondson,et al.  Chapter 2 – Assessing science understanding through concept maps , 2005 .

[58]  F. Reif,et al.  Effects of Knowledge Organization on Task Performance , 1984 .

[59]  Antonija Mitrovic,et al.  Experiences in Implementing Constraint-Based Modeling in SQL-Tutor , 1998, Intelligent Tutoring Systems.

[60]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..

[61]  R. Shavelson,et al.  Problems and Issues in the Use of Concept Maps in Science Assessment. , 1996 .

[62]  Marco Arguedas,et al.  Aiding knowledge capture by searching for extensions of knowledge models , 2003, K-CAP '03.

[63]  D. A. Kenny,et al.  Statistics for the social and behavioral sciences , 1987 .

[64]  Joseph W. Cliburn,et al.  Concept Maps to Promote Meaningful Learning. , 1990 .

[65]  Joseph D. Novak,et al.  Learning creating and using knowledge: Concept maps as facilitative tools , 1998 .

[66]  Nguyen Bach,et al.  A Review of Relation Extraction , 2007 .

[67]  Peter Akinsola Okebukola,et al.  Can Good Concept Mappers be Good Problem Solvers in Science , 1992 .

[68]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[69]  Nestor Garay-Vitoria,et al.  Use of concept maps to analyze students' understanding of the I/O subsystem , 2013, Koli Calling '13.

[70]  M. G. Jones,et al.  The concept map as a research and evaluation tool: Further evidence of validity , 1994 .

[71]  Nickolas J. G. Falkner,et al.  Automated Extraction of Semantic Concepts from Semi-structured Data: Supporting Computer-Based Education through the Analysis of Lecture Notes , 2012, DEXA.

[72]  Dan Brickley,et al.  Resource Description Framework (RDF) Model and Syntax Specification , 2002 .

[73]  Barbara A. Frey,et al.  Learners' Perceptions on the Value of PowerPoint in Lectures. , 2002 .

[74]  G. Salomon,et al.  The computer as a zone of proximal development: Internalizing reading-related metacognitions from a Reading Partner. , 1989 .

[75]  Joseph Krajcik,et al.  A Scaffolding Design Framework for Software to Support Science Inquiry , 2004, The Journal of the Learning Sciences.

[76]  J. T. Dillon Questioning and Teaching: A Manual of Practice , 1988 .

[77]  Daniel Jurafsky,et al.  Learning Syntactic Patterns for Automatic Hypernym Discovery , 2004, NIPS.

[78]  R. Sawyer The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[79]  J. Novak Concept mapping: A useful tool for science education , 1990 .

[80]  Angela M. O'Donnell,et al.  Cognitive and Affective Outcomes of Learning from Knowledge Maps , 1996 .

[81]  Kuo-En Chang,et al.  The Effect of Concept Mapping to Enhance Text Comprehension and Summarization , 2002 .

[82]  Philipp Cimiano,et al.  Ontology learning and population from text - algorithms, evaluation and applications , 2006 .

[83]  Marti A. Hearst The debate on automated essay grading , 2000 .

[84]  Nickolas J. G. Falkner,et al.  Evaluation of Concept Importance in Concept Maps Mined from Lecture Notes - Computer Vs Human , 2014, CSEDU.

[85]  Abraham Silberschatz,et al.  Operating System Concepts, 5th Edition , 1994 .

[86]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[87]  Diana Maynard,et al.  NLP Techniques for Term Extraction and Ontology Population , 2008, Ontology Learning and Population.

[88]  Luis Gravano,et al.  Snowball: extracting relations from large plain-text collections , 2000, DL '00.

[89]  Elaine B. Coleman,et al.  Using Explanatory Knowledge During Collaborative Problem Solving in Science , 1998 .

[90]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[91]  E. T. Hallberg,et al.  Conceptualizations of novice and experienced counselors , 1989 .

[92]  Gautam Biswas,et al.  Designing Learning by Teaching Agents: The Betty's Brain System , 2008, Int. J. Artif. Intell. Educ..

[93]  Michael Drake,et al.  Scaffolding techniques of expert human tutors. , 1997 .

[94]  Ian M. Kinchin,et al.  Using PowerPoint as a lens to focus on linearity in teaching , 2008 .

[95]  Alberto J. Cañas,et al.  Mining the Web to Suggest Concepts during Concept Map Construction , 2004 .

[96]  Raymond Y. K. Lau,et al.  Towards Fuzzy Domain Ontology Based Concept Map Generation for E-Learning , 2007, ICWL.

[97]  Olusola O. Adesope,et al.  Learning With Concept and Knowledge Maps: A Meta-Analysis , 2006 .

[98]  Boris Katz,et al.  Annotating the World Wide Web using Natural Language , 1997, RIAO.

[99]  Enrico Motta,et al.  AquaLog: An ontology-driven question answering system for organizational semantic intranets , 2007, J. Web Semant..

[100]  Peter W. Foltz,et al.  The Debate on Automated Essay Grading , 2000, IEEE Intell. Syst..

[101]  Arthur C. Graesser,et al.  Question Generation from Concept Maps , 2012, Dialogue Discourse.

[102]  Nancy Ide,et al.  Introduction to the Special Issue on Word Sense Disambiguation: The State of the Art , 1998, Comput. Linguistics.

[103]  Hiromitsu Shimakawa,et al.  Semantic Network to Formalize Learning Items from Lecture Notes , 2011 .

[104]  Dekang Lin,et al.  Dependency-Based Evaluation of Minipar , 2003 .

[105]  Joseph D. Novak,et al.  Meaningful learning: The essential factor for conceptual change in limited or inappropriate propositional hierarchies leading to empowerment of learners , 2002 .

[106]  Nickolas J. G. Falkner,et al.  Acquisition of Triples of Knowledge from Lecture Notes: A Natural Langauge Processing Approach , 2014, EDM.

[107]  Robert McCartney,et al.  Student understanding of object-oriented programming as expressed in concept maps , 2008, SIGCSE '08.

[108]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[109]  Dunja Mladenic,et al.  AnswerArt - Contextualized Question Answering , 2010, ECML/PKDD.

[110]  Ana Arruarte Lasa,et al.  The use of concept maps in Computer Engineering education to promote meaningful learning, creativity and collaboration , 2011, 2011 Frontiers in Education Conference (FIE).

[111]  Marko Grobelnik,et al.  A SURVEY OF ONTOLOGY EVALUATION TECHNIQUES , 2005 .

[112]  Elizabeth A. Davis,et al.  Metacognitive Scaffolding To Foster Scientific Explanations. , 1996 .

[113]  Peter Maurer,et al.  The Cambridge Handbook of the Learning Sciences , 2022 .

[114]  Joseph Krajcik,et al.  Scaffolding in the small: designing educational supports for concept mapping on handheld computers , 2002, CHI Extended Abstracts.

[115]  Pierre Tchounikine,et al.  Computer Science and Educational Software Design - A Resource for Multidisciplinary Work in Technology Enhanced Learning , 2011 .

[116]  I. Kinchin,et al.  How a qualitative approach to concept map analysis can be used to aid learning by illustrating patterns of conceptual development , 2000 .

[117]  Thomas W. Bean,et al.  Scaffolding Reflection for Preservice and Inservice Teachers , 2002 .

[118]  Doug Downey,et al.  Unsupervised named-entity extraction from the Web: An experimental study , 2005, Artif. Intell..

[119]  Angela M. O'Donnell,et al.  Interactive Effects of Prior Knowledge and Material Format on Cooperative Teaching , 2000 .

[120]  Francis P. Hunkins Questioning strategies and techniques , 1972 .

[121]  L. Irvine,et al.  Can concept mapping be used to promote meaningful learning in nurse education? , 1995, Journal of advanced nursing.

[122]  José Maria Parente de Oliveira,et al.  Concept maps as the first step in an ontology construction method , 2013, Inf. Syst..

[123]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[124]  M. F. Porter,et al.  An algorithm for suffix stripping , 1997 .

[125]  A. Graesser,et al.  Mechanisms that generate questions , 1992 .

[126]  David B. Leake,et al.  JUMP-STARTING CONCEPT MAP CONSTRUCTION WITH KNOWLEDGE EXTRACTED FROM DOCUMENTS , 2006 .

[127]  Nickolas J. G. Falkner,et al.  Educational Question Answering Motivated by Question-Specific Concept Maps , 2015, AIED.

[128]  Alberto J. Cañas,et al.  Using Automatically Generated Concept Maps for Document Understanding: a Human Subjects Experiment , 2012 .

[129]  Vipin Kumar,et al.  Introduction to Data Mining , 2022, Data Mining and Machine Learning Applications.

[130]  Ted Dunning,et al.  Accurate Methods for the Statistics of Surprise and Coincidence , 1993, CL.

[131]  David Leake,et al.  Understanding Knowledge Models: Modeling Assessment of Concept Importance in Concept Maps , 2004 .

[132]  Gary T. Henry,et al.  Formative Evaluation , 2013 .

[133]  Ellen Riloff,et al.  A Corpus-Based Approach for Building Semantic Lexicons , 1997, EMNLP.

[134]  Wolff‐Michael Roth,et al.  The concept map as a tool for the collaborative construction of knowledge: A microanalysis of high school physics students , 1993 .

[135]  Joseph D. Novak,et al.  Alternative instructional systems and the development of problem‐solving skills in physics , 1985 .

[136]  B. Meyer Use of Top-Level Structure in Text: Key for Reading Comprehension of Ninth-Grade Students. , 1980 .

[137]  Graeme Hirst,et al.  Knowledge and knowledge acquisition in the computational context , 1992 .

[138]  Donald F. Dansereau,et al.  Effects of Knowledge Maps and Prior Knowledge on Recall of Science Lecture Content , 1992 .

[139]  E. Yalow On Educational psychology: A cognitive view. , 1979 .

[140]  Chris Quintana,et al.  Scaffolding strategies for supporting middle school students' online inquiry processes , 2012, Comput. Educ..

[141]  Robert A. Bartsch,et al.  Effectiveness of PowerPoint presentations in lectures , 2003, Comput. Educ..

[142]  Gloria Gomez,et al.  CmapTools: A Knowledge Modeling and Sharing Environment , 2004 .

[143]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[144]  P. Hayes,et al.  Online Concept Maps: Enhancing Collaborative Learning by Using Technology with Concept Maps , 2001 .

[145]  William W. Wilen Questioning skills, for teachers , 1982 .