Mining concept maps from news stories for measuring civic scientific literacy in media

Motivated by a long-term goal in education for measuring Taiwanese civic scientific literacy in media (SLiM), this work reports the detailed techniques to efficiently mine a concept map from 2years of Chinese news articles (901,446 in total) for SLiM instrument development. From the Chinese news stories, key terms (important words or phrases), known or new to existing lexicons, were first extracted by a simple, yet effective, rule-based algorithm. They were subjected to an association analysis based on their co-occurrence in sentences to reveal their term-to-term relationship. A given list of 3657 index terms from science textbooks were then matched against the term association network. The resulting term network (including 95 scientific terms) was visualized in a concept map to scaffold the instrument developers. When developing an item, the linked term pair not only suggests the topic for the item due to the clear context being mutually reinforced by each other, but also the content itself because of the rich background provided by the recurrent snippets in which they co-occur. In this way, the resulting instrument (comprised of 50 items) reflect the scientific knowledge revealed in the daily news stories, meeting the goal for measuring civic scientific literacy in media. In addition, the concept map mined from the texts served as a convenient tool for item classification, developer collaboration, and expert review and discussion.

[1]  Shian-Shyong Tseng,et al.  A new approach for constructing the concept map , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[2]  Shyan-Ming Yuan,et al.  Students' use of web-based concept map testing and strategies for learning , 2001 .

[3]  Chun-Yen Chang,et al.  Exploring Secondary Science Teachers' Perceptions on the Goals of Earth Science Education in Taiwan , 2009 .

[4]  Yuen-Hsien Tseng,et al.  Automatic thesaurus generation for Chinese documents , 2002, J. Assoc. Inf. Sci. Technol..

[5]  M. G. Jones,et al.  The concept map as a research and evaluation tool: Further evidence of validity , 1994 .

[6]  L. Thomas Hopkins.  A STUDY OF MAGAZINE AND NEWSPAPER SCIENCE ARTICLES WITH RELATION TO COURSES IN SCIENCES FOR HIGH SCHOOLS1 , 1925 .

[7]  Yao-Ting Sung,et al.  Learning through computer‐based concept mapping with scaffolding aid , 2001 .

[8]  Norman E. Wallen,et al.  How to Design and Evaluate Research in Education , 1990 .

[9]  Rafael A. Calvo,et al.  Concept Map Mining: A Definition and a Framework for Its Evaluation , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[10]  W. Edgar Martin.  A CHRONOLOGICAL SURVEY OF PUBLISHED RESEARCH STUDIES RELATING TO BIOLOGICAL MATERIALS IN NEWSPAPERS AND MAGAZINES , 1945 .

[11]  Vladimir Batagelj,et al.  Exploratory Social Network Analysis with Pajek , 2005 .

[12]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[13]  Ian M. Kinchin.  Concept-Mapping Activities To Help Students Understand Photosynthesis--and Teachers Understand Students , 2000 .

[14]  Gloria Gomez,et al.  CmapTools: A Knowledge Modeling and Sharing Environment , 2004 .

[15]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[16]  Kinshuk,et al.  Mining e-Learning domain concept map from academic articles , 2008, Comput. Educ..

[17]  Qin He,et al.  Knowledge Discovery Through Co-Word Analysis , 1999, Libr. Trends.

[18]  Trish Stoddart,et al.  Concept maps as assessment in science inquiry learning - a report of methodology , 2000 .

[19]  James Shanahan,et al.  Do They Know What They Read? Building a Scientific Literacy Measurement Instrument Based on Science Media Coverage , 2006 .

[20]  Shu-Nu Chang.  Externalising students' mental models through concept maps , 2007 .

[21]  J. Novak.  Concept maps and Vee diagrams: two metacognitive tools to facilitate meaningful learning , 1990 .

[22]  Ricardo Baeza-Yates,et al.  Information Retrieval: Data Structures and Algorithms , 1992 .

[23]  Richard M. Rowell,et al.  Concept Maps: A Tool for Use in Biology Teaching , 1979 .

[24]  M. F. Porter,et al.  An algorithm for suffix stripping , 1997 .

[25]  A. L. Woods,et al.  An investigation of the effectiveness of concept mapping as an instructional tool , 1993 .

[26]  J. Novak.  The Theory Underlying Concept Maps and How To Construct Them , 2004 .

[27]  Darina Dicheva,et al.  TM4L: Creating and browsing educational topic maps , 2006, Br. J. Educ. Technol..

[28]  Cynthia E. Glidden.  How to Design and Evaluate Research in Education (2nd ed.). , 1993 .

[29]  Angela M. O'Donnell,et al.  Knowledge Maps as Scaffolds for Cognitive Processing , 2002 .

[30]  R. Clariana,et al.  A computer-based approach for translating text into concept map-like representations , 2004 .

[31]  Gregory K. W. K. Chung,et al.  Reliability and validity of a computer-based knowledge mapping system to measure content understanding , 1999 .

[32]  Peter Akinsola Okebukola,et al.  Concept Mapping with a Cooperative Learning Flavor. , 1992 .

[33]  Lee-Feng Chien,et al.  PAT-tree-based keyword extraction for Chinese information retrieval , 1997, SIGIR '97.

[34]  Kola Soyibo,et al.  Using Concept Maps to Analyze Textbook Presentations of Respiration. , 1995 .

[35]  Charles L. Koelsche.  Scientific Literacy as Related to the Media of Mass Communication , 1965 .

[36]  George E. DeBoer,et al.  Scientific literacy: Another look at its historical and contemporary meanings and its relationship to science education reform , 2000 .