Quantitative Analysis of the Usage of the COSMOS Science Education Portal

A quantitative method of mapping the web usage of an innovative educational portal is applied to analyze the behaviour of users of the COSMOS Science Education Portal. The COSMOS Portal contains user-generated resources (that are uploaded by its users). It has been designed to support a science teacher’s search, retrieval and access to both, scientific and educational resources. It also aims to introduce in and familiarize teachers with an innovative methodology for designing, expressing and representing educational practices in a commonly understandable way through the use of user-friendly authoring tools that are available through the portal. As a new science education portal that includes user-generated content, the COSMOS Portal encounters the well-known “new product/service challenge”: to convince the users to use its tools, which facilitate quite fast lesson planning and lesson preparation activities. To respond to this challenge, the COSMOS Portal operators implemented a validation process by analyzing the usage data of the portal in a 10 month time-period. The data analyzed comprised: (a) the temporal evolution of the number of contributors and the amount of content uploaded to the COSMOS Portal; (b) the number of portal visitors (categorized as all-visitors, new-visitors, and returning-visitors) and (c) visitor loyalty parameters (such as page-views; pages/visit; average time on site; depth of visit; length of visit). The data is augmented with data associated with the usage context (e.g. the time of day when most of the activities in the portal take place). The quantitative results indicate that the exponential growth of the contributors to the COSMOS Portal is followed by an exponential growth of the uploaded content. Furthermore, the web usage statistics demonstrate significant changes in users’ behaviour during the period under study, with returning visitors using the COSMOS Portal more frequently, mainly for lesson planning and preparation (in the afternoon hours). The findings demonstrate that the new COSMOS users follow the “law of surfing” behaviour, a common pattern of surfing behaviour in portals. However, users return to the COSMOS Portal: returning users comprise more than 50% of all COSMOS visits, stay longer on site and visit more pages. Returning visitors are benchmarked against the “law of surfing” and outperform it substantially. These quantitative results benchmark the web usage of a portal and provide its operators with maps of value-added patterns of the portal’s offering to its users in the science education community.

[1]  G. Madey,et al.  Uncovering individual and collective human dynamics from mobile phone records , 2007, 0710.2939.

[2]  Didier Sornette,et al.  Download relaxation dynamics on the WWW following newspaper publication of URL , 2000 .

[3]  J. Voogt,et al.  International handbook of information technology in primary and secondary education , 2008 .

[4]  N. Law.  Teacher Learning Beyond Knowledge for Pedagogical Innovations with ICT , 2008 .

[5]  Erik Duval,et al.  Quantitative Analysis of Learning Object Repositories , 2008, IEEE Transactions on Learning Technologies.

[6]  Riina Vuorikari,et al.  An Overview of Learning Object Repositories , 2009, Database Technologies: Concepts, Methodologies, Tools, and Applications.

[7]  Pamela Taylor Northrup,et al.  Learning Objects for Instruction: Design and Evaluation , 2007 .

[8]  Deborah J. Trumbull.  Students’ Actual and Perceived Use of Navigational and Guidance Tools in a Hypermedia Program , 1992 .

[9]  Claire Bradley,et al.  The Design, Development, and Use of Multimedia Learning Objects , 2004 .

[10]  S. M. Duncan.  Patterns of learning object reuse in the connexions repository , 2009 .

[11]  Sofoklis Sotiriou.  COSMOS: An Advanced Scientific Repository for Science Teaching and Learning , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[12]  Robin Kay.  A Systematic Evaluation of Learning Objects for Secondary School Students , 2007 .

[13]  Rob Koper,et al.  Combining reusable learning resources and services to pedagogical purposeful units of learning , 2003 .

[14]  Mimi Recker,et al.  Using web metrics to analyze digital libraries , 2008, JCDL.

[15]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[16]  Walter Willinger,et al.  Scaling phenomena in the Internet: Critically examining criticality , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Lajeane Thomas,et al.  Information, Communications, and Educational Technology Standards for Students, Teachers, and School Leaders , 2008 .

[18]  A. Basu,et al.  The Inverse Gaussian Distribution , 1993 .

[19]  A. M. Edwards,et al.  Revisiting Lévy flight search patterns of wandering albatrosses, bumblebees and deer , 2007, Nature.

[20]  A. Barabasi,et al.  Dynamics of information access on the web. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  R. Dean Malmgren,et al.  Log-normal statistics in e-mail communication patterns , 2008 .

[22]  Kwok-Wing Lai,et al.  ICT Supporting the Learning Process: The Premise, Reality, and Promise , 2008 .

[23]  David F. Treagust,et al.  Conceptual change: a discussion of theoretical, methodological and practical challenges for science education , 2008 .

[24]  Carl Lagoze,et al.  Metadata aggregation and "automated digital libraries": a retrospective on the NSDL experience , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[25]  Panagiotis Zervas,et al.  Enhancing Educational Metadata with Science Education Information , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[26]  Annette Simpson.  Lost in hyperspace: How can designers help? , 1990, Intell. Tutoring Media.

[27]  Rob Koper,et al.  Use of the Semantic Web to Solve Some Basic Problems in Education: Increase Flexible , 2004 .

[28]  R. McCormick,et al.  An evaluation of European learning objects in use , 2006 .

[29]  Nancy A. Vanhouse,et al.  Digital Library Use: Social Practice in Design and Evaluation , 2003 .

[30]  B. Buttenfield,et al.  An Ecological Perspective on Digital Libraries , 2003 .

[31]  Ruth Thomas,et al.  Putting Teachers in the Loop: Tools for Creating and Customising Simulations , 2004 .

[32]  Albert-László Barabási,et al.  The origin of bursts and heavy tails in human dynamics , 2005, Nature.

[33]  Antonio G. Chessa,et al.  A memory model for internet hits after media exposure , 2004 .

[34]  Thomas Cochrane,et al.  Interactive QuickTime: Developing and Evaluating Multimedia Learning Objects to Enhance Both Face-To-Face and Distance E-Learning Environments , 2004 .

[35]  Albert-László Barabási,et al.  Modeling bursts and heavy tails in human dynamics , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Michael Khoo.  Evaluating digital libraries with webmetrics , 2007, JCDL '07.

[37]  Allison Littlejohn,et al.  Characterising effective eLearning resources , 2008, Comput. Educ..

[38]  Huberman,et al.  Strong regularities in world wide web surfing , 1998, Science.

[39]  R. Perline.  Strong, Weak and False Inverse Power Laws , 2005 .

[40]  A. Johansen.  Probing human response times , 2003, cond-mat/0305079.

[41]  Eduardo S. Schwartz,et al.  Investment Under Uncertainty. , 1994 .

[42]  Jean-Pierre Eckmann,et al.  Entropy of dialogues creates coherent structures in e-mail traffic. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Xin Mao,et al.  A study of teachers’ use of online learning resources to design classroom activities , 2007, New Rev. Hypermedia Multim..