EVALUATION OF USER PRACTICES DURING COLLABORATIVE PROCESSES THROUGH PROPOSED HISTORICAL PROJECTION

The paper focuses on the domain of user behaviour evaluation in the collaborative processes performed in a virtual user environment. Proposed historical projection of activities performed in such an environment provides several analytic perspectives materialised in form of different tools, but all of them are based on suitable visualization and extraction techniques. The differences are based on different analytical tasks to be supported by particular analytic tools. We will describe two of these analytic tools, but only one in more details because of our direct involvement in the design and implementation of this tool as project partner in the IST European project called KP-Lab. The main technological output of this project is represented by KP-Lab System as an original platform for support of collaborative working and learning practices based on knowledge creation metaphor. The first analytic approach is based on interactive visualisation of available historical data based on user requirements in simple and user friendly graphical formats as graphs or charts. The second analytic approach provides historical retrospective of performed collaborative processes based on timeline form visualisation of performed events with different selection a patterns’ search capabilities. These two approaches can be used instead of often used manual methods of user behaviour evaluation e.g. in a learning course. Manual evaluation is much more time consuming and tedious for teachers or researchers from several reasons: necessary collection of all materials from students, laborious analysis of their communication channels etc.; e.g. in this case it is difficult to identify the real involvement of each student. Suitable visualisation of automatically collected data with the possibility to define constraints based on users’needs provides easier approach, mainly in the case of large students’ groups. In our paper we will describe our motivation, related works, briefly the first analytical approach and the second one in more details as an important output of our research group.

[1]  Jun Luo,et al.  Towards evaluating learners' behaviour in a Web-based distance learning environment , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[2]  Erno Lehtinen,et al.  Evaluating CSCL log files by social network analysis , 1999, CSCL.

[3]  Urban Nuldén,et al.  Visualizing learning activities to support tutors , 1999, CHI Extended Abstracts.

[4]  Nicolas Spyratos,et al.  A Framework to Analyze Information Visualization Based on the Functional Data Model , 2009, 2009 13th International Conference Information Visualisation.

[5]  F. Babic,et al.  A logging mechanism for acquisition of real data from different collaborative systems for analytical purposes , 2010, 2010 IEEE 8th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[6]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[7]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[8]  Wil M. P. van der Aalst,et al.  Semantic Process Mining Tools: Core Building Blocks , 2008, ECIS.

[9]  Boudewijn F. van Dongen,et al.  ProM: The Process Mining Toolkit , 2009, BPM.

[10]  K. Hakkarainen,et al.  FROM MONOLOGICAL AND DIALOGICAL TO TRIALOGICAL APPROACHES TO LEARNING , 2007 .