Planning and implementing a new assessment strategy using an e-learning platform

One of the most difficult issues of e Learning is the students’ assessment. Being this an outstanding task regarding theoretical topics, it becomes even more challenging when the topics under evaluation are practical. ISCAP’s Information Systems Department is composed of about twenty teachers who have been for several years using an e learning environment (at the moment Moodle 2.3) combined with traditional assessment. They are now planning and implementing a new e learning assessment strategy. This effort was undertaken in order to evaluate a practical topic (the use of spreadsheets to solve management problems) common to shared courses of several undergraduate degree programs. The same team group is already experienced in the assessment of theoretical information systems topics using the b learning platform. Therefore, this project works as an extension to previous experiences being the team aware of the additional difficulties due to the practical nature of the topics. This paper describes this project and presents two cycles of the action research methodology, used to conduct the research. The first cycle goal was to produce a database of questions. When it was implemented in order to be used with a pilot group of students, several problems were identified. Subsequently, the second cycle consisted in solving the identified problems preparing the database and all the players to a broader scope implementation. For each cycle, all the phases, its drawbacks and achievements are described. This paper suits all those who are or are planning to be in the process of shifting their assessment strategy from a traditional to one supported by an e learning platform.

[1]  Steven Lonn,et al.  Who needs to do what where?: Using learning management systems on residential vs. commuter campuses , 2011, Comput. Educ..

[2]  Rosalina Babo,et al.  Learning management systems usage on higher education institutions , 2009 .

[3]  Richard Baskerville,et al.  Diversity in information systems action research methods , 1998 .

[4]  Harry Evdorides,et al.  Developing formative assessments for postgraduate students in engineering , 2005 .

[5]  Jan Stage,et al.  Controlling Prototype Development Through Risk Analysis , 1996, MIS Q..

[6]  Arne Koesling,et al.  Strategies of LMS Implementation at German Universities , 2012 .

[7]  Francisco Falcone,et al.  Use of e-learning functionalities: Results of a survey along Spain , 2010, IEEE EDUCON 2010 Conference.

[8]  Robert W. Folden General Perspective in Learning Management Systems , 2012 .

[9]  David E. Avison,et al.  Controlling action research projects , 2001, Inf. Technol. People.

[10]  Marina Ribaudo,et al.  LMS Adoption at the University of Genova: Ten Years After , 2012 .

[11]  Niklas Arvidsson,et al.  Exploring tensions in projectified matrix organisations , 2009 .

[12]  Ivica Boticki,et al.  Knowledge assessment at the Faculty of Electrical Engineering and Computing , 2008, ITI 2008 - 30th International Conference on Information Technology Interfaces.

[13]  George McGuire,et al.  Mathematical ability assessed by computer , 1995 .

[14]  Kathy Schwalbe,et al.  Information Technology Project Management , 1999 .

[15]  Carla Teixeira Lopes,et al.  Differences in internet and LMS usage: a case study in higher education , 2012 .

[16]  Alexander Kock,et al.  Behavior of internal stakeholders in project portfolio management and its impact on success , 2013 .

[17]  Martín Llamas Nistal,et al.  Blended e-assessment: Migrating classical exams to the digital world , 2013, Comput. Educ..

[18]  Jim Bindl,et al.  Small Steps, Big Reward: Quality Improvement through Pilot Groups. , 1988 .

[19]  Richard Baskerville,et al.  Investigating Information Systems with Action Research , 1999, Commun. Assoc. Inf. Syst..