Student evaluation of a virtual experience for project management learning: An empirical study for learning improvement

Project management education was designed traditionally according to an expository paradigm. However, it needs to be redefined to engage students in higher order thinking and to facilitate effective learning. This study proposes a student-centered approach that is aligned with situated learning theory in virtual teams and explores its impact on student satisfaction and learning outcomes. Using a quasi-experimental design, 122 undergraduate and master's degree students enrolled in project management courses at two universities in separate locations. They were separated randomly into two groups, an experimental group in which students used the proposed student-centered approach and a control group in which students followed a more traditional course design. Data analysis indicated a higher level of satisfaction and performance with the proposed methodology. These results suggest that the presented methodology, which was based on project-based learning in an authentic context that offers opportunities for students to experience virtual teamwork, was more effective than traditional teaching approaches. Furthermore, there were some positive and significant correlations between students' satisfaction and their final marks. In this matter, the most relevant aspects to facilitate students' academic performance were (1) positive expectations of future professional development, (2) clear learning objectives that consistently relate to the content of the course, (3) positive feelings induced by teachers' support in resolving doubts, and (4) academic self-perception. The findings of this study suggest that motivational and affective states influence student learning in higher education. This is consistent with current learning theories. A framework designed to facilitate learning in Project Management is presented.The adopted student-centered approach is supported by the use of ICT tools.The methodology based on situated learning increases the students' performance.Students are, in general, more satisfied with the new methodological approach.Some correlations between students' satisfaction and their final marks were found.

[1]  Joaquín B. Ordieres Meré,et al.  An analytical method for measuring competence in project management , 2016, Br. J. Educ. Technol..

[2]  R. Mayer.  Should there be a three-strikes rule against pure discovery learning? The case for guided methods of instruction. , 2004, The American psychologist.

[3]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[4]  Jennifer L. Maeng,et al.  Learning in context: Technology integration in a teacher preparation program informed by situated learning theory , 2013 .

[5]  Yi-Shun Wang,et al.  Measuring e-learning systems success in an organizational context: Scale development and validation , 2007, Comput. Hum. Behav..

[6]  Hahn-Ming Lee,et al.  Personalized e-learning system using Item Response Theory , 2005, Comput. Educ..

[7]  M. A. Shah,et al.  Growth of zinc oxide (ZnO) nanorods and their optical properties , 2011 .

[8]  J. Biggs,et al.  The revised two-factor Study Process Questionnaire: R-SPQ-2F. , 2001, The British journal of educational psychology.

[9]  César Hervás-Martínez,et al.  PpcProject: An educational tool for software project management , 2013, Comput. Educ..

[10]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[11]  Michael Stodnick,et al.  Using SERVQUAL to Measure the Quality of the Classroom Experience , 2008 .

[12]  He Jing,et al.  The Project Management Maturity Model and Application Based on PRINCE2 , 2012 .

[13]  Kamalanath Priyantha Hewagamage,et al.  Redesigned Framework and Approach for IT Project Management , 2011 .

[14]  Scott D. Johnson,et al.  Team development and group processes of virtual learning teams , 2002, Comput. Educ..

[15]  Mehryar Nooriafshar.  The effectiveness of a lifecycle approach to learning project management , 2013 .

[16]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[17]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[18]  Markku Niemivirta,et al.  Relations between teacher students’ approaches to learning, cognitive and attributional strategies, well-being, and study success , 2012 .

[19]  G. Carvalho,et al.  Tradução do Guia de Competências Individuais ICB-4 da International Project Management Association (IPMA) , 2017 .

[20]  Craig Caulfield,et al.  Teaching Software Engineering Project Management – A Novel Approach for Software Engineering Programs , 2011 .

[21]  T. Sass,et al.  Teacher training, teacher quality and student achievement , 2011 .

[22]  T. Seidel.  Implementing competence assessment in university education. A comment on using the Collegiate Learning Assessment as a prototype , 2012 .

[23]  In Lee,et al.  Learners' acceptance of e-learning in South Korea: Theories and results , 2009, Comput. Educ..

[24]  Olga C. Santos,et al.  Practical guidelines for designing and evaluating educationally oriented recommendations , 2015, Comput. Educ..

[25]  Jonas Söderlund,et al.  Rethinking project management education : Social twists and knowledge co-production , 2008 .

[26]  Ana González-Marcos,et al.  Competence Assessment Framework for Project Management Learners and Practitioners , 2014, CSEDU.

[27]  Pilar Martínez Clares,et al.  Promoción del aprendizaje estratégico y competencias de aprendizaje en estudiantes de primero de Universidad : evaluación de una intervención , 2006 .

[28]  K. Lonka,et al.  MED NORD–A tool for measuring medical students’ well-being and study orientations , 2008, Medical teacher.

[29]  Robert O'Dowd,et al.  Telecollaborative networks in university higher education: Overcoming barriers to integration , 2013, Internet High. Educ..

[30]  T. Wolsey.  Efficacy of Instructor Feedback on Written Work in an Online Program , 2008 .

[31]  Joan E. Hughes,et al.  The Role of Teacher Knowledge and Learning Experiences in Forming Technology-Integrated Pedagogy , 2005 .

[32]  Inmaculada García,et al.  Motivation and learning strategies in the use of ICTs among university students , 2013, Comput. Educ..

[33]  Gary A. Smith.  How Does Student Performance on Formative Assessments Relate to Learning Assessed by Exams , 2007 .

[34]  Mohammad Hossein Yarmohammadian,et al.  Evaluation of quality of education in higher education based on Academic Quality Improvement Program (AQIP) Model , 2011 .

[35]  F. Dochy,et al.  Student-centred learning environments: an investigation into student teachers’ instructional preferences and approaches to learning , 2016 .

[36]  Russell Haines,et al.  Group development in virtual teams: An experimental reexamination , 2014, Comput. Hum. Behav..

[37]  Jay F. Nunamaker,et al.  Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness , 2006, Inf. Manag..

[38]  W. Xiang,et al.  Using computer software packages to enhance the teaching of engineering management science: Part 1—Critical path networks , 2011, Comput. Appl. Eng. Educ..

[39]  Carlos Delgado Kloos,et al.  Lessons learned from the design of situated learning environments to support collaborative knowledge construction , 2015, Comput. Educ..

[40]  Axelos.  Managing Successful Projects with PRINCE2 , 2009 .

[41]  Paul Ginns,et al.  Developing conceptions of teaching and the scholarship of teaching through a Graduate Certificate in Higher Education , 2008 .

[42]  Roy D. Pea,et al.  Addressing the Challenges of Inquiry-Based Learning Through Technology and Curriculum Design , 1999 .

[43]  Guido Hertel,et al.  Managing virtual teams: A review of current empirical research , 2005 .

[44]  G. Brosvic,et al.  Immediate Feedback Assessment Technique Promotes Learning and Corrects Inaccurate first Responses , 2002 .

[45]  Janice Thomas,et al.  Preparing project managers to deal with complexity–advanced project management education , 2008, IEEE Engineering Management Review.

[46]  Christiane Gresse von Wangenheim,et al.  DELIVER! - An educational game for teaching Earned Value Management in computing courses , 2012, Inf. Softw. Technol..

[47]  John A Scigliano,et al.  Mastering Virtual Teams: Strategies, Tools, and Techniques that Succeed: Deborah L. Duarte and Nancy Tennant Snyder. (2000). 2nd ed., San Francisco, CA: Jossey-Bass, 256 pages. ISBN: 0-7879-5589-2W01. US$39.95, includes a CD-ROM , 1999, Internet High. Educ..

[48]  J. W. Gikandi,et al.  Online formative assessment in higher education: A review of the literature , 2011, Comput. Educ..

[49]  W. Duncan.  A GUIDE TO THE PROJECT MANAGEMENT BODY OF KNOWLEDGE , 1996 .

[50]  Timothy J. Kloppenborg,et al.  Project Management in Local Nonprofit Organizations: Engaging Students in Problem-Based Learning , 2004 .

[51]  Udechukwu Ojiako,et al.  Learning and teaching challenges in project management , 2011 .

[52]  Brigitte Maier,et al.  Students' expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction , 2010, Comput. Educ..

[53]  Christophe Kolski,et al.  Framework for the evolution of acquiring knowledge modules to integrate the acquisition of high-level cognitive skills and professional competencies: Principles and case studies , 2011, Comput. Educ..

[54]  J. Rodney Turner,et al.  Learning by Experience in the Project-Bases Organization , 2000 .

[55]  Tahir Masood Qureshi,et al.  Significance of project management performance assessment (PMPA) model , 2009 .

[56]  Günter L. Huber.  Aprendizaje activo y metodologías educativas , 2008 .

[57]  Roger Atkinson,et al.  Excellence in teaching and learning for project management , 2006 .

[58]  Shahron Williams van Rooij.  Scaffolding project-based learning with the project management body of knowledge (PMBOK®) , 2009, Comput. Educ..

[59]  Sara Hennessy,et al.  Developing a typology of teacher beliefs and practices concerning classroom use of ICT , 2013, Comput. Educ..

[60]  Sevgi Özkan,et al.  Multi-dimensional students' evaluation of e-learning systems in the higher education context: An empirical investigation , 2009, Comput. Educ..

[61]  Stephanie Bell.  Project-Based Learning for the 21st Century: Skills for the Future , 2010 .

[62]  Beatrix Niemeyer.  El aprendizaje situado : una oportunidad para escapar del enfoque del déficit , 2006 .

[63]  Yong-Hui Li,et al.  Exploitative and exploratory learning in transactive memory systems and project performance , 2013, Inf. Manag..

[64]  Kerstin E. E. Schroder,et al.  Interaction, Internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education courses , 2014, Internet High. Educ..

[65]  P. Jonnaert,et al.  Compétences et socioconstructivisme : un cadre théorique , 2002 .

[66]  A. Parasuraman,et al.  A Conceptual Model of Service Quality and Its Implications for Future Research , 1985 .

[67]  F. Buttle.  SERVQUAL: review, critique, research agenda , 1996 .

[68]  Jan Bietenbeck,et al.  Teaching practices and cognitive skills , 2014 .

[69]  John Biggs,et al.  Calidad del aprendizaje universitario , 2005 .

[70]  Ana González Marcos,et al.  An active project management framework for professional skills development , 2014 .

[71]  Jesús Sánchez Gómez,et al.  How team feedback and team trust influence information processing and learning in virtual teams: A moderated mediation model , 2015, Comput. Hum. Behav..