Has the Bologna process been worthwhile? An analysis of the Learning Society-Adapted Outcome Index through quantile regression

This paper seeks to discover whether the performance of university students has improved in the wake of the changes in higher education introduced by the Bologna Declaration of 1999 and the construction of the European Higher Education Area. A principal component analysis is used to construct a multi-dimensional performance variable called the LEArning Society-adapted Outcome Index. A quantile regression is then applied to ensure that the analysis does not focus solely on average figures, and the performance of students of various types is analyzed. Significant improvements are found in the acquisition of systemic and interpersonal skills and in student satisfaction but not in cognitive aspects. There are improvements in students of all types, but they are smaller among the best students.

[1]  C. Hmelo‐Silver.  Problem-Based Learning: What and How Do Students Learn? , 2004 .

[2]  Paul W. Grimes,et al.  Grades—Who's to Blame? Student Evaluation of Teaching and Locus of Control , 2004 .

[3]  P. J. Pérez,et al.  IMPORTANCIA DE LAS PERTURBACIONES EXTERNAS EN LA ECONOMÍA ESPAÑOLA TRAS LA INTEGRACIÓN: ¿TAMAÑO DEL SHOCK O GRADO DE RESPUESTA? , 2005 .

[4]  Mathew Joseph,et al.  An educational institution's quest for service quality: customers’ perspective , 2005 .

[5]  J. González,et al.  Tuning Educational Structures in Europe , 2003 .

[6]  María Martínez Lirola,et al.  Students’ beliefs about portfolio evaluation and its influence on their learning outcomes to develop EFL in a Spanish context , 2009 .

[7]  Harsharanjeet S. Jagpal.  Multicollinearity in Structural Equation Models with Unobservable Variables , 1982 .

[8]  Ines Herrero,et al.  Is the new ECTS system better than the traditional one? An application to the ECTS pilot-project at the University Pablo de Olavide , 2010, Eur. J. Oper. Res..

[9]  L. J. Williams,et al.  Exploratory and confirmatory factor analysis: guidelines, issues, and alternatives , 1997 .

[10]  Michael Guolla,et al.  STUDENT SATISFACTION RELATIONSHIP: APPLIED CUSTOMER SATISFACTION RESEARCH IN THE CLASSROOM , 1999 .

[11]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[12]  Youth.  Teaching and learning - towards the learning society : white paper on education and training , 1996 .

[13]  María J. Martín,et al.  Teaching Digital Systems in the Context of the New European Higher Education Area: A Practical Experience , 2009, IEEE Transactions on Education.

[14]  Gonzalo Almerich,et al.  Learning strategies in excellent and average university students. Their evolution over the first year of the career , 2012 .

[15]  Erica Macho-Stadler,et al.  Case study of a problem-based learning course of physics in a telecommunications engineering degree , 2013 .

[16]  Nandish V. Patel,et al.  A holistic approach to learning and teaching interaction: factors in the development of critical learners , 2003, International Journal of Educational Management.

[17]  Cindy E. Hmelo-Silver,et al.  Problem-Based Learning: What and How Do , 2004 .

[18]  Allen Gibson.  Measuring business student satisfaction: a review and summary of the major predictors , 2010 .

[19]  Barbara Sinclair,et al.  Integrating Simulated Teaching/Learning Strategies in Undergraduate Nursing Education , 2009, International journal of nursing education scholarship.

[20]  Bengt-Åke Lundvall,et al.  The University in the Learning Economy , 2002 .

[21]  Maria Dolores Gil Montoya,et al.  Engaging students in computer-supported cooperative learning , 2013, Int. J. Learn. Technol..

[22]  S. E. M. Everwijn,et al.  Ability- or competence-based education: Bridging the gap between knowledge acquisition and ability to apply , 1993 .

[23]  J. Biggs,et al.  The revised two-factor Study Process Questionnaire: R-SPQ-2F. , 2001, The British journal of educational psychology.

[24]  Prashant Kumar,et al.  Improving student learning in engineering discipline using student- and lecturer-led assessment approaches , 2011 .

[25]  Barbara A. Price,et al.  Assessing Learning Outcomes in Quantitative Courses: Using Embedded Questions for Direct Assessment , 2008 .

[26]  Kathryn A. Martell,et al.  Assessing Student Learning: Are Business Schools Making the Grade? , 2007 .

[27]  Jussi Välimaa,et al.  Knowledge society discourse and higher education , 2008 .

[28]  Ernest Valveny,et al.  Adaptation of a computer programming course to the ESHE requirements: evaluation five years later , 2012 .

[29]  J. Bindé.  Towards knowledge societies: UNESCO world report , 2005 .

[30]  K. Mumford,et al.  Student Performance in Undergraduate Economics Courses , 2011 .

[31]  Ellen Sewell,et al.  Grade Dropping: An Empirical Analysis , 2004 .

[32]  K. Krentler,et al.  Measuring Student Expectations and Their Effects on Satisfaction: The Importance of Managing Student Expectations , 2006 .

[33]  David F. Larcker,et al.  Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics: , 1981 .

[34]  David W. Johnson,et al.  Cooperative Learning Returns To College What Evidence Is There That It Works , 1998 .

[35]  Marie Schmidt,et al.  Learning to Teach in Higher Education , 1992 .

[36]  J. Biggs.  Student Approaches to Learning and Studying , 1987 .

[37]  W. Steele,et al.  Generating academic standards and assessment practices in work integrated learning: a case study from urban and regional planning , 2009 .

[38]  D. Boud.  Sustainable Assessment: Rethinking assessment for the learning society , 2000 .

[39]  Giuseppe Vittorio Silvestrini.  Toward Knowledge Societies , 2013 .

[40]  O. Gutierrez,et al.  EL ÉXITO EN LA UNIVERSIDAD: UNA APROXIMACIÓN CUANTÍLICA * , 2007 .

[41]  R. Koenker,et al.  Regression Quantiles , 2007 .

[42]  Alfred Joseph Lizzio,et al.  University Students' Perceptions of the Learning Environment and Academic Outcomes: Implications for theory and practice , 2002 .

[43]  M. Castro,et al.  Modeling the best practices towards the adaptation to the European credit transfer system in technical degrees within the IEEE ES chapter , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[44]  María Luz Martín-Peña,et al.  Metodología Docente Y Evaluación Por Competencias: Una Experiencia En La Materia Dirección De Producción / Teaching Methodology And Skills Acquisitions: An Experience In Production Management Field , 2012 .

[45]  A. Kara,et al.  Determinants of Business Student Satisfaction and Retention in Higher Education: Applying Herzberg's Two-Factor Theory. , 2005 .

[46]  Michael C. W. Yip.  Differences in Learning and Study Strategies between High and Low Achieving University Students: A Hong Kong study , 2007 .

[47]  Eric R. Eide,et al.  The effect of school quality on student performance: A quantile regression approach , 1998 .

[48]  R. Beecham,et al.  Teaching Quality and Student Satisfaction: Nexus or Simulacrum?. , 2009 .

[49]  Michael C. W. Yip.  Differences between high and low academic achieving university students in learning and study strategies: a further investigation , 2009 .

[50]  E. Jansen,et al.  The relationship between perceived competence and earned credits in competence-based higher education , 2013 .

[51]  Esa Poikela,et al.  Understanding problem-based learning , 2006 .

[52]  S. Hooper,et al.  A "learning society"? , 1996, Science.

[53]  R. M. Lima,et al.  Engaging students in learning: findings from a study of project-led education , 2014 .

[54]  B. Fraser.  Science Learning Environments: Assessment, Effects and Determinants , 1998 .

[55]  Juan C. Burguillo,et al.  Using game theory and Competition-based Learning to stimulate student motivation and performance , 2010, Comput. Educ..

[56]  E. Graaff,et al.  History of problem-based and project-based learning , 2007 .

[57]  R. Koenker.  Quantile Regression: Name Index , 2005 .

[58]  Paul A. Kirschner,et al.  Using integrated electronic environments for collaborative teaching/learning , 2001 .

[59]  J. Biggs.  What do inventories of students' learning processes really measure? A theoretical review and clarification. , 1993, The British journal of educational psychology.

[60]  Hans Hummel,et al.  The design of a study environment for acquiring academic and professional competence , 1997 .

[61]  Anna Tuschling,et al.  From Education to Lifelong Learning: The emerging regime of learning in the European Union , 2006 .

[62]  John B. Biggs,et al.  Teaching for Quality Learning at University: What the Student Does , 1999 .

[63]  M. S. Sohail,et al.  Quest for Excellence in Business Education: A Study of Student Impressions of Service Quality , 2004 .

[64]  Anette Kolmos,et al.  Management of change : Implementation of problem-based and project-based learning in engineering , 2007 .