Comparison of student marks obtained by an assessment panel reveals generic problem-solving skills and academic ability as distinct skill sets

Abstract Generic problem-solving skills have been identified as one of the key competencies valued by professional programmes, university students and their future employers. A lack of widely available and simple testing tools prevents assessment of the development of student problem-solving skills. As part of a research study, a generic problem-solving test was administered to 130 third-year science students during three consecutive years. A comparison between the scores students achieved in this test with their six academic marks obtained in this course showed no significant correlation. Lack of correlation between the problem-solving skill test scores and academic marks of students was confirmed in a larger population of students participating in a campus-wide study of generic problem-solving skills (n = 830). Problem solving and academic performance may represent two independent skill sets of students; testing problem-solving skills of students could be introduced to achieve a more comprehensive evaluation of undergraduate student progress and achievement.

[1]  M. Scheerer,et al.  Problem Solving , 1967, Nature.

[2]  J. Piaget.  Intellectual Evolution from Adolescence to Adulthood , 1972 .

[3]  J. Piaget.  The Grasp of Consciousness: Action and Concept in the Young Child , 1976 .

[4]  N. Denney,et al.  A developmental study of adults' performance on traditional and practical problem-solving tasks. , 1982, Experimental aging research.

[5]  D. R. Shaffer,et al.  Developmental Psychology: Childhood and Adolescence , 1989 .

[6]  J. G. Adair,et al.  Hawthorne Control Procedures in Educational Experiments: A Reconsideration of Their Use and Effectiveness , 1989 .

[7]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[8]  S. Heidrich,et al.  Does social problem solving differ from other types of problem solving during the adult years? , 1994, Experimental aging research.

[9]  D. R. Woods.  Problem-based learning for large classes in chemical engineering , 1996 .

[10]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[11]  D. Cottrell,et al.  Structured teaching methods enhance skill acquisition but not problem‐solving abilities: an evaluation of the ‘silent run through’ , 1999, Medical education.

[12]  E. Morales-Mann,et al.  Problem-based learning in a new Canadian curriculum. , 2001, Journal of advanced nursing.

[13]  Deborah Allen,et al.  The power of problem-based learning : a practical "how to" for teaching undergraduate courses in any discipline , 2001 .

[14]  Wang Banyue,et al.  Chapter 5 , 2003 .

[15]  A. Demetriou.  Mind, Self, and Personality: Dynamic Interactions from Late Childhood to Early Adulthood , 2003 .

[16]  M. Segers,et al.  Effects of problem-based learning: a meta- analysis , 2003 .

[17]  Durward K. Sobek,et al.  The Engineering Problem-Solving Process: Good for Students? , 2004 .

[18]  Anthony R. Napoli,et al.  How Reliable Are Our Assessment Data?: A Comparison of the Reliability of Data Produced in Graded and Un-Graded Conditions , 2004 .

[19]  Nikos J Mourtos,et al.  Open-ended problem-solving skills in thermal-fluids engineering , 2004 .

[20]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[21]  Catherine M. Millett,et al.  A Culture of Evidence: Postsecondary Assessment and Learning Outcomes. Recommendations to Policymakers and the Higher Education Community. , 2006 .

[22]  Muhammad Ashraf Malik,et al.  Correlation between Marks Obtained By Students in Assignments and Final Examination of Master of Education Conducted by Allama Iqbal Open University. , 2007 .

[23]  Wendy K. Adams,et al.  Problem Solving Skill Evaluation Instrument — Validation Studies , 2007 .

[24]  K. Araya,et al.  Role of cannabinoid CB1 receptors and Gi/o protein activation in the modulation of synaptosomal Na+,K+-ATPase activity by WIN55,212-2 and delta(9)-THC. , 2007, European journal of pharmacology.

[25]  Marcy P Osgood,et al.  Gauging the gaps in student problem-solving skills: assessment of individual and group use of problem-solving strategies using online discussions. , 2008, CBE life sciences education.

[26]  Ronald H. Stevens,et al.  An Assessment of the Effect of Collaborative Groups on Students' Problem-Solving Strategies and Abilities. , 2008 .

[27]  E. Lorch,et al.  A Developmental Examination of Story Recall and Coherence Among Children with ADHD , 2010, Journal of abnormal child psychology.

[28]  S. A. Adeyemo.  Students' Ability Level and Their Competence in Problem- Solving Task in Physics , 2010 .

[29]  Louis Deslauriers,et al.  Improved Learning in a Large-Enrollment Physics Class , 2011, Science.

[30]  J. V. Capella-Hernández,et al.  A NEW ASSESSMENT MODEL OF STUDENT LEARNING IN THE EUROPEAN HIGHER EDUCATION AREA , 2011 .

[31]  J. A. Zúñiga-Vicente,et al.  HOW SIMILAR OR DIFFERENT ARE THE GENERIC SKILLS AMONG DIFFERENT AREAS OF KNOWLEDGE? A COMPARATIVE ANALYSIS IN THE SPANISH HIGHER EDUCATION , 2011 .

[32]  Andrew Mienaltowski.  Everyday problem solving across the adult life span: solution diversity and efficacy , 2011, Annals of the New York Academy of Sciences.

[33]  A. Klegeris,et al.  Impact of problem-based learning in a large classroom setting: student perception and problem-solving skills. , 2011, Advances in physiology education.

[34]  J. Sweller,et al.  Using General Problem‐solving Strategies to Generate Ideas in Order to Solve Geography Problems , 2012 .

[35]  A. Klegeris,et al.  Improvement in Generic Problem-Solving Abilities of Students by Use of Tutor-less Problem-Based Learning in a Large Classroom Setting , 2013, CBE life sciences education.

[36]  Janice D. Gobert,et al.  From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining , 2013, Journal of the Learning Sciences.

[37]  Nancy A. Schiller,et al.  Case Studies and the Flipped Classroom , 2013 .

[38]  A. Graesser,et al.  Domain-general problem solving skills and education in the 21st century , 2014 .

[39]  J. Sweller,et al.  Domain-Specific Knowledge and Why Teaching Generic Skills Does Not Work , 2014 .

[40]  Kuang-Chao Yu,et al.  ENHANCING STUDENTS’ PROBLEM-SOLVING SKILLS THROUGH CONTEXT-BASED LEARNING , 2014, International Journal of Science and Mathematics Education.

[41]  Tanja Neumann,et al.  Designing Courses For Higher Education , 2016 .

[42]  Andis Klegeris,et al.  Dynamics of undergraduate student generic problem-solving skills captured by a campus-wide study , 2017 .