Co-Curricular Connections: The Role of Undergraduate Research Experiences in Promoting Engineering Students’ Communication, Teamwork, and Leadership Skills

Abstract This study examined the impact of undergraduate research (UR) in engineering, focusing on three particular learning outcomes: communication, teamwork, and leadership. The study included 5126 students across 31 colleges of engineering. The authors employed propensity score matching method to address the selection bias for selection into (and differential availability of) UR programs. Engineering students who engage in UR tend to report higher skill levels, but when curriculum and classroom experiences are taken into account, there is no significant effect of UR on teamwork and leadership skills. Not accounting for college experiences such as curricular, classroom, and other co-curricular experiences may overestimate the positive relationship between UR participation and professional skills. After propensity score adjustment, we found that UR provided a significant predictor of communication skills; a finding that provides support for previous research regarding the importance of communication skills as an outcome of UR. The study highlights the importance of taking into account selection bias when assessing the effect of co-curricular programs on student learning. Implications of the study include expanding undergraduate research opportunities when possible and incorporating communication and leadership skill development into required course curriculum.

[1]  Lisa R. Lattuca,et al.  Academic Environments in Detail: Holland’s Theory at the Subdiscipline Level , 2010 .

[2]  David B. Knight,et al.  2020 Vision: Progress in Preparing the Engineer of the Future , 2014 .

[3]  Betsy Palmer,et al.  Best Paper PIC II: Design in Context: Where do the Engineers of 2020 Learn this Skill? , 2011 .

[4]  Ernest T. Pascarella,et al.  How College Affects Students: A Third Decade of Research. Volume 2. , 2005 .

[5]  Susan H. Russell,et al.  Benefits of Undergraduate Research Experiences , 2007, Science.

[6]  M. Villarejo,et al.  Importance of Undergraduate Research for Minority Persistence and Achievement in Biology , 2010 .

[7]  Hyun Kyoung Ro,et al.  Between-College Effects on Students Reconsidered , 2013 .

[8]  J. Neter,et al.  Applied linear statistical models : regression, analysis of variance, and experimental designs , 1974 .

[9]  Cynthia J. Atman,et al.  AC 2008-768: SAME COURSES, DIFFERENT OUTCOMES? VARIATIONS IN CONFIDENCE, EXPERIENCE, AND PREPARATION IN ENGINEERING DESIGN , 2008 .

[10]  David A. Sabatini,et al.  TEACHING AND RESEARCH SYNERGISM: THE UNDERGRADUATE RESEARCH EXPERIENCE , 1997 .

[11]  Joni Schwartz,et al.  Faculty as undergraduate research mentors for students of color: Taking into account the costs , 2012 .

[12]  John L. Holland,et al.  The Psychology Of Vocational Choice , 1966 .

[13]  Nicholas A. Bowman.  Can 1st-Year College Students Accurately Report Their Learning and Development? , 2010 .

[14]  Ning Fang,et al.  Improving engineering students’ technical and professional skills through project-based active and collaborative learning , 2012 .

[15]  Chetan S. Sankar,et al.  Use of Presage-Pedagogy-Process-Product Model to Assess the Effectiveness of Case Study Methodology in Achieving Learning Outcomes , 2011 .

[16]  Matthew W. Ohland,et al.  Trajectories of Electrical Engineering and Computer Engineering Students by Race and Gender , 2011, IEEE Transactions on Education.

[17]  Tom W. Smith.  TRENDS IN NON-RESPONSE RATES , 1995 .

[18]  Carrie B. Myers.  Union Status and Faculty Job Satisfaction: Contemporary Evidence from the 2004 National Study of Postsecondary Faculty , 2011 .

[19]  David Cook,et al.  Matching and Propensity Scores , 2013 .

[20]  Tara McKay,et al.  Cross-Discipline Perceptions of the Undergraduate Research Experience , 2011 .

[21]  G. Wallman.  Book Review: Making Vocational Choices: A Theory of Vocational Personalities & Work Environments (2nd ed.). John L. Holland , 2015 .

[22]  Vincent Tinto,et al.  Leaving College: Rethinking the Causes and Cures of Student Attrition. , 1988 .

[23]  Troy D. Sadler,et al.  Learning Science through Research Apprenticeships: A Critical Review of the Literature. , 2009 .

[24]  Jennifer L. Croissant,et al.  Industry, academe, and the values of undergraduate engineers , 1992 .

[25]  J. L. Holland,et al.  Making Vocational Choices: A Theory of Careers , 1973 .

[26]  Paul D. Umbach,et al.  Student Survey Response Rates across Institutions: Why Do they Vary? , 2006 .

[27]  Victor M. H. Borden,et al.  Working with Missing Data in Higher Education Research: A Primer and Real-World Example , 2014 .

[28]  R. Reardon,et al.  Academic Disciplines: Holland's Theory and the Study of College Students and Faculty (review) , 2000 .

[29]  J. Roger Parsons,et al.  Enabling Engineering Performance Skills: A Program to Teach Communication, Leadership, and Teamwork* , 2001 .

[30]  Elizabeth Niehaus,et al.  HLM Behind the Curtain: Unveiling Decisions Behind the Use and Interpretation of HLM in Higher Education Research , 2014 .

[31]  Eric L. Dey.  Working with Low Survey Response Rates: The Efficacy of Weighting Adjustments , 1995 .

[32]  David B. Knight,et al.  In Search of the Engineers of 2020: An Outcomes-based Typology of Engineering Undergraduates , 2012 .

[33]  D. Armor.  Theta Reliability and Factor Scaling , 1973 .

[34]  D B Rubin,et al.  Matching using estimated propensity scores: relating theory to practice. , 1996, Biometrics.

[35]  Yehuda Baruch,et al.  Response Rate in Academic Studies — A Comparative Analysis , 1999 .

[36]  Matthew W. Ohland,et al.  Women in Industrial Engineering: Stereotypes, Persistence, and Perspectives , 2012 .

[37]  S. Schwartz,et al.  Leaving College: Rethinking the Causes and Cures of Student Attrition , 1987 .

[38]  J. Graham,et al.  Missing data analysis: making it work in the real world. , 2009, Annual review of psychology.

[39]  E. Seymour,et al.  Establishing the benefits of research experiences for undergraduates in the sciences: First findings from a three‐year study , 2004 .

[40]  Charlene M. Smith,et al.  Integrating lecture capture as a teaching strategy to improve student presentation skills through self-assessment , 2011 .

[41]  Daryl E. Chubin,et al.  A Retrospective on Undergraduate Engineering Success for Underrepresented Minority Students , 2003 .

[42]  Monica Martinussen,et al.  Survey Response Rates and Survey Administration in Counseling and Clinical Psychology , 2009 .

[43]  Troy D. Sadler,et al.  Scientific Research for Undergraduate Students: A Review of the Literature. , 2010 .

[44]  Nicky Bowman,et al.  Can College Students Accurately Assess What Affects Their Learning and Development? , 2011 .

[45]  Diane C. Calleson,et al.  Teaching Advanced Leadership Skills in Community Service (ALSCS) to medical students. , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[46]  Scott Tomek.  Developing a Multicultural, Cross-Generational, and Multidisciplinary Team: An Introduction for Civil Engineers , 2011 .

[47]  Elizabeth A Stuart,et al.  Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. , 2010, Psychological methods.

[48]  Cecilia Rios-Aguilar,et al.  Multilevel Analysis in Higher Education Research: A Multidisciplinary Approach , 2011 .

[49]  J. L. Holland,et al.  Making vocational choices : a theory of vocational personalities and work environments , 1984 .

[50]  Lorelle L. Espinosa.  Pipelines and Pathways: Women of Color in Undergraduate STEM Majors and the College Experiences That Contribute to Persistence , 2011 .

[51]  L.R. Lattuca,et al.  Panel Session - Engineering Change: Findings from a Study of the Impact of EC2000 , 2006, Proceedings. Frontiers in Education. 36th Annual Conference.

[52]  William R. Shadish,et al.  A Primer on Propensity Score Analysis , 2010 .

[53]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[54]  A. Astin.  What Matters In College , 1993 .

[55]  Karen L. Tonso,et al.  Teams that Work: Campus Culture, Engineer Identity, and Social Interactions , 2006 .

[56]  R. Reason.  An Examination of Persistence Research Through the Lens of a Comprehensive Conceptual Framework , 2009 .

[57]  P. Austin.  An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies , 2011, Multivariate behavioral research.

[58]  David B. Knight,et al.  An Exploration of Gender Diversity in Engineering Programs: a Curriculum and Instruction-Based Perspective , 2012 .

[59]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.

[60]  Reginald S. Lee,et al.  PROPENSITY SCORE ANALYSIS AND ASSESSMENT OF PROPENSITY SCORE APPROACHES USING SAS ® PROCEDURES , 2012 .

[61]  Frances D. Carter,et al.  The Influence of On-Campus, Academic Year Undergraduate Research on STEM Ph.D. Outcomes: Evidence From the Meyerhoff Scholarship Program , 2009, Educational evaluation and policy analysis.

[62]  Gül E. Okudan Kremer,et al.  Approaches to engaging students in engineering design and problem solving , 2011 .