Desiging the Pathways of Engineering Alumni Research Survey (PEARS)

Surveys of engineering alumni are a common approach taken by departments to collect evidence demonstrating how educational objectives are being met for the purpose of continuous improvement of the program (ABET Criterion 4). Whi le survey administration tools have become widely available and easy to navigate, resea ch rs must still address the challenges of designing not only a concise survey instrument but also an effective deployment plan that results in a high response rate among targeted respondents. To explore these issues in a real world context, th is paper draws upon first hand experiences related to the planning of the Pathways of Engineer i g Alumni Research Survey (PEARS) which was piloted with geographically distributed enginee ring alumni from four institutions in fall 2011. Creating the PEARS deployment plan parallele d th design of the instrument itself. This paper speaks to the unique logistical consideration s of deploying an alumni survey with respect to subject recruitment, incentives, alumni associat ion partnerships, and scalability. The preliminary findings outlined here are intended to inf rm the redesign of the deployment plan for future administrations of PEARS as well as to serve as a practical resource for other researchers wishing to survey engineering alumni.

[1]  Terry L. Childers,et al.  SURVEY RESPONSE BEHAVIOR A META-ANALYSIS , 2004 .

[2]  Stephen R. Porter Survey Research Policies: An Emerging Issue for Higher Education. , 2005 .

[3]  Gary R. Pike,et al.  The relationship between alumni satisfaction and work experiences , 1993 .

[4]  Russel L. Thompson,et al.  A Meta-Analysis of Response Rates in Web- or Internet-Based Surveys , 2000 .

[5]  G. Toye,et al.  Targeting undergraduate students for surveys: Lessons from the Academic Pathways Of People Learning Engineering Survey (APPLES) , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[6]  Gary Lichtenstein,et al.  From PIE to APPLES: The Evolution of a Survey Instrument to Explore Engineering Student Pathways. Research Brief. , 2008 .

[8]  T. Heberlein,et al.  Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. , 1978 .

[9]  Adam N. Joinson,et al.  Personalized salutation, power of sender and response rates to Web-based surveys , 2007, Comput. Hum. Behav..

[10]  Martin Wetzels,et al.  Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study , 2004 .

[11]  G. Toye,et al.  Scaling up: Taking the Academic Pathways of People Learning Engineering Survey (APPLES) national , 2008, 2008 38th Annual Frontiers in Education Conference.

[12]  Don A. Dillman,et al.  Development of a Standard E-Mail Methodology: Results of an Experiment , 1998 .

[13]  Ross A. Perkins,et al.  Using Research-Based Practices to Increase Response Rates of Web-Based Surveys. , 2011 .

[14]  J. Krosnick,et al.  Survey research. , 1999, Annual review of psychology.

[15]  M. Crask,et al.  MAIL SURVEY RESPONSE RATE A META-ANALYSIS OF SELECTED TECHNIQUES FOR INDUCING RESPONSE , 1988 .

[16]  Alberto F. Cabrera,et al.  Making an impact with alumni surveys , 2005 .

[17]  Alex R. Trouteaud How You Ask Counts , 2004 .

[18]  P. Ewell Alumni Studies as Instruments of Public Policy: The U.S. Experience. , 2005 .

[19]  Robert M. Groves,et al.  UNDERSTANDING THE DECISION TO PARTICIPATE IN A SURVEY , 1992 .

[20]  Victor M. H. Borden Using Alumni Research to Align Program Improvement with Institutional Accountability , 2005 .