Gifted and Talented Services for EFL Learners in China: A Step-by-Step Guide to Propensity Score Matching Analysis in R

We sought to quantify the effectiveness of a gifted and talented (GT) program, as was provided to university students who demonstrated a talent for learning English as a foreign language (EFL) in China. To do so, we used propensity score matching (PSM) techniques to analyze data collected from a tier-1 university where an English talent (ET) program was provided. Specifically, we provided (a) a step-by-step guide of PSM analysis using the R analytical package, (b) the codes for PSM analysis and visualization, and (c) the final analysis of baseline equivalence and treatment effect based on the matching sample. Collectively, the results of descriptive statistics, visualization, and baseline equivalence indicate that PSM is an effective matching technique for generating an unbiased counterfactual analysis. Moreover, the ET program yields a statistically significant, positive effect on ET students’ English language proficiency.

[1]  B. Wallace,et al.  TASC: Thinking Actively in a Social Context. A universal problem-solving process , 2012 .

[2]  Beverly J. Irby,et al.  The impact of professional learning on in-service teachers’ pedagogical delivery of literacy-infused science with middle school English learners: a randomised controlled trial study in the U.S , 2018, Educational Studies.

[3]  Zhenhui Rao,et al.  Teaching English as a foreign language in Chinese universities: The present and future , 2014, English Today.

[4]  J. Y. Jung,et al.  Assessment in Gifted Education: A Review of the Literature From 2005 to 2016 , 2017 .

[5]  Fan Lei,et al.  Chinese EFL Learners’ Public Speaking Skills: An Investigation of Impromptu Speeches at the “FLTRP Cup” English Speaking Contest in the Light of Communication Models , 2016 .

[6]  Yanmei Liu.  Cultivation of Foreign Language Talents Viewed from the Perspective of Educational Ecology , 2015 .

[7]  Xitao Fan,et al.  The subjective well-being of academically gifted students in the Chinese cultural context , 2018 .

[8]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[9]  Stephen W. Raudenbush,et al.  Effects of Kindergarten Retention Policy on Children’s Cognitive Growth in Reading and Mathematics , 2005 .

[10]  Gary King,et al.  MatchIt: Nonparametric Preprocessing for Parametric Causal Inference , 2011 .

[11]  D. Chan.  Identifying gifted and talented students in Hong Kong , 2000 .

[12]  A. Deaton,et al.  Understanding and Misunderstanding Randomized Controlled Trials , 2016, Social science & medicine.

[13]  Zhitian Zhang,et al.  Gifted education in China , 2017 .

[14]  S. Hollon,et al.  Why randomised controlled trials of psychological treatments are still essential. , 2018, The lancet. Psychiatry.

[15]  Xiaodong Yue,et al.  Concepts of Creativity: Similarities and Differences among Mainland, Hong Kong and Taiwanese Chinese , 2000 .

[16]  S. Wan.  Differentiated instruction: Hong Kong prospective teachers’ teaching efficacy and beliefs , 2016 .

[17]  P. Bodycott,et al.  The Influence and Implications of Chinese Culture in the Decision to Undertake Cross-Border Higher Education , 2012 .

[18]  D. Chan.  Healthy and Unhealthy Perfectionists Among Academically Gifted Chinese Students in Hong Kong: Do Different Classification Schemes Make a Difference? , 2010 .

[19]  J. Avorn,et al.  Variable selection for propensity score models. , 2006, American journal of epidemiology.

[20]  Jean A. Baker.  Depression and Suicidal Ideation Among Academically Gifted Adolescents , 1995 .

[21]  Stephen E. Lucas.  English Public Speaking and the Cultivation of Talents for Chinese College Students , 2013 .

[22]  Yuliya Ardasheva,et al.  Sources of college EFL learners' self-efficacy in the English public speaking domain , 2019, English for Specific Purposes.

[23]  Dirkje S Postma,et al.  An evaluation of exact matching and propensity score methods as applied in a comparative effectiveness study of inhaled corticosteroids in asthma , 2017, Pragmatic and observational research.

[24]  Sascha O. Becker,et al.  Estimation of Average Treatment Effects Based on Propensity Scores , 2002 .

[25]  Mantak Yuen,et al.  Differentiation in key learning areas for gifted students in regular classes , 2018 .

[26]  G. Farkas,et al.  A Propensity Score Matching Analysis of the Effects of Special Education Services , 2010, The Journal of special education.

[27]  C. Cheung,et al.  Who are the Best-Known National and Foreign Creators — a Comparative Study Among Undergraduates in China and Germany , 2011 .