Objective: The University Hospital in Hamburg (UKE) started to develop a test of knowledge in natural sciences for admission to medical school in 2005 (Hamburger Auswahlverfahren für Medizinische Studiengänge, Naturwissenschaftsteil, HAM-Nat). This study is a step towards establishing the HAM-Nat. We are investigating parallel forms reliability, the effect of a crash course in chemistry on test results, and correlations of HAM-Nat test results with a test of scientific reasoning (similar to a subtest of the "Test for Medical Studies", TMS). Methods: 316 first-year students participated in the study in 2007. They completed different versions of the HAM-Nat test which consisted of items that had already been used (HN2006) and new items (HN2007). Four weeks later half of the participants were tested on the HN2007 version of the HAM-Nat again, while the other half completed the test of scientific reasoning. Within this four week interval students were offered a five day chemistry course. Results: Parallel forms reliability for four different test versions ranged from rtt=.53 to rtt=.67. The retest reliabilities of the HN2007 halves were rtt=.54 and rtt =.61. Correlations of the two HAM-Nat versions with the test of scientific reasoning were r=.34 und r=.21. The crash course in chemistry had no effect on HAM-Nat scores. Conclusions: The results suggest that further versions of the test of natural sciences will not easily conform to the standards of internal consistency, parallel-forms reliability and retest reliability. Much care has to be taken in order to assemble items which could be used interchangeably for the construction of new test versions. The test of scientific reasoning and the HAM-Nat are tapping different constructs. Participation in a chemistry course did not improve students’ achievement, probably because the content of the course was not coordinated with the test and many students lacked of motivation to do well in the second test.
[1]
I. McManus,et al.
Predictive validity of the Biomedical Admissions Test: An evaluation and case study
,
2011,
Medical teacher.
[2]
I C McManus,et al.
A levels and intelligence as predictors of medical careers in UK doctors: 20 year prospective study
,
2003,
BMJ : British Medical Journal.
[3]
J. Emery,et al.
The predictive validity of the BioMedical Admissions Test for pre‐clinical examination performance
,
2009,
Medical education.
[4]
E. Ferguson,et al.
Learning in practice Factors associated with success in medical school: systematic review of the literature
,
2022
.
[5]
S. Harendza,et al.
Reduzierbarkeit der Abbrecherquote im Humanmedizinstudium durch das Hamburger Auswahlverfahren für Medizinische Studiengänge - Naturwissenschaftsteil (HAM-Nat) [Possible reduction of the medical school dropout number by the Hamburg Assessment test for Medicine - part Natural sciences (HAM-Nat)]
,
2008
.
[6]
J. Smolle,et al.
Progress of medical students after open admission or admission based on knowledge tests
,
2010,
Medical Education.
[7]
Benedikt Hell,et al.
Die Validität von Schulnoten zur Vorhersage des Studienerfolgs : eine Metaanalyse
,
2007
.
[8]
S. Embretson,et al.
Item response theory for psychologists
,
2000
.
[9]
M. Larkin.
Software
,
2003,
The Lancet.