10th International
Conference on
Teaching Statistics
8 – 13 July 2018
Kyoto, Japan
Contributed paper list

Contributed Paper C192


Do open-ended and multiple choice questions measure the same latent trait?


EJ Bakker (Netherlands)
Hilde Tobi (Netherlands)


EJ Bakker (Netherlands)


Exams of a secondary service course on Statistics at our University, covering t-tests, linear regression, 1- and 2-way ANOVA, and non-parametric tests, contained two parts: one with open ended questions and one with multiple choice questions, each with 45 credits max. We have student scores (per item) of approximately 3000 first attempts for 10 different exams.

Besides showing some descriptive statistics for the two sets, we will present results of a series of factor analyses to identify whether the items in the two sets represent different latent variables. We will present to what extent these latent variables correlate, in general, and for high and low scoring student sub-groups separately. We will close off with discussing possible consequences for future test score weighting.