Abstract
In order to understand whether raters in rater-mediated assessments exhibit different response styles on rating scales due to different latent classes of ratees, this study aims to develop a "many-facet mixture extreme response style item response model" and assess the efficiency of the proposed model. This study consists of two parts: simulation study and empirical study. The simulation study results show that the model has good parameter estimation for item and person parameters and that the precision of parameter estimates declines when the misleading model was used. In the empirical study, the data that were collected from writing assessment administered to an international school in Thailand were fit to several competing models to demonstrate the application of the proposed model. The empirical study shows that the many-facet mixture extreme response style generalized partial credit model provides the best-fitting model among the competing models. Moreover, the changes in rank order between the best-fitting model and it corresponding model without considering different response styles and latent classes are not trivial. Finally, the author addresses conclusions based on the results and provides suggestions for future study.
| Translated title of the contribution | Development and Application of Many-facet Mixture Extreme Response Models for Rater-mediated Assessments |
|---|---|
| Original language | Chinese (Traditional) |
| Pages (from-to) | 237-260 |
| Number of pages | 24 |
| Journal | 測驗學刊 = Psychological Testing |
| Volume | 69 |
| Issue number | 3 |
| Publication status | Published - 2022 Sept |