A New Class of Psychometric Models for Performance Decline and Nonignorable Missing Data

In educational assessments and achievement tests, it is commonly assumed that test-takers would attempt all test items with full effort and leave no blank responses with unplanned missing values. However, aberrant response behavior, such as performance decline, dropping out beyond a certain point, and skipping certain items over the course of the test, is inevitable, especially for low-stakes assessments and speeded tests, due to low motivation or time limits. In this study, test-takers are classified as normal or aberrant using a mixture item response theory (IRT) modeling approach, and aberrant response behavior is described and modeled using IRTrees. Simulations are conducted to evaluate the efficiency and quality of the new class of mixture IRTree model using WinBUGS with Bayesian estimation. The results show that the parameter recovery is satisfactory for the proposed mixture IRTree model and that treating missing values as ignorable or incorrect and ignoring possible performance decline results in biased estimation. Finally, the applicability of the new model is illustrated by means of an empirical example based on the Program for International Student Assessment.