Abstract:
Previous longitudinal assessment experiences for multidimensional continuous latent constructs suggested that the set of anchor items should be proportionally representative of the total test forms in content and statistical characteristics and that they should be loaded on every domain in multidimensional tests. In such cases, the set of items containing the unit Q-matrix, which is the smallest unit representing the whole test, seems to be the natural choice for anchor items. Two simulation studies were conducted to verify the applicability of these existing insights to longitudinal learning diagnostic assessments (LDAs). The results mainly indicated that there is no effect on the classification accuracy regardless of the unit Q-matrix in the anchor items, and even not including the anchor items has no impact on the classification accuracy. The findings of this brief study may ease practitioners\' worries regarding anchor-item settings in the practice application of longitudinal LDAs.
摘要:
先前对多维连续潜在构造的纵向评估经验表明,该组锚定项应在内容和统计特征上按比例代表总测试形式,并且应将其加载到多维测试的每个领域。在这种情况下,包含单位Q矩阵的项目集,这是代表整个测试的最小单位,似乎是锚项目的自然选择。进行了两项模拟研究,以验证这些现有见解对纵向学习诊断评估(LDA)的适用性。结果主要表明,无论锚项中的单位Q矩阵如何,对分类精度都没有影响。即使不包括锚项目也不会影响分类精度。这项简短研究的结果可能会减轻从业者对纵向LDA实践应用中锚定项设置的担忧。