单例实验在心理和教育研究中越来越受欢迎。然而,单例数据的分析往往因频繁出现数据缺失或不完整而变得复杂。如果不能避免错误或不完整,知道哪些策略是最优的变得很重要,因为缺失数据的存在或不充分的数据处理策略可能导致实验不再“符合标准”,例如,什么工作信息交换所。对于处理缺失数据的策略的检查和比较,我们模拟了ABAB相位设计的完整数据集,随机区组设计,和多基线设计。我们通过随机删除10%,在模拟数据集中引入了不同程度的错误,30%,和50%的数据。我们评估了随机检验的I型错误率和统计能力,即在这些不同程度的错误下没有治疗效果的零假设,使用不同的策略来处理缺失数据:(1)随机化缺失数据标记并仅为可用数据点计算所有参考统计数据,(2)利用时间序列模型的状态空间表示通过单次插补估计缺失数据点,(3)基于对前后数据点的可用数据点进行回归的多重填补。对于模拟的条件,结果是决定性的:在随机测试中,随机标记方法在统计功效方面优于其他两种方法,同时控制I型错误率。
Single-case experiments have become increasingly popular in psychological and educational research. However, the analysis of single-case data is often complicated by the frequent occurrence of missing or incomplete data. If missingness or incompleteness cannot be avoided, it becomes important to know which strategies are optimal, because the presence of missing data or inadequate data handling strategies may lead to experiments no longer \"meeting standards\" set by, for example, the What Works Clearinghouse. For the examination and comparison of strategies to handle missing data, we simulated complete datasets for ABAB phase designs, randomized block designs, and multiple-baseline designs. We introduced different levels of missingness in the simulated datasets by randomly deleting 10%, 30%, and 50% of the data. We evaluated the type I error rate and statistical power of a randomization test for the null hypothesis that there was no treatment effect under these different levels of missingness, using different strategies for handling missing data: (1) randomizing a missing-data marker and calculating all reference statistics only for the available data points, (2) estimating the missing data points by single imputation using the state space representation of a time series model, and (3) multiple imputation based on regressing the available data points on preceding and succeeding data points. The results are conclusive for the conditions simulated: The randomized-marker method outperforms the other two methods in terms of statistical power in a randomization test, while keeping the type I error rate under control.