PDF(Pubmed)
Abstract：
UNASSIGNED: Script concordance testing is widely practiced to foster and assess clinical reasoning. Our study aimed to develop script concordance test (SCT) in the specialty of otolaryngology and test the validation using panel response pattern and consensus index.
UNASSIGNED: The methodology was an evolving pattern of constructing SCTs, administering them to the panel members, and optimizing the panel with response patterns and consensus index. The SCT\'s final items were chosen to be administered to the students.
UNASSIGNED: We developed 98 items of SCT and administered them to 20 panel members. The mean score of the panel members for these 98 items was 79.5 (standard deviation [SD] = 4.4). The consensus index calculated for the 98-item SCT ranged from 25.81 to 100. Sixteen items had bimodal and uniform response patterns; the consensus index improved when eliminated. We administered the rest 82 items of SCT to 30 undergraduate and ten postgraduate students. The mean score of undergraduate students was 61.1 (SD = 7.5) and that of postgraduate students was 67.7 (SD = 6.3). Cronbach\'s alpha for the 82-item SCT was 0.74. Excluding the 22 poor items, the final SCT instrument of 60 items had a Cronbach\'s alpha of 0.82.
UNASSIGNED: Our study revealed that a consensus index above 60 had a good item-total correlation and be used to optimize the items for panel responses in SCT, necessitating further studies on this aspect. Our study also revealed that the panel response clustering pattern could be used to categorize the items, although bimodal and uniform distribution patterns need further differentiation.
UNASSIGNED: The methodology was an evolving pattern of constructing SCTs, administering them to the panel members, and optimizing the panel with response patterns and consensus index. The SCT\'s final items were chosen to be administered to the students.
UNASSIGNED: We developed 98 items of SCT and administered them to 20 panel members. The mean score of the panel members for these 98 items was 79.5 (standard deviation [SD] = 4.4). The consensus index calculated for the 98-item SCT ranged from 25.81 to 100. Sixteen items had bimodal and uniform response patterns; the consensus index improved when eliminated. We administered the rest 82 items of SCT to 30 undergraduate and ten postgraduate students. The mean score of undergraduate students was 61.1 (SD = 7.5) and that of postgraduate students was 67.7 (SD = 6.3). Cronbach\'s alpha for the 82-item SCT was 0.74. Excluding the 22 poor items, the final SCT instrument of 60 items had a Cronbach\'s alpha of 0.82.
UNASSIGNED: Our study revealed that a consensus index above 60 had a good item-total correlation and be used to optimize the items for panel responses in SCT, necessitating further studies on this aspect. Our study also revealed that the panel response clustering pattern could be used to categorize the items, although bimodal and uniform distribution patterns need further differentiation.
摘要：
■脚本一致性测试被广泛实践以促进和评估临床推理。我们的研究旨在开发耳鼻喉科专业的脚本一致性测试（SCT），并使用面板响应模式和共识指数测试验证。
■该方法是一种不断发展的构建SCT的模式，将它们管理给小组成员，并使用响应模式和共识指数优化小组。SCT的最终项目被选择给学生。
■我们开发了98项SCT，并将其管理给20名小组成员。这98个项目的小组成员的平均得分为79.5（标准偏差[SD]=4.4）。为98项SCT计算的共识指数范围为25.81至100。16个项目具有双峰和统一的反应模式；消除后，共识指数有所改善。我们对30名本科生和10名研究生进行了其余82项SCT。本科生的平均得分为61.1（SD=7.5），研究生的平均得分为67.7（SD=6.3）。82项SCT的克朗巴赫α为0.74。不包括22件可怜的物品，最终的60项SCT仪器的Cronbachα为0.82。
■我们的研究表明，超过60的共识指数具有良好的项目总相关性，可用于优化SCT中面板响应的项目，需要对这方面进行进一步的研究。我们的研究还表明，面板响应聚类模式可以用来对项目进行分类，尽管双峰和均匀分布模式需要进一步区分。
■该方法是一种不断发展的构建SCT的模式，将它们管理给小组成员，并使用响应模式和共识指数优化小组。SCT的最终项目被选择给学生。
■我们开发了98项SCT，并将其管理给20名小组成员。这98个项目的小组成员的平均得分为79.5（标准偏差[SD]=4.4）。为98项SCT计算的共识指数范围为25.81至100。16个项目具有双峰和统一的反应模式；消除后，共识指数有所改善。我们对30名本科生和10名研究生进行了其余82项SCT。本科生的平均得分为61.1（SD=7.5），研究生的平均得分为67.7（SD=6.3）。82项SCT的克朗巴赫α为0.74。不包括22件可怜的物品，最终的60项SCT仪器的Cronbachα为0.82。
■我们的研究表明，超过60的共识指数具有良好的项目总相关性，可用于优化SCT中面板响应的项目，需要对这方面进行进一步的研究。我们的研究还表明，面板响应聚类模式可以用来对项目进行分类，尽管双峰和均匀分布模式需要进一步区分。
