Abstract:
The aim of this study was to develop a simulated technical skills examination specific to oral and maxillofacial surgery, assessing the validity of the test and its psychometric properties and obtaining feedback on the examination from both resident trainees and expert evaluators. The Oral and Maxillofacial Objective Structured Assessment of Technical Skills (OMOSATS) examination is a simulated procedure-based eight-station technical skills examination. Fourteen oral and maxillofacial surgery (OMFS) residents of various levels participated in 12-minute surgical tasks and were evaluated by blinded expert OMFS surgeons. The tasks included suturing, tracheostomy, arthroscopy, dental implant placement, plate bending and lag screw application, microvascular anastomosis, and skin grafting. These tasks reflect a broad range of technical milestones necessary for the practice of OMFS. Tasks were evaluated using a validated global rating scale and task-specific checklists. The results of the pilot study indicated strong face and construct validity for seven of the eight OMOSATS stations in discerning the level of training based on technical skill demonstrated at each of the eight surgical stations. Additionally, through one-way ANOVA, P-values were observed to confirm the level of discernment. The OMOSATS examination is a novel way to assess the technical skills of OMFS residents. This type of performance-based assessment has been used in other surgical domains for many years. There is strong evidence to support the use of technical skills examinations to help evaluate, teach, and provide surgeon educators with training outcomes for our OMFS trainees.
摘要:
这项研究的目的是开发一种针对口腔颌面外科的模拟技术技能考试,评估测试的有效性及其心理测量特性,并从驻地受训人员和专家评估人员那里获得关于考试的反馈。口腔颌面客观结构化技术技能评估(OMOSATS)考试是一种基于模拟程序的八站技术技能考试。14名各级口腔颌面外科(OMFS)居民参加了12分钟的手术任务,并由盲专家OMFS外科医生进行了评估。任务包括缝合,气管造口术,关节镜,牙种植体放置,板弯曲和拉力螺钉应用,微血管吻合,和植皮。这些任务反映了OMFS实践所需的广泛技术里程碑。使用经过验证的全球评级量表和特定于任务的清单评估任务。试点研究的结果表明,八个OMOSATS站中的七个站具有很强的面子和结构有效性,可以根据八个手术站中每个站所展示的技术技能来辨别培训水平。此外,通过单向方差分析,观察P值以确认辨别水平。OMOSATS考试是评估OMFS居民技术技能的一种新颖方法。这种类型的基于性能的评估已经在其他手术领域中使用了很多年。有强有力的证据支持使用技术技能考试来帮助评估,教,并为我们的OMFS学员提供培训结果。