objective structured assessment of technical skills

对技术技能的客观结构化评估
  • 文章类型: Journal Article
    背景:产后出血是全球孕产妇发病率和死亡率的重要原因,并且发病率正在增加。这项研究旨在评估产后出血管理中不同模拟系统中受训者表现的改进和缺陷。
    目的:进行一项初步研究,评估和比较高保真度和低保真度仿真模型,使用高保真模式评估重复绩效的改善情况,并识别使用客观结构化技术技能评估评估的错误,从而探索在教学设置中应优先考虑产后出血应急管理的哪些方面,并评估哪种模拟设置在获得能力方面最有效。
    方法:这是一个前瞻性随机,单盲,在柏林Charité大学医院产科模拟中心对17名初级产科学员进行的单机构试验。学员被随机分为两组,使用初始低保真度模拟或高保真度模拟,然后反复评估业绩,采用高保真模型仿真系统。对各个模拟会话进行视频录制和转录,并记录了干预的时机。Strandardized客观结构化技术技能评估表格被用作绩效清单。
    结果:在模拟评估的第二个周期中,性能总体上有统计学上的显着改善(P=.02;24.7-27.2分,31.0分;平均8.7%),并且在进行重复模拟评估的组中有统计学上的显着改善(P=.043;24.4-28.4分,31.0分;平均12.9%)。从初始低保真度系统到高保真
    结论:当受训者经历了从低保真度系统到高保真度系统的重复模拟评估循环时,表现有所改善。模拟评估可以识别错误和学习差距,这对产科学员很重要。这项研究发现,受训者犯同样的错误,无论最初使用哪种模拟模型。
    BACKGROUND: Postpartum hemorrhage is a significant cause of both maternal morbidity and mortality worldwide and is increasing in incidence. This study aimed to assess improvement and identify shortcomings in trainee performance in different simulation systems in the management of postpartum hemorrhage.
    OBJECTIVE: To perform a pilot study evaluating and comparing high- and low-fidelity simulation models, assessing improvement in repeated performance with high-fidelity mode and identifying mistakes made assessed using Objective Structured Assessment of Technical Skills and thereby exploring what aspects of emergency management of postpartum hemorrhage should be prioritized in teaching settings and assessing what simulation setup is most effective in achieving competence.
    METHODS: This was a prospective randomized, single-blinded, single-institution trial in a population of 17 junior obstetrical trainees at the Charité University Hospital Obstetric Simulation Center in Berlin. Trainees were randomized into 2 groups, with either initial low-fidelity simulation or high-fidelity simulation, followed by repeated assessment of performance, using the high-fidelity model simulation system. Individual simulation sessions were video-recorded and transcribed, and the timing of interventions was documented. Strandardized Objective Structured Assessment of Technical Skills forms were used as a checklist for performance.
    RESULTS: There was a statistically significant general improvement in performance (P=.02; 24.7-27.2 of 31.0 points; average of 8.7%) in the second cycle of simulation assessment and a statistically significant training effect (P=.043; 24.4-28.4 of 31.0 points; average of 12.9%) in the group that underwent repeat simulation assessment from the initial low-fidelity system to the high-fidelity system compared with the group using the same high-fidelity setup (P=.276; 25.0-25.8 of 31.0; average of 2.4%).
    CONCLUSIONS: There was an improvement in the performance when trainees underwent a repeated cycle of simulation assessment changing from a low-fidelity system to a high-fidelity system. Simulation assessment can identify mistakes and learning gaps that are important for obstetrical trainees. This study found that trainees make the same mistakes, regardless of which simulation model was initially used.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    目的:评估结构模拟课程对产科肛门括约肌损伤(OASIS)修复的短期和技能保留效果。
    方法:本实验研究招募了北京协和医院31名妇产科住院医师。OASIS维修技能评估(在所有时间点)包括任务特定清单(TSC),全球评级量表(GRS),和通过/失败等级。仿真课程采用了牛舌模型。基线测试后,居民完成了一个结构化的1-h工作坊。两周后,进行了第二次测试,接着是一对一的教学研讨会,以正确完成清单为终点。三个月后,居民完成了第三次测试。
    结果:基线时的总体通过率为16.1%,老年居民的GRS评分较高(p=0.035)。此外,课前预习手术和OASIS修复观察史与较高的TSC和GRS评分相关.在第二次和第三次测试中观察到显著的技能改进,合格率分别为96.8%和93.5%。与基线相比,TSC和GRS评分均有所改善(p<0.001)。
    结论:在监督下整合刻意练习的结构模拟课程提高了OASIS修复能力,并实现了令人满意的技能保留。
    OBJECTIVE: To assess the short-term and skill-retention effects of a structural simulation curriculum for the repair of obstetrical anal sphincter injuries (OASIS).
    METHODS: This prepost experimental study recruited 31 obstetrics and gynecology residents from Peking Union Medical College Hospital. OASIS repair skill evaluations (at all timepoints) comprised a task-specific checklist (TSC), global rating scale (GRS), and pass/fail grade. A beef-tongue model was adopted in the simulation curriculum. After baseline testing, residents completed a structured 1-h workshop. Two weeks later, a second test was performed, followed by a one-to-one teaching workshop, with the proper completion of a checklist as the end-point. Three months later, residents completed a third test.
    RESULTS: The overall pass rate at baseline was 16.1%, with higher GRS scores (p = 0.035) in senior residents. Additionally, previewing the procedure before class and a history of OASIS repair observation were associated with higher TSC and GRS scores. Significant skill improvement was observed in the second and third tests, with pass rates of 96.8% and 93.5% respectively. Both TSC and GRS scores were improved compared with baseline (p < 0.001).
    CONCLUSIONS: A structural simulation curriculum integrating deliberate practice under supervision improves OASIS repair competence and achieves satisfactory skill retention.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    我们调查了接受腹腔镜根治性子宫切除术(LRH)的宫颈癌患者的手术技巧和手术方式是否与肿瘤预后有关。
    我们先前评估了251例FIGO分期(2009年)IA2、IB1和IIA1宫颈癌患者的LRH数据,这些患者为JGOG1081s研究收集。1)重新检查JGOG1081s队列研究,以完善手术细节并延长随访期作为图表回顾。2)使用改良的客观结构化技术技能评估(OSATS)工具,由专家针对各种手术技能和手术程序,对复发病例和匹配的非复发对照病例进行了新的比较。没有意识到复发状态作为视频审查。
    经过46个月的中位随访,251例患者中有31例肿瘤复发.五年无复发生存率为86.9%(81.8-90.6),五年总生存率为93.7%(87.5-96.8)。图表回顾的多因素分析发现,每个机构的LRH少于20例是复发的独立预后因素(危险比(HR)2.49,95CI1.12-5.53,p=0.025)。对于手术视频审查,我们比较了23例复发病例和23例背景匹配的非复发对照.来自视频评论的较低的改良OSATS评分始终倾向于具有较高的复发风险。
    我们的新研究发现,LRH手术经验和技能倾向于具有更好的肿瘤学结果。
    We investigated whether surgical skill and procedure were related to oncological outcomes in cervical cancer patients who underwent Laparoscopic Radical Hysterectomy (LRH).
    We previously assessed data of LRH from 251 patients with FIGO stage (2009) IA2, IB1and IIA1 cervical cancer collected for JGOG 1081s study. 1) The JGOG 1081s cohort study was re-examined to refine the surgical details and extend the follow-up period as chart review. 2) Unedited videos for recurrent cases and matched non-recurrent control cases were newly compared by experts for various surgical skills and surgical procedures using the modified Objective Structured Assessment of Technical Skills (OSATS) tool, without awareness of the recurrence status as video review.
    After a median follow-up of 46 months, tumors had recurred in 31 of the 251 patients. The five-year Recurrence-Free Survival rate was 86.9% (81.8-90.6) and five-year Overall Survival rate was 93.7% (87.5-96.8). Multivariate analysis from chart reviews found that an experience with LRH of less than 20 cases per institution was an independent prognostic factor for recurrence (Hazard Ratio (HR) 2.49, 95%CI 1.12-5.53, p = 0.025). For the surgical video review, we compared 23 videos of recurrent cases with 23 background-matched non-recurrent controls. Lower modified OSATS scores from the video review were consistently trended to have a higher risk of recurrence.
    Our new study has found that LRH surgical experience and skill trended to have better oncological outcomes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    评估模拟训练与传统动手手术指导对妇科手术中学习者操作技能和患者预后的影响。
    PubMed,Embase,ClinicalTrials.gov,和Cochrane中央受控试验登记册从开始到2021年1月12日。
    随机对照试验,前瞻性比较研究,纳入了前瞻性单组研究,包括培训前和培训后评估,报告了妇科手术前基于手术模拟的培训.
    审稿人独立确定了这些研究,获得的数据,并评估研究质量。根据妇科手术类型对结果进行分析,模拟,比较器,和结果数据,包括临床和患者相关结果。最大似然随机效应模型荟萃分析的比值比和标准化的平均差以估计的95%置信区间计算。
    20项研究,包括13项随机对照试验,1项随机交叉试验,5项非随机比较研究,并确定了1个前置研究。大多数纳入的研究(14/21,67%)是在腹腔镜模拟器上进行的,证据质量中等。Meta分析结果显示,与传统外科教学相比,高保真度和低保真度模拟器提高了手术室的手术技术技能,高保真模拟器缩短了手术时间。发现中等质量的证据有利于腹腔镜手术前的热身运动。没有足够的证据对其他妇科手术进行荟萃分析。
    目前的证据支持对各种妇科手术进行基于模拟的培训,以提高手术室的技术技能,但缺乏患者相关结局的数据.
    To evaluate the effect of simulation training vs traditional hands-on surgical instruction on learner operative skills and patient outcomes in gynecologic surgeries.
    PubMed, Embase, ClinicalTrials.gov, and the Cochrane Central Register of Controlled Trials from inception to January 12, 2021.
    Randomized controlled trials, prospective comparative studies, and prospective single-group studies with pre- and posttraining assessments that reported surgical simulation-based training before gynecologic surgery were included.
    Reviewers independently identified the studies, obtained data, and assessed the study quality. The results were analyzed according to the type of gynecologic surgery, simulation, comparator, and outcome data, including clinical and patient-related outcomes. The maximum likelihood random effects model meta-analyses of the odds ratios and standardized mean differences were calculated with estimated 95% confidence intervals.
    Twenty studies, including 13 randomized controlled trials, 1 randomized crossover trial, 5 nonrandomized comparative studies, and 1 prepost study were identified. Most of the included studies (14/21, 67%) were on laparoscopic simulators and had a moderate quality of evidence. Meta-analysis showed that compared with traditional surgical teaching, high- and low-fidelity simulators improved surgical technical skills in the operating room as measured by global rating scales, and high-fidelity simulators decreased the operative time. Moderate quality evidence was found favoring warm-up exercises before laparoscopic surgery. There was insufficient evidence to conduct a meta-analysis for other gynecologic procedures.
    Current evidence supports incorporating simulation-based training for a variety of gynecologic surgeries to increase technical skills in the operating room, but data on patient-related outcomes are lacking.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    暂无摘要。
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Journal Article
    2019年冠状病毒病(COVID-19)大流行在手术教育期间存在个人暴露风险。我们旨在使用合成模拟器和在线视频聊天软件来验证针对冠状动脉搭桥术的完全远程教师监督的手术培训课程的可行性。
    这项观察性研究组织了24次2小时的远程训练。每节有三名学员参加,一位教师,和一个主机。共有70名学员和24个学院注册。参与者通过在线视频聊天加入了远程会话,并使用市售模拟器进行冠状动脉吻合术的重点训练。进行了一项调查以验证远程会话的可行性。分析了重复参加(n=13)的学员的绩效改善情况,比较了各种绩效指标的初始和最终得分。
    所有学员和院系都对远程会话的有效性感到满意。此外,大多数受训人员(79%)和学院(95%)同意远程培训课程相当于传统的现场培训研讨会。在近侧面的评分分量中观察到初始和最后一个会话之间的显着改善(3.4±1.0vs.4.1±0.9;P=0.02),远端(3.3±0.8vs.3.9±0.8;P=0.03),外观(3.5±0.8vs.4.2±0.7;P=0.01),和内部外观(2.8±0.9vs.4.0±0.9;P=0.004)。
    执行了由教师监督的远程外科培训课程,结果令人满意。这种方法可能对COVID-19大流行期间的外科教育有重要意义。
    UNASSIGNED: The coronavirus disease 2019 (COVID-19) pandemic presents in-person exposure risk during surgical education. We aimed to validate the feasibility of fully remote faculty-supervised surgical training sessions focused on coronary artery bypass grafting using a synthetic simulator and online video-chat software.
    UNASSIGNED: This observational study organized 24 sessions of 2-hour remote training. Each session involved three trainees, one faculty, and one host. A total of 70 trainees and 24 faculties were enrolled. The participants joined the remote sessions via online video-chat, and performed focused training in coronary artery anastomosis using a commercially available simulator. A survey was conducted to validate the feasibility of the remote sessions. Performance improvement of the trainees who repeatedly participated (n = 13) were analyzed comparing initial and final scores of various performance indicators.
    UNASSIGNED: All trainees and faculties were satisfied with the efficacy of the remote session. Additionally, most trainees (79%) and faculties (95%) agreed that the remote training sessions were equivalent to conventional on-site training seminars. A significant improvement between initial and last sessions was observed in the scoring components of near side (3.4 ± 1.0 vs. 4.1 ± 0.9; P = 0.02), far side (3.3 ± 0.8 vs. 3.9 ± 0.8; P = 0.03), external appearance (3.5 ± 0.8 vs. 4.2 ± 0.7; P = 0.01), and internal appearance (2.8 ± 0.9 vs. 4.0 ± 0.9; P = 0.004).
    UNASSIGNED: Faculty-supervised remote surgical training sessions were executed with satisfactory results. This methodology may have important implications for surgical education during the COVID-19 pandemic.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    目的:通过频繁评估证明能力是基于能力的医学教育课程逐步发展的预期目标。客观结构化技术技能评估(OSATS)被认为是一种有效的形成性评估方法,但在少数情况下,已经制定了确定能力的标准。本研究使用边界回归方法来检查复杂技术任务的性能标准设置,并使用OSATS清单评估新手。
    方法:这是一项单机构前瞻性单臂实验设计研究。参与者是58名非医学本科生,没有手术经验,他们观察了端到侧血管吻合的基于计算机的训练模块。随后,为参与者提供了两次20分钟的培训课程,相隔两周,他们在低保真模型上执行任务时收到专家反馈。每次培训后,参与者在没有帮助的情况下完成了任务。由专家回顾性地使用OSATS检查表记录和评估会议。
    结果:配对t检验分析表明,对于检查表总分(t(52)=8.05,p<0.001)和全局评分(t(53)=8.15,p<0.001),个体在第二阶段的表现明显更好。边界回归分析表明,在第一阶段(R2=.60)和第二阶段(R2=.75),OSATS检查表可以充分捕获新手的性能变化。Further,该清单可以可靠地将新手分类为五个全球评级绩效水平中的三个。由回归方程确定的通过率在所有全球评级水平上从阶段1提高到阶段2。
    结论:随着对基于能力的医学教育的日益关注,培训计划必须有能力准确评估结果并设定最低绩效标准。边界回归方法可以使用OSATS清单在复杂的技术技能任务培训之前和之后,准确地区分不同表现水平的新手学习者。
    OBJECTIVE: Demonstrated competence through frequent assessment is an expected goal for progressive development in competency-based medical education curricula. The Objective Structured Assessment of Technical Skill (OSATS) is considered a valid method of formative assessment, but in few instances have standards been set for determining competence. The present study used borderline regression methods to examine standard setting of performance on a complex technical task with novices assessed using an OSATS checklist.
    METHODS: This was a single institution prospective single arm experimental design study. Participants were 58 non-medical undergraduate students with no previous surgical experience, who observed a computer-based training module on end-to-side vascular anastomosis. Subsequently, participants were provided two 20-minute training sessions, two weeks apart where they received expert feedback whilst performing the task on a low-fidelity model. After each training session, participants completed the task unaided. Sessions were recorded and assessed using an OSATS checklist retrospectively by experts.
    RESULTS: Paired t-test analyses indicate that for both the checklist total score (t(52) = 8.05, p < 0.001) and the global rating score (t(53) = 8.15, p < 0.001), individuals performed significantly better in Phase 2. Borderline regression analyses indicated that in Phase 1 (R2 = .60) and Phase 2 (R2 = .75), the OSATS checklist could adequately capture variation in performance in novices. Further, the checklist could reliably classify novices at three of the five global rating performance levels. Pass rates determined by regression equations improved from Phase 1 to Phase 2 on all global rating levels.
    CONCLUSIONS: With the increasing focus on competency-based medical education, it is imperative that training programs have the capacity to accurately assess outcomes and set minimum performance standards. Borderline regression methods can accurately differentiate novice learners of varying performance levels before and after training on a complex technical skill task using an OSATS checklist.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Journal Article
    创建基于能力的评估工具,用于小儿食管镜检查与异物取出。
    盲目修改的Delphi共识过程。
    三级护理中心。
    通过研究电子数据捕获数据库将25个潜在项目的列表发送给进行小儿食管镜检查的66名专家外科医生。在第一轮中,项目被评为“保留”或“删除”,并合并了注释。在第二轮中,专家以7分的李克特量表对每个项目的重要性进行了评分。达成共识的目标是7至25个最终项目。
    第一轮的回答率为38/64(59.4%),返回的问卷完成了100%。专家希望“保留”所有项目,并纳入了172条评论。第二轮共分发了24项特定任务和7项先前经过验证的全球评级项目,回答率为53/64(82.8%),问卷完成97.5%.在特定于任务的项目中,9达成共识,7接近共识,8没有达成共识。对于先前验证的全局评级项目,6达成共识,1接近共识。
    使用改良的Delphi共识技术,可以就硬性食管镜检查中异物取出的重要步骤达成共识。在此过程中评估学员时,现在可以考虑这些项目。该工具可以使受训者专注于程序的重要步骤,并帮助培训计划标准化如何评估受训者。
    5.喉镜,131:1168-1174,2021。
    Create a competency-based assessment tool for pediatric esophagoscopy with foreign body removal.
    Blinded modified Delphi consensus process.
    Tertiary care center.
    A list of 25 potential items was sent via the Research Electronic Data Capture database to 66 expert surgeons who perform pediatric esophagoscopy. In the first round, items were rated as \"keep\" or \"remove\" and comments were incorporated. In the second round, experts rated the importance of each item on a seven-point Likert scale. Consensus was determined with a goal of 7 to 25 final items.
    The response rate was 38/64 (59.4%) in the first round and returned questionnaires were 100% complete. Experts wanted to \"keep\" all items and 172 comments were incorporated. Twenty-four task-specific and 7 previously-validated global rating items were distributed in the second round, and the response rate was 53/64 (82.8%) with questionnaires returned 97.5% complete. Of the task-specific items, 9 reached consensus, 7 were near consensus, and 8 did not achieve consensus. For global rating items that were previously validated, 6 reached consensus and 1 was near consensus.
    It is possible to reach consensus about the important steps involved in rigid esophagoscopy with foreign body removal using a modified Delphi consensus technique. These items can now be considered when evaluating trainees during this procedure. This tool may allow trainees to focus on important steps of the procedure and help training programs standardize how trainees are evaluated.
    5. Laryngoscope, 131:1168-1174, 2021.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Journal Article
    这项研究的目的是开发一种针对口腔颌面外科的模拟技术技能考试,评估测试的有效性及其心理测量特性,并从驻地受训人员和专家评估人员那里获得关于考试的反馈。口腔颌面客观结构化技术技能评估(OMOSATS)考试是一种基于模拟程序的八站技术技能考试。14名各级口腔颌面外科(OMFS)居民参加了12分钟的手术任务,并由盲专家OMFS外科医生进行了评估。任务包括缝合,气管造口术,关节镜,牙种植体放置,板弯曲和拉力螺钉应用,微血管吻合,和植皮。这些任务反映了OMFS实践所需的广泛技术里程碑。使用经过验证的全球评级量表和特定于任务的清单评估任务。试点研究的结果表明,八个OMOSATS站中的七个站具有很强的面子和结构有效性,可以根据八个手术站中每个站所展示的技术技能来辨别培训水平。此外,通过单向方差分析,观察P值以确认辨别水平。OMOSATS考试是评估OMFS居民技术技能的一种新颖方法。这种类型的基于性能的评估已经在其他手术领域中使用了很多年。有强有力的证据支持使用技术技能考试来帮助评估,教,并为我们的OMFS学员提供培训结果。
    The aim of this study was to develop a simulated technical skills examination specific to oral and maxillofacial surgery, assessing the validity of the test and its psychometric properties and obtaining feedback on the examination from both resident trainees and expert evaluators. The Oral and Maxillofacial Objective Structured Assessment of Technical Skills (OMOSATS) examination is a simulated procedure-based eight-station technical skills examination. Fourteen oral and maxillofacial surgery (OMFS) residents of various levels participated in 12-minute surgical tasks and were evaluated by blinded expert OMFS surgeons. The tasks included suturing, tracheostomy, arthroscopy, dental implant placement, plate bending and lag screw application, microvascular anastomosis, and skin grafting. These tasks reflect a broad range of technical milestones necessary for the practice of OMFS. Tasks were evaluated using a validated global rating scale and task-specific checklists. The results of the pilot study indicated strong face and construct validity for seven of the eight OMOSATS stations in discerning the level of training based on technical skill demonstrated at each of the eight surgical stations. Additionally, through one-way ANOVA, P-values were observed to confirm the level of discernment. The OMOSATS examination is a novel way to assess the technical skills of OMFS residents. This type of performance-based assessment has been used in other surgical domains for many years. There is strong evidence to support the use of technical skills examinations to help evaluate, teach, and provide surgeon educators with training outcomes for our OMFS trainees.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Journal Article
    The use of 3-dimensional (3D)-printed models is promising in nasal endoscopic technique training. Here, we aimed to develop postsurgical simulants for use in conjunction with 3D-printed nasal models and to assess their usefulness in helping residents transfer basic endoscopic skills acquired during simulation training to clinical situations.
    The secretion simulant was prepared via a crosslinked reaction between sodium alginate and acrylamide, whereas the packing simulant was prepared using a superabsorbent polymer. After the simulants\' fidelity and utility were evaluated by 5 rhinologists using a 5-point Likert scale, 46 novice residents were trained using the 3D-printed nasal models and postsurgical simulants for 2 weeks. A checklist and Global Rating Scale (GRS) were used to assess their performances before and after training, and the time to finish each task was also recorded. Following training, the qualified trainees operated on real patients and were reevaluated.
    The simulants\' similarity and usefulness scored ≥4.0, and the training cost was 28 CNY ($4 USD) per session. Following training, the checklist and GRS scores increased, and the operation time decreased (all p < 0.05). There were no statistical differences between the trainees\' performances on the models with the simulants and on patients (all p > 0.05).
    The low-cost simulated secretion and dressing are safe to use. The application of the simulants in conjunction with that of 3D-printed nasal models in a simulated task setting can help residents in transferring endoscopic skills acquired during simulation teaching to real patients.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号