formative assessment

形成性评估
  • 文章类型: Journal Article
    形成性评估总体上已被证明可以改善医学教育中的终结性评估。然而,目前尚不清楚在多个亚专业的综合课程中使用它们作为课程学分是否有利于学生获得知识。我们着手确定通过总结性评估对形成性测验进行评分是否会对学生的知识获取产生影响。
    在2020年,测验仍然是强制性的,但没有被评为课程学分。当测验进行评分与未评分时,我们收集并比较了来自学生队列的形成性(测验)和总结性(单元测试)得分数据。医学院入学考试(MCAT)成绩,性别,并利用医学代表性不足(URM)状态数据来确定它们是否对结局有影响。我们使用预定义的无差异区域(±5%)和第二代p值来确定平均总结性考试成绩是否存在有意义的差异。
    尽管取消课程学分后测验成绩有所下降,平均总结性考试成绩的差异完全存在于五个课程模块中的三个课程模块的冷漠区域内,表明这些模块的总结性考试成绩没有有意义的差异。在其他街区,差异没有完全嵌套在冷漠区域内;然而,所有与该区域重叠的数据,暗示考试成绩差异对于这些模块来说是不确定的。
    我们的研究表明,当强制性测验未按课程学分进行评分时,对总结性评估没有有意义的影响或没有决定性的有害影响。
    UNASSIGNED: Formative assessments have overall been shown to improve summative evaluations in medical education. However, it remains unclear if utilizing them for course credit in an integrated curriculum over multiple subspecialties is beneficial for student acquisition of knowledge. We set out to determine if grading formative quizzes had an effect on student acquisition of knowledge via summative assessments.
    UNASSIGNED: In 2020, quizzes remained mandatory, but were not graded for course credit. We collected and compared formative (quiz) and summative (unit exam) score data from student cohorts when quizzes were graded versus not graded. Medical college admission test (MCAT) score, gender, and underrepresented in medicine (URM) status data were utilized to determine if they had effects on outcomes. We used a predefined region of indifference (± 5%) and second-generation p-values to determine if there were meaningful differences in average summative exam scores.
    UNASSIGNED: Despite a drop in quiz scores after removing course credit, differences in average summative exam scores fully resided within the region of indifference for three of five course blocks, indicating no meaningful differences in summative exam scores existed for those blocks. In other blocks, the difference was not fully nested within the region of indifference; however, all data overlapped with this region, implying exam score differences were inconclusive for these blocks.
    UNASSIGNED: Our study demonstrates that there is either no meaningful effect on summative assessments or no conclusive detrimental effects when mandatory quizzes are not graded for course credit.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    评估是所有教育计划的重要组成部分,必须检查能力的获得,同时促进和促进学习。进度测试(PT)是公认的评估认知知识,临床背景下的临床推理和决策,提供有关个人表现和节目质量的重要信息。它在巴西和国际医学院广泛使用;然而,它在评估巴西的医疗居民方面仍然没有什么作用。我们介绍了两年来在传染病居住计划中实施PT试点的经验。第一,二年级和三年级居民进行了四次连续考试,每次40道多项选择题(项目)。对受体进行了项目写作最佳实践培训。所有项目都由专家小组审查,批准后,包含在项目库中。所有参与者都回答了他们对体验的看法的调查。在所有考试申请中,三年级居民的最终分数更高。参与者的满意度很高,他在考试和反馈中提到了学习机会。PT可以在培训期间改善居民的评估,居民的表现应指导计划的审查和改进。
    Assessment is an essential component for all educational programs and must check competence acquirement while foster and promote learning. Progress Test (PT) is well recognized to assess cognitive knowledge, clinical reasoning and decision making in the clinical context, offering important information about the individual performance and program quality. It is widely used in Brazilian and international medical schools; however, it still has little role in assessing medical residents in Brazil. We present the experience of a PT pilot implementation in an Infectious Diseases residency program over two years. The first, second and third-year residents did four serial exams with 40 multiple choice questions (item)/each. Preceptors were trained on best practices on item writing. All the items were reviewed by a panel of experts and, after approval, included in the item bank. All participants answered a survey on their perceptions about the experience. The final score was higher for the third-year residents in all exam applications. The level of satisfaction was high among the participants, who mentioned the learning opportunity with the exam and the feedback. PT can improve residents\' assessment along the training period and residents\' performance should guide review and improvement of the programs.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    在大型大学课程中有效实施循证教学(EBT)得益于成功使用教学团队。教学团队的反馈允许教师根据学生学习的证据采取行动,满足学生的需求。这种反馈对于新手指导员或有经验的指导员第一次教授班级可能特别重要。这项研究旨在表征教学团队反馈的性质及其对经验丰富的教师教授新课程的决定和行动的影响。教学团队成员以预期的形式提供反馈,通知,和建议。预期和建议似乎对教师的决定和行动有最大的影响,虽然注意到,尽管提供了对学生思维的见解,影响较小。我们的发现表明,当团队成员有机会有意义地参与计划和教学过程时,教学团队可以向教师提供有价值的反馈。
    The effective implementation of evidence-based teaching (EBT) in large college courses benefits from the successful use of instructional teams. An instructional team\'s feedback allows instructors to act based on evidence of student learning, addressing students\' needs. This feedback may be particularly important for novice instructors or experienced instructors teaching a class for the first time. This study sought to characterize the nature of an instructional team\'s feedback as well as its influence on the decisions and actions of a seasoned instructor teaching a new class. Instructional team members provided feedback in the form of anticipations, noticings, and suggestions. Anticipations and suggestions seemed to have the largest impact on the instructor\'s decisions and actions, while noticings, despite providing insights into student thinking, had a smaller effect. Our findings indicate that an instructional team can provide valuable feedback to instructors when team members have an opportunity to meaningfully participate in the planning and teaching processes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    基于团队的学习(TBL)是一种基于证据的方法,可促进团队合作。同行评价(PE)是塑造未来团队参与和促进反思的重要组成部分。由于PE的使用不同,实施,和评估,这项研究建立了TBL课程的形成性体育工具的内容和结构效度。
    根据对体育文献的全面回顾开发了十项工具,并由经验丰富的教育工作者团队进行了批判性编辑。研究生组织学课程中的每个学生在从Never到Always(0-3)的两个时间点上对同龄人进行评分。通过划分响应集(D1和D2)来分析仪器的因子结构;D1用于探索性因子分析(EFA),D2用于验证性因子分析(CFA)。克朗巴赫的阿尔法评估了内部一致性。
    来自四个队列的158名学生的数据被纳入分析(D1,D2=972)。三因素解决方案具有良好的整体内部一致性(α=0.82),并且在子量表范围从0.67到0.81。因子结构与现有文献关于(1)制备的共振,(2)提供反馈,(3)反馈接受度和态度。
    本研究为TBL课程的形成性PE工具的内容和有效性建立了证据。
    UNASSIGNED: Team-based learning (TBL) is an evidence-based approach to promote teamwork. Peer evaluation (PE) is an essential component to shape future team engagement and promote reflection. As PEs vary in use, implementation, and assessment, this study establishes the content and construct validity of a formative PE tool for a TBL course.
    UNASSIGNED: A ten-item instrument was developed based on a comprehensive review of PE literature and was critically edited by a team of experienced educators. Each student in a graduate histology course rated peers at two timepoints on a scale from Never to Always (0-3). The instrument\'s factor structure was analyzed by dividing the response set (D1 and D2); with D1 utilized for exploratory factor analysis (EFA) and D2 for confirmatory factor analysis (CFA). Cronbach\'s alpha assessed internal consistency.
    UNASSIGNED: Data from 158 students across four cohorts were included in the analyses (D1, D2 = 972). A three-factor solution had good overall internal consistency (alpha = 0.82), and within the subscales ranged from 0.67 to 0.81. The factor structures were resonant with existing literature on (1) preparation, (2) providing feedback, and (3) feedback receptivity and attitude.
    UNASSIGNED: This study establishes evidence of content and construct validity of a formative PE instrument for a TBL course.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    带有反馈的形成性评估是医学教育评估计划的一部分,以改善学生的学习。有限的研究集中在其应用和对实用解剖学教育的影响上。
    这项研究旨在检查医学生在基于身体系统的教育单位的实际解剖学课程中对形成性评估的看法,并探讨其对最终实际考试表现的影响。描述性的,进行了横断面研究。通过一项调查,从173名2年级医学生中收集了数据,该调查涉及他们对形成性评估和反馈的过程和重要性的看法。调查采用5分的李克特量表。调查结束时附加了两个开放式问题。将学生在第3单元(进行形成性评估)中的表现与他们在第2单元(未进行形成性评估)中的表现以及上一学年学生在第3单元(未进行形成性评估)中的表现进行比较。使用描述性统计。统计显著性水平设定为p值<0.05。对开放式问题(定性数据)的回答进行了统计,分类为主题,并以频率和百分比表示。
    调查显示内部一致性很高,并通过探索性因子分析建立其效度。结果表明,具有形成性评估和反馈的单元的平均分数显着高于没有形成性评估和反馈的单元。学生对实际解剖学课程后进行的形成性评估和反馈表现出积极的看法。他们报告了关于他们从形成性评估和反馈中获得的好处的有用见解,以及对未来改进的建设性建议。
    该研究表明,学生在实际解剖学课程后积极地感知形成性评估和反馈课程。研究结果还提到了形成性评估对学生在解剖学总结性实践评估中的表现的积极影响。
    UNASSIGNED: Formative assessment with feedback is part of the assessment program in medical education to improve students\' learning. Limited research has focused on its application and impact on practical anatomy education.
    UNASSIGNED: This study aimed to examine medical students\' perceptions of formative assessment in practical anatomy sessions of body systems-based educational units and explore its influence on final practical exam performance. A descriptive, cross-sectional study was conducted. Data was collected from 173 Year 2 medical students through a survey that addressed their perception of process and importance of formative assessment and feedback. The survey employed a 5-point Likert scale. Two open-ended questions were appended at the end of the survey. Students\' performance in Unit 3 (where formative assessment was conducted) was compared to their performance in Unit 2 (where no formative assessment was conducted) and with the performance of the previous academic year\'s students in Unit 3 (where no formative assessment was conducted). Descriptive statistics were used. The level of statistical significance was set at p-value < 0.05. Responses to open-ended questions (qualitative data) were counted, categorized as themes, and presented as frequencies and percentages.
    UNASSIGNED: The survey showed high internal consistency, and its validity was established through exploratory factor analysis. Results showed that the mean mark for the unit with formative assessment and feedback was significantly higher than for the units without formative assessment and feedback. Students showed positive perception of formative assessment and feedback conducted after practical anatomy sessions. They reported useful insights regarding the benefits they gained from formative assessment and feedback as well as constructive suggestions for future improvements.
    UNASSIGNED: The study indicates that students positively perceived formative assessment and feedback sessions after practical anatomy sessions. Findings also refer to a positive effect of formative assessment on students\' performance in summative practical assessment in anatomy.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    Mini-CEX评估临床能力,主要用作形成性评估工具。它在研究生培训中的使用有据可查。然而,Mini-CEX将在培养本科医学生方面发挥重要作用,特别是随着印度基于能力的医学教育的开始。这项工作报告了在ENT部门实施Mini-CEX的情况分析。
    自2017年以来,耳鼻喉科正在使用Mini-CEX对学生的临床能力进行形成性评估。在总结性评估之前,每个学生都必须至少完成五次Mini-CEX遭遇。我们回顾了2018年参加总结性考试的149名本科医学生的Mini-CEX评估记录。
    我们分析了874次Mini-CEX遭遇的记录。每次Mini-CEX相遇平均花费11分钟。每个学生都完成了五项这样的评估,其中55分钟的一对一师生互动集中在临床技能学习上。反馈时间从1到30分钟不等。反馈集中在认知(46%)和精神运动(42%)领域。然而,大多数学生反映他们在Mini-CEX期间学习了心理运动技能。学生只为Mini-CEX选择了一些技能,忽略了许多必须知道的技能。
    Mini-CEX作为医学本科生耳鼻喉科培训的形成性评估工具是可行的。它改善了评估员与学生的互动,提供有效的反馈,并在学生中发展反思的实践。然而,作为质量保证措施,需要定期审查和培训评估员和学生。
    UNASSIGNED: Mini-CEX assesses clinical competency and is mainly used as a formative assessment tool. Its use in postgraduate training is well documented. However, Mini-CEX would play a significant role in training undergraduate medical students, especially with the commencement of competency-based medical education in India. This work reports the situational analysis of the Mini-CEX implementation in the department of ENT.
    UNASSIGNED: The Department of ENT is using Mini-CEX for formative assessment of students\' clinical competence since 2017. Each student had to complete a minimum of five Mini-CEX encounters before the summative assessment. We reviewed the Mini-CEX assessment records of 149 undergraduate medical students who appeared for the summative exam in 2018.
    UNASSIGNED: We analysed the records of 874 Mini-CEX encounters. Each Mini-CEX encounter took 11 min on average. Each student completed five such assessments, which accounted for 55 min of one-to-one teacher-student interaction focused on clinical skills learning. The feedback time varied from 1 to 30 min. Feedback was focused on the cognitive (46%) and psychomotor (42%) domains. However, the majority of students reflected that they learned psychomotor skills during the Mini-CEX. Students selected only a few skills for the Mini-CEX, ignoring many must-know skills.
    UNASSIGNED: Mini-CEX is feasible as a formative assessment tool for medical undergraduates\' ENT training. It improves the assessor-student interaction, provides effective feedback, and develops the practice of reflection among students. However, regular review and training of the assessors and students are needed as a quality assurance measure.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    简介:学习专家沟通技巧是姑息治疗培训中的核心教育目标,然而,很少有专门为受过专业培训的姑息治疗提供者设计的基于通信的教育工具。目的:开发和实施一种工具,以促进临终关怀和姑息医学研究员对严重疾病交流的有效学习。方法:在加州大学洛杉矶分校姑息治疗奖学金计划中开发了一种新的形成性评估工具,并在整个学年每周使用。在学年结束时分别为研究员和教职员工举行焦点小组会议,以深入了解该工具的经验和有效性。通过主题分析对焦点小组的成绩单进行分析。结果:焦点组的参与率为47%(n=7)。定性分析证明了该工具在确定学习目标方面的积极影响,提高反馈质量,在围绕高级沟通技巧标准化语言方面,在奖学金年度的上半年最有价值。该工具的某些方面被发现会增加反馈焦虑,包括能力评分部分,使用频率,以及与个体患者相遇的利用。结论:这种新颖的沟通工具为专科姑息治疗提供者的严重疾病沟通培训提供了重要的补充,在创建命名和组织技能的共享心智模型时,以及产生特定的高质量学习目标和反馈。我们试点实施阶段的初步反馈提供了有关如何完善工具和删除不必要地增加反馈焦虑的组件的重要信息。
    Introduction: Learning expert communication skills is a core educational goal within palliative care training, yet there are few communication-based educational tools specifically designed for specialty-trained palliative care providers. Objective: To develop and implement a tool to facilitate effective learning of serious illness communication for hospice and palliative medicine fellows. Methods: A novel formative assessment tool was developed within the UCLA Palliative Care Fellowship program, and utilized throughout the academic year on a weekly basis. Focus groups were held for fellows and faculty separately at the end of the academic year in order to gain insight into the experience and effectiveness of the tool. Focus group transcripts were analyzed through thematic analysis. Results: There was a 47% participation rate in the focus groups (n = 7). Qualitative analysis demonstrated positive impact of the tool in identifying learning goals, improving quality of feedback, and in standardizing language around advanced communication skills, with most value in the first half of the fellowship year. Some aspects of the tool were found to increase feedback anxiety, including the competency scoring component, frequency of use, and utilization with individual patient encounters. Conclusion: This novel communication tool provides an important addition to serious illness communication training of specialist palliative care providers, in creating a shared mental model for naming and organizing skills, as well as generating specific high quality learning goals and feedback. Preliminary feedback from our pilot implementation phase provided important information about how to refine the tool and remove components that unnecessarily added to feedback anxiety.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    对解剖学学习者的评估是一项复杂的任务,因为它不仅测试学生的事实知识,还有视觉信息的分析。有时候,组织学新手必须在短时间内掌握微观结构的图像识别技能。本文介绍了一种策略,为密歇根大学的一年级牙科学生提供简短的服务,非职等捐款,形成性评估测验,以便更好地为高风险做好准备,最终的总结性组织学检查。7年来收集的数据表明,学生,他们利用了这个形成性评估的机会,在他们的终结性考试中表现明显优于学生,谁没有。尤其是早期的练习测验用户获利最大。学生,他们使用练习测验直到取得满分,在统计上也有更高的期末考试分数。学生,没有使用练习测验的人,累计D1年平均成绩(D1-GPA)明显低于学生,是谁干的,这表明学业较弱的学生往往没有充分利用支持性学习资源。总的来说,在DENT510组织学课程中,牙科入院测试(DAT)的分数是学习成功的弱预测因子。相比之下,D1-GPA值与最终组织学检查评分呈中等强度正相关.这个练习测验策略遇到的主要问题是,许多学生等到接近期末考试的那一天才利用这个反馈机会,从而降低其改善组织学整体学习策略的潜在益处。
    Assessment of learners in the anatomical sciences is a complex task as it not only tests students\' fact knowledge, but also the analysis of visual information. Sometimes, novice histology learners must acquire image recognition skills of microscopic structures in a short time frame. This paper describes a strategy of offering first year dental students at the University of Michigan a short, non-grade contributing, formative assessment quiz in order to better prepare them for a high-stakes, final summative histology examination. Data collected over 7 years indicate that students, who made use of this formative assessment opportunity, performed significantly better in their summative examination than students, who did not. Especially early practice quiz users profited most. Students, who used the practice quiz until they achieved a perfect score, also had statistically higher final examination scores. Students, who did not use the practice quiz, had a significantly lower cumulative D1-year Grade Point Average (D1-GPA) than students, who did, indicating that academically weaker students often underuse supporting learning resources. In general, scores from the Dental Admission Test (DAT) were weak predictors of learning success in the DENT 510 histology course. In contrast, the D1-GPA values had a medium strength positive correlation with final histology examination scores. The major problem that was encountered with this practice quiz strategy was that many students waited until close to the day of the final examination before taking advantage of this feedback opportunity, thereby reducing its potential benefit for improving their overall learning strategy for histology.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    背景:长案用于评估医学生执行临床任务的熟练程度。作为形成性评估,目的是提供绩效反馈,旨在加强和加快临床学习。在低资源环境中,长病例是临床医师的主要形成性评估方法之一,但在文献中很少受到关注。
    目的:探索医学生和教职员工在资源匮乏的三级护理教学医院中使用长案例研究作为形成性评估方法的经验。
    方法:采用定性研究设计。这项研究是在马凯雷雷大学进行的,低资源设置。研究参与者是三年级和五年级的医学生以及讲师。目的抽样用于招募参与者。数据收集包括与学生的六次焦点小组讨论和与讲师的五次关键线人访谈。定性数据采用归纳专题分析法进行分析。
    结果:研究中出现了三个主题:病房安置,案例介绍,以及案例评估和反馈。调查结果显示,学生在分配给整个职员的特定病房/单位的患者床边进行长期病例。有效监督,反馈,和分数被强调为对学习过程产生积极影响的关键实践。然而,挑战,例如对长期案件的定位不足,医院病房的超专业化,寻找标记的压力,并确定了不充分的反馈做法。
    结论:长期案例为学生提供了在临床环境中接触真实患者的机会。然而,在三级护理教学医院,这是至关重要的,以确保适当的设计和实施这一做法,使学生接触到各种情况。充分有效的监督和反馈为每个学习者提供提供宝贵的机会并接受纠正。
    BACKGROUND: The long case is used to assess medical students\' proficiency in performing clinical tasks. As a formative assessment, the purpose is to offer feedback on performance, aiming to enhance and expedite clinical learning. The long case stands out as one of the primary formative assessment methods for clinical clerkship in low-resource settings but has received little attention in the literature.
    OBJECTIVE: To explore the experiences of medical students and faculty regarding the use of the Long Case Study as a formative assessment method at a tertiary care teaching hospital in a low-resource setting.
    METHODS: A qualitative study design was used. The study was conducted at Makerere University, a low-resource setting. The study participants were third- and fifth-year medical students as well as lecturers. Purposive sampling was utilized to recruit participants. Data collection comprised six Focus Group Discussions with students and five Key Informant Interviews with lecturers. The qualitative data were analyzed by inductive thematic analysis.
    RESULTS: Three themes emerged from the study: ward placement, case presentation, and case assessment and feedback. The findings revealed that students conduct their long cases at patients\' bedside within specific wards/units assigned for the entire clerkship. Effective supervision, feedback, and marks were highlighted as crucial practices that positively impact the learning process. However, challenges such as insufficient orientation to the long case, the super-specialization of the hospital wards, pressure to hunt for marks, and inadequate feedback practices were identified.
    CONCLUSIONS: The long case offers students exposure to real patients in a clinical setting. However, in tertiary care teaching hospitals, it\'s crucial to ensure proper design and implementation of this practice to enable students\' exposure to a variety of cases. Adequate and effective supervision and feedback create valuable opportunities for each learner to present cases and receive corrections.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    长期以来,传统的学术讲座一直被批评为为学生提供被动的学习环境。通常,他们没有抓住观众的注意力,导致学习者分心或无聊,从而降低他们的学习效率。因此,它们被许多学校和大学抛弃,作为一种教育方式,或者被修改成更加以学习者为中心的体验。这篇描述性文章概述了将主动学习PowerPoint幻灯片插入传统组织学讲座的策略。正在向读者提供添加或改进现有主动学习幻灯片的建议和建议,他们计划修改自己的演讲。还讨论了作者在不同类型的组织学学习者中使用这种形成性评估策略的经验。
    Traditional academic lectures have long been criticized as providing a passive learning environment to students. Often, they do not capture the audience\'s attention, resulting in learners being distracted or bored and thereby reducing their learning efficacy. Consequently, they are being abandoned by many schools and universities as an educational modus or modified into more learner-centered experiences. This descriptive article outlines a strategy of inserting active learning PowerPoint slides into traditional histology lectures. Suggestions and advice for adding or improving existing active learning slides are being offered to readers, who are planning to modify their own lecture presentations. The author\'s experience of using this formative assessment strategy with different types of histology learners is also discussed.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

公众号