Academic assessment

学术评估
  • 文章类型: Journal Article
    关于COVID-19大流行对学业成绩的影响的调查研究结果好坏参半,有限的直接证据。
    使用意大利大学系统的学术平台,进行了一项涉及30,731名学生和829名考官的大规模档案研究,包括总共246,416项考试(仅口试),以审查COVID-19大流行对通过考试可能性的影响.在大流行期间,以面对面和在线形式收集了检查数据。在大流行前,只能访问面对面的数据.
    在面对面检查中,我们观察到,与大流行前相比,大流行期间通过考试的可能性较低。值得注意的是,在大流行期间,我们发现与面对面评估相比,通过在线平台进行的考试的机会增加了。
    这些发现为COVID-19大流行对学业成绩的不利影响提供了第一个直接证据。此外,结果与先前的调查研究一致,强调使用远程信息处理平台评估学生的表现会增加考试成功的可能性。这项研究大大有助于正在进行的努力,旨在理解封锁和在线平台的广泛使用如何影响学术评估过程。
    UNASSIGNED: Survey studies yield mixed results on the influence of the COVID-19 pandemic on academic performance, with limited direct evidence available.
    UNASSIGNED: Using the academic platform from the Italian university system, a large-scale archival study involving 30,731 students and 829 examiners encompassing a total of 246,416 exams (oral tests only) to scrutinize the influence of the COVID-19 pandemic on the likelihood of passing exams was conducted. Examination data were collected both in face-to-face and online formats during the pandemic. In the pre-pandemic period, only face-to-face data were accessible.
    UNASSIGNED: In face-to-face examination, we observed a lower probability of passing exams during the pandemic as opposed to pre-pandemic periods. Notably, during the pandemic we found an increased chance of passing exams conducted through online platforms compared to face-to-face assessments.
    UNASSIGNED: These findings provide the first direct evidence of an adverse impact of the COVID-19 pandemic on academic performance. Furthermore, the results align with prior survey studies underscoring that using telematics platforms to evaluate students\' performance increases the probability of exam success. This research significantly contributes to ongoing efforts aimed to comprehend how lockdowns and the widespread use of online platforms impact academic assessment processes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    基于课程的测量(CBM)是一种衡量学生学术成长和评估教学效果的方法(Deno,特殊的孩子,52,219-232,1985)开发的,在某种程度上,基于应用行为分析的特点。学习管理和使用CBM数据通常是教师准备计划的一部分,但在行为分析研究生课程中并不常见(Schreck等人。行为干预,31,355-376,2016;Schreck&Mazur,行为干预,23,201-212,2008)。本文介绍了教育团队在多层支持系统(MTSS)框架中使用CBM可以遵循的一系列步骤。这些步骤包括(1)选择CBM发布者并收集材料;(2)练习管理和评分CBM;(3)管理,得分,并将学生分数与年级基准进行比较;(4)使用CBM数据编写雄心勃勃且现实的IEP目标;(5)使用基于数据的个性化。每个步骤都被描述,并包括一个案例研究的描述,该案例研究基于我们与职前教师候选人合作的经验,以及K-12和课后教学计划中的特殊教育和行为分析研究生。
    Curriculum-based measurement (CBM) is an approach to measuring student academic growth and evaluating the effectiveness of instruction (Deno, Exceptional Children, 52, 219-232, 1985) that was developed, in part, based on characteristics of applied behavior analysis. Learning to administer and use CBM data is commonly part of teacher preparation programs, but less common in behavior analysis graduate programs (Schreck et al. Behavioral Interventions, 31, 355-376, 2016; Schreck & Mazur, Behavioral Interventions, 23, 201-212, 2008). This article describes a sequence of steps that educational teams can follow to use CBM within the multi-tiered system of support (MTSS) framework. These steps include (1) selecting a CBM publisher and gathering materials; (2) practicing administering and scoring CBM; (3) administering, scoring, and comparing student scores to grade-level benchmarks; (4) using CBM data to write ambitious and realistic IEP goals; and (5) using data-based individualization. Each step is described and includes a description of a case study that is based on our experiences working with pre-service teacher candidates, and special education and behavior analysis graduate students in K-12 and after-school instructional programs.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    Objective.识别和描述衡量文化能力并与药学教育相关的经过验证的评估工具。方法。使用系统方法来确定与药学教育相关的定量文化能力评估工具。使用OVID和EBSCO数据库对文献进行了系统的搜索,并手动搜索了可能包含与药学教育相关的工具的期刊。有资格接受审查,这些工具必须使用美国的研究样本来开发,至少有一份经过同行评审的经过验证的出版物,适用于制药行业,自2010年起出版。结果。系统的文献和手动搜索确定了27种工具。12种评估工具符合摘要中包含的标准,并讨论了它们与药学教育的相关性。结论。文献综述表明,评估工具差异很大,没有一个工具可以有效地评估药学专业学生或药学博士课程的文化能力的各个方面。由于文化能力是药学教育认证标准中的优先事项,鼓励PharmD计划开发其他工具来衡量观察到的性能。
    Objective. To identify and describe validated assessment tools that measure cultural competence and are relevant to pharmacy education.Methods. A systematic approach was used to identify quantitative cultural competence assessment tools relevant to pharmacy education. A systematic search of the literature was conducted using the OVID and EBSCO databases and a manual search of journals deemed likely to include tools relevant to pharmacy education. To be eligible for the review, the tools had to be developed using a study sample from the United States, have at least one peer-reviewed validated publication, be applicable to the pharmacy profession, and be published since 2010.Results. The systematic literature and manual search identified 27 tools. Twelve assessment tools met the criteria to be included in the summary and their relevancy to pharmacy education is discussed.Conclusion. A review of literature demonstrates that assessment tools vary widely and there is no one tool that can effectively assess all aspects of cultural competence in pharmacy students or the Doctor of Pharmacy curriculum. As cultural competence is a priority within the accreditation standards for pharmacy education, PharmD programs are encouraged to develop additional tools that measure observed performance.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    OBJECTIVE: Academic physical therapy has no universal metrics by which educational programs can measure outcomes, limiting their ability to benchmark to their own historical performance, to peer institutions, or to other healthcare professions. The PT-GQ survey, adapted from the Association of American Medical Colleges\' (AAMC) Graduation Questionnaire, addresses this gap by offering both inter-professional insight and fine-scale assessment of physical therapist education. This study reports the first wave of findings from an ongoing multi-site trial of the PT-GQ among diverse academic physical therapy programs, including: 1) benchmarks for academic physical therapy, and 2) a comparison of the physical therapist student experience to medical education benchmarks.
    METHODS: Thirty-four doctor of physical therapy (DPT) programs (13.2% nationwide sample) administered the online survey to DPT graduates during the 2019-2020 academic year. PT-GQ and AAMC data were contrasted via Welch\'s unequal-variance t-test and Hedges\' g (effect size).
    RESULTS: A total of 1025 respondents participated in the study (response rate: 63.9%). Average survey duration was 31.8 minutes. Overall educational satisfaction was comparable to medicine, and respondents identified areas of curricular strength (eg, anatomy) and weakness (eg, pharmacology). DPT respondents provided higher ratings of faculty professionalism than medicine, lower rates of student mistreatment, and a lesser impact of within-program diversity upon their training. One-third of respondents were less than \"Satisfied\" with student mental health services. DPT respondents reported significantly higher Exhaustion but lower Disengagement than medical students, along with lower Tolerance for Ambiguity. Of DPT respondents who reported educational debt, one-third reported debt exceeding $150,000, the threshold above which the DPT degree loses economic power.
    CONCLUSIONS: These academic benchmarks, using the PT-GQ, provided insight into physical therapist education and identified differences between physical therapist and medical student perceptions.
    CONCLUSIONS: This ongoing trial will establish a comprehensive set of benchmarks to better understand academic physical therapy outcomes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    背景:在高等教育环境中,越来越多的人呼吁放弃传统的总结性评估做法,这样的期末笔试,探索以替代方式评估学习的方法。同行评估一直被提倡作为形成性评估的一种手段,以提高学生的参与度,让学生对自己的学习负责。虽然有越来越多的证据表明同行评价在高等教育中的价值,不能假设同伴反馈会适当地转化为所有设置和教育环境。
    目的:本研究评估了在护理和助产研究方法模块中实施形成性在线同伴评估的情况。我们探讨了学生的期望,经验,以及最终这种方法的可接受性。
    方法:定量描述性研究。
    方法:爱尔兰。
    方法:一项在线调查,旨在整理参与同伴评估的期望和经验。量表是从以前的研究中得出的,非参数检验探讨了感知随时间的变化。定性内容分析探索了开放文本响应中明显的模式。
    结果:基线时的反应率为28%(n=74),随访时的反应率为31%(n=81)。对95%的受访者来说,同行评估是一种新的体验。学生最初表示担心,认为任务令人生畏,怀疑他们向同龄人提供反馈的能力。然而,通过提供指导和工具来支持学生的活动,报告了对过程和经验的高度满意。随着时间的推移,对同伴评估的看法存在显著差异,包括一种增强的信念,即受访者具有评估同龄人工作的必要技能。
    结论:总而言之,护理和助产专业学生一致认为,作为研究方法培训和关键技能培养的一部分,同伴评估是一种宝贵的学习经验.
    BACKGROUND: In higher education settings, there are increasing calls to shift away from traditional summative assessment practices, such end of term written tests, to explore methods of assessing learning in alternative ways. Peer assessment has been advocated as a means of formative assessment to enhance student engagement, empowering students to take responsibility for their own learning. While there is accumulating evidence for the value of peer assessment in higher education, one cannot assume peer feedback will translate appropriately to all settings and educational contexts.
    OBJECTIVE: This study evaluated the implementation of formative online peer assessment in a nursing and midwifery research methods module. We explored students\' expectations, experiences, and ultimately the acceptability of this approach.
    METHODS: A quantitative descriptive study.
    METHODS: Ireland.
    METHODS: An online survey to collate expectations and experiences of engagement in peer assessment. Scales were drawn from previous research and non-parametric tests explored changes in perceptions over time. Qualitative content analysis explored patterns evident in open-text responses.
    RESULTS: The response rate was 28% (n = 74) at baseline and 31% at follow-up (n = 81). Peer assessment was a new experience for 95% of respondents. Students initially expressed apprehension, perceiving the task as daunting, and doubting their ability to provide feedback to peers. However, through providing instruction and tools to support students in the activity, high levels of satisfaction with the process and the experience were reported. Significant differences in perceptions of peer assessment were evident over time, including an enhanced belief that respondents had the requisite skills to appraise the work of their peers.
    CONCLUSIONS: In sum, nursing and midwifery students agreed that peer assessment was a valuable learning experience as part of research methods training and critical skills development.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    Universities and research institutions have to assess individuals when making decisions about hiring, promotion and tenure, but there are concerns that such assessments are overly reliant on metrics and proxy measures of research quality that overlook important factors such as academic rigor, data sharing and mentoring. These concerns have led to calls for universities and institutions to reform the methods they use to assess research and researchers. Here we present a new tool called SPACE that has been designed to help universities and institutions implement such reforms. The tool focuses on five core capabilities and can be used by universities and institutions at all stages of reform process.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    Emotional intelligence is intrinsically associated with the ability to understand, manage, and express feelings and deal with other people\'s emotions. This competence is essential for the formation, development, and maintenance of personal and professional relationships. Furthermore, emotional intelligence can be extensively worked out and developed over time, which allows each individual to become a better professional. Nevertheless, the perception that higher education students have about the importance of emotional intelligence remains residual and there are few contexts that allow them to develop emotional intelligence skills. In this sense, this study proposes the use of a serious game to assess and develop emotional intelligence skills in the context of an entrepreneurship discipline attended by multidisciplinary students from the courses of management and computer engineering. The performance of students is measured and discussed considering a mixed methods approach. The findings indicate the existence of a correlation between the player\'s emotional intelligence skills and his performance in the game, and this occurrence is common to students regardless of their course, gender, age, and number of years of professional experience. The study also explores the importance of emotional intelligence considering the distinct profile of students.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:2010年意大利大学系统的改革引入了国家科学能力培养(ASN)作为申请常任教授职位的要求。自从59,149名候选人的简历及其评估结果公开以来,ASN构成了对全国评估过程进行分析的机会。
    目的:本文的主要目标是:(i)使用候选CV中包含的信息预测ASN结果;(ii)确定一组可用于执行准确预测的定量指标。
    方法:使用语义技术来提取,系统化和丰富申请人简历中包含的信息,和机器学习方法用于预测ASN结果并识别相关预测因子的子集。
    结果:为了预测副教授角色的成功,我们使用所有和前15个预测因子的最佳模型在88%和88.6%的情况下做出准确的预测(F-measure值高于0.6),分别。对于全职教授的角色也取得了类似的结果。
    结果:所提出的方法优于为预测研究人员评估程序的结果而开发的其他模型。
    结论:这样的结果允许开发一种自动化系统,用于在未来的ASN会议和其他学者的评估程序中支持候选人和委员会。
    BACKGROUND: The 2010 reform of the Italian university system introduced the National Scientific Habilitation (ASN) as a requirement for applying to permanent professor positions. Since the CVs of the 59,149 candidates and the results of their assessments have been made publicly available, the ASN constitutes an opportunity to perform analyses about a nation-wide evaluation process.
    OBJECTIVE: The main goals of this paper are: (i) predicting the ASN results using the information contained in the candidates\' CVs; (ii) identifying a small set of quantitative indicators that can be used to perform accurate predictions.
    METHODS: Semantic technologies are used to extract, systematize and enrich the information contained in the applicants\' CVs, and machine learning methods are used to predict the ASN results and to identify a subset of relevant predictors.
    RESULTS: For predicting the success in the role of associate professor, our best models using all and the top 15 predictors make accurate predictions (F-measure values higher than 0.6) in 88% and 88.6% of the cases, respectively. Similar results have been achieved for the role of full professor.
    RESULTS: The proposed approach outperforms the other models developed to predict the results of researchers\' evaluation procedures.
    CONCLUSIONS: Such results allow the development of an automated system for supporting both candidates and committees in the future ASN sessions and other scholars\' evaluation procedures.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Comparative Study
    Publications by Chinese researchers in scientific journals have dramatically increased over the past decade; however, academic misconduct also becomes more prevalent in the country. The aim of this prospective study was to understand the perceptions of Chinese biomedical researchers towards academic misconduct and the trend from 2010 to 2015. A questionnaire comprising 10 questions was designed and then validated by ten biomedical researchers in China. In the years 2010 and 2015, respectively, the questionnaire was sent as a survey to biomedical researchers at teaching hospitals, universities, and medical institutes in mainland China. Data were analyzed by the Chi squared test, one-way analysis of variance with the Tukey post hoc test, or Spearman\'s rank correlation method, where appropriate. The overall response rates in 2010 and 2015 were 4.5% (446/9986) and 5.5% (832/15,127), respectively. Data from 15 participants in 2010 were invalid, and analysis was thus performed for 1263 participants. Among the participants, 54.7% thought that academic misconduct was serious-to-extremely serious, and 71.2% believed that the Chinese authorities paid no or little attention to the academic misconduct. Moreover, 70.2 and 65.2% of participants considered that the punishment for academic misconduct at the authority and institution levels, respectively, was not appropriate or severe enough. Inappropriate authorship and plagiarism were the most common forms of academic misconduct. The most important factor underlying academic misconduct was the academic assessment system, as judged by 50.7% of the participants. Participants estimated that 40.1% (39.8 ± 23.5% in 2010; 40.2 ± 24.5% in 2015) of published scientific articles were associated with some form of academic misconduct. Their perceptions towards academic misconduct had not significantly changed over the 5 years. Reform of the academic assessment system should be the fundamental approach to tackling this problem in China.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    The Chinese academic assessment and incentive system drew mixed responses from academia. In the essay the author tried to explain why the current assessment system is appropriate in China and an opportunistic behavior in Chinese academia is exposed.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号