Meta-research

meta 研究
  • 文章类型: Journal Article
    背景:系统评价(SRs)是告知决策的最可靠的证据来源。虽然有严格的协议来正确进行SR,有时主要研究中的方法学偏差会在SR的结论中得到解释.
    目的:本研究旨在绘制有关乳牙龋齿病变处理的证据。
    方法:两名审查人员在电子数据库中进行了系统的搜索,直到2024年3月。任何有关乳牙龋齿病变处理的SR都被认为是可行的。
    结果:包括约162个SR。其中,80专注于恢复性治疗,64牙髓治疗,18非侵入性治疗。只有42.6%的人提出了研究注册方案。大多数(67.9%)进行了荟萃分析,而少数人专门对汽车进行定性数据分析。尽管92.6%的SR使用一些工具评估了主要研究的方法学质量或偏倚风险,只有24%的人使用分级方法评估证据的确定性,导致分类范围从非常低到中等。
    结论:对研究注册方案的依从性有限,表明需要改进这种做法。此外,在少数使用分级方法的SR中,大多数人表现出非常低到中等的确定性水平。
    BACKGROUND: Systematic reviews (SRs) represent the most robust source of evidence for informing decision-making. While there are rigorous protocols for properly conducting SRs, sometimes the methodological biases in the primary studies are accounted for in the conclusions of the SRs.
    OBJECTIVE: This study aimed to map the evidence regarding the management of caries lesions in primary teeth.
    METHODS: Two reviewers conducted a systematic search up to March 2024 in electronic data-bases. Any SR concerning the management of caries lesions in primary teeth was considered eli-gible.
    RESULTS: About 162 SRs were included. Among these, 80 focused on restorative treatments, 64 on endodontic treatments, and 18 on non-invasive treatments. Only 42.6% presented a study registra-tion protocol. The majority (67.9%) performed a meta-analysis, while a minority exclusively car-ried out qualitative data analysis. Despite 92.6% of the SRs evaluating the methodological quality or risk of bias of the primary studies using some tool, only 24% assessed the certainty of evidence using the GRADE approach, resulting in classifications ranging from very low to moderate.
    CONCLUSIONS: There is a limited adherence to study registration protocols, indicating a need for improvements in this practice. Additionally, among the few SRs that used the GRADE approach, the majority demonstrated levels of very low to moderate certainty.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    传统领域,互补,综合医学(TCIM)因其对健康和福祉的整体方法而受到越来越多的关注。虽然发表的关于TCIM的研究数量呈指数增长,评论家认为,该领域面临着与方法论严谨性有关的挑战,再现性,和整体质量。本文提出了元研究作为评估和提高TCIM研究质量的一种方法。元研究,也被称为关于研究的研究,可以定义为“研究本身的研究:它的方法,reporting,再现性,评估,和激励措施\“。通过系统地评估方法的严谨性,识别偏见,促进透明度,元研究可以提高TCIM研究的可靠性和可信度。本文讨论的感兴趣的具体主题包括:1)研究设计和研究方法,2)研究报告;3)研究伦理,完整性,和不当行为,4)可复制性和可重复性,5)同行评审和期刊编辑实践,6)研究经费:赠款和奖励,7)招聘,促销,和任期。对于每个主题,我们提供了案例来说明元研究在TCIM中的应用。我们认为,元研究举措可以有助于维护公众信任,维护研究诚信,推进基于证据的TCIM实践,虽然挑战包括导航方法的复杂性,偏见,以及资金和学术认可方面的差距。未来的方向涉及量身定制的研究方法,跨学科合作,政策影响,和元研究能力建设。
    The field of traditional, complementary, and integrative medicine (TCIM) has garnered increasing attention due to its holistic approach to health and well-being. While the quantity of published research about TCIM has increased exponentially, critics have argued that the field faces challenges related to methodological rigour, reproducibility, and overall quality. This article proposes meta-research as one approach to evaluating and improving the quality of TCIM research. Meta-research, also known as research about research, can be defined as \"the study of research itself: its methods, reporting, reproducibility, evaluation, and incentives\". By systematically evaluating methodological rigour, identifying biases, and promoting transparency, meta-research can enhance the reliability and credibility of TCIM research. Specific topics of interest that are discussed in this article include the following: 1) study design and research methodology, 2) reporting of research, 3) research ethics, integrity, and misconduct, 4) replicability and reproducibility, 5) peer review and journal editorial practices, 6) research funding: grants and awards, and 7) hiring, promotion, and tenure. For each topic, we provide case examples to illustrate meta-research applications in TCIM. We argue that meta-research initiatives can contribute to maintaining public trust, safeguarding research integrity, and advancing evidence based TCIM practice, while challenges include navigating methodological complexities, biases, and disparities in funding and academic recognition. Future directions involve tailored research methodologies, interdisciplinary collaboration, policy implications, and capacity building in meta-research.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:评估牙科随机对照试验(RCTs)中的透明度实践。
    方法:这项荟萃研究包括牙科RCT,无论主题如何,方法,或报告的详细程度。只考虑了英语学习。我们在PubMed中检索了2016年12月31日至2021年12月31日以英文发表的牙科随机对照试验。筛查一式两份,提取的数据包括期刊和作者的详细信息,牙科专业,协议注册,数据和代码共享,利益冲突声明,和资金信息。对数据进行描述性分析。我们生成了地图,以说明相应作者国家/地区的透明度项目报告情况,以及反映牙科专业报告水平的热表。
    结果:共纳入844个随机对照试验。只有12.86%的研究报告了有关数据和代码共享的任何信息。据报道,50.36%的RCT进行了协议注册。在大多数研究中存在利益冲突(83.41%)和资金(71.68%)声明。无论国家或专业如何,利益冲突和资金冲突都得到了一致的报告,虽然数据和代码共享跨专业的报告水平较低,以及世界各地的低传播。协议登记表现出相当大的可变性。
    结论:考虑到RCT对循证牙科的重要性,至关重要的是,每个参与科学生产和传播过程的人都必须积极和一贯地促进遵守透明的科学标准,特别是协议的注册,共享数据和代码。
    BACKGROUND: To evaluate transparency practices in randomized controlled trials (RCTs) in dentistry.
    METHODS: This meta-research study included RCTs in dentistry regardless of topic, methods, or level of detail reported. Only studies in English were considered. We searched PubMed for RCTs in dentistry published in English from December 31, 2016, to December 31, 2021. The screening was performed in duplicate, and data extracted included journal and author details, dental specialty, protocol registration, data and code sharing, conflict of interest declaration, and funding information. A descriptive analysis of the data was performed. We generated maps illustrating the reporting of transparency items by country of the corresponding author and a heat table reflecting reporting levels by dental specialty.
    RESULTS: A total of 844 RCTs were included. Only 12.86% of studies reported any information about data and code sharing. Protocol registration was reported for 50.36% of RCTs. Conflict of interest (83.41%) and funding (71.68%) declarations were present in most studies. Conflicts of interest and funding were consistently reported regardless of country or specialty, while data and code sharing had a low level of reporting across specialties, as well as low dissemination across the world. Protocol registration exhibited considerable variability.
    CONCLUSIONS: Considering the importance of RCTs for evidence-based dentistry, it is crucial that everyone who participates in the scientific production and dissemination process actively and consistently promotes adherence to transparent scientific standards, particularly registration of protocols, and sharing of data and code.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    研究脑电双频指数(BIS)降低术中意识(IOA)疗效的随机对照试验(RCT)报告了相互矛盾的结果。这项荟萃分析的目的是巩固RCT的结果,以评估BIS与对照组相比降低IOA的功效。次要结果包括拔管时间,自发和/或口头睁开眼睛的时间,PACU放电时间,以及吸入麻醉药的使用。
    包括报告主要和/或次要结局之一的RCT。文献检索使用关键词“随机对照试验”和“术中意识”。使用RevMan5进行Meta分析。
    这项研究纳入了27个随机对照试验,共有35,585名患者,BIS组18,146例,对照组17,439例。在BIS和对照组中,14,062例患者中有18例(0.12%)和16,765例中有42例(0.25%)报告了明确的IOA,分别,差异无统计学意义。BIS可有效减少平均1.3分钟的自发睁眼时间和平均1.97分钟的拔管时间。各组之间PACU放电时间无差异。与对照组相比,七氟醚的消耗量显着减少,但地氟醚和异丙酚的消耗量没有差异。
    虽然BIS监测导致术中意识发生率降低一半,没有统计学意义。BIS在减少拔管时间方面提供适度的好处,自发睁开眼睛的时间,和七氟醚的消费。证据级别:I.
    UNASSIGNED: Randomized controlled trials (RCTs) investigating the efficacy of bispectral index (BIS) to reduce intra-operative awareness (IOA) have reported conflicting results. The purpose of this meta-analysis is to consolidate results from RCTs to assess the efficacy of BIS in reducing IOA when compared to controls. Secondary outcomes included time to extubation, time to spontaneous and/or verbal eye opening, PACU discharge time, and utilization of inhaled anesthetics.
    UNASSIGNED: RCTs which reported on one of the primary and/or secondary outcomes were included. Literature search utilized keywords \"randomized control trial\" and \"intraoperative awareness.\" Meta-analysis was performed using RevMan 5.
    UNASSIGNED: Twenty-seven RCTs were included in the study with a total of 35,585 patients, with 18,146 patients in the BIS and 17,439 in the control group. Eighteen of 14,062 patients (0.12%) and 42 of 16,765 (0.25%) reported definite IOA in the BIS and control group, respectively, with no statistically significant difference. BIS was effective in reducing the time to spontaneous eye opening by an average of 1.3 minutes and the time to extubation by an average of 1.97 minutes. There was no difference in PACU discharge times among the groups. There was a significant decrease in consumption of sevoflurane but no difference in desflurane and propofol compared to the control group.
    UNASSIGNED: While BIS monitoring results in decreased incidence of intra-operative awareness by half, it was not statistically significant. BIS provides modest benefits with regard to reducing the time to extubation, the time to spontaneous eye opening, and consumption of sevoflurane.Level of evidence: I.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    目的:评估放射学期刊是否以及如何展示其关于使用大型语言模型(LLM)的政策,并识别与存在关联的日志特征变量。
    方法:在这项荟萃研究中,我们筛选了放射学杂志,核医学和医学影像类别,2022年期刊引文报告,不包括非英语期刊和不可用的相关文件。我们评估了他们的LLM使用政策:(1)政策是否存在;(2)政策是否适用于作者,审稿人,并且编辑在场;以及(3)政策是否要求作者报告LLM的使用情况,LLM的名称,使用LLM的部分,LLM的作用,LLM的验证,和LLM的潜在影响。评估了策略的存在与期刊特征变量之间的关联。
    结果:在43.9%(83/189)的期刊中提出了LLM使用政策,对于作者来说,审稿人,编辑的比例为43.4%(82/189),29.6%(56/189)和25.9%(49/189)的期刊,分别。许多期刊提到了使用方面(43.4%,82/189),名字(34.9%,66/189),验证(33.3%,63/189),和角色(31.7%,60/189)的法学硕士,而LLM的潜在影响(4.2%,8/189),和使用LLM的部分(1.6%,3/189)被少量触摸。发布者与LLM使用策略的存在有关(p<0.001)。
    结论:在放射学期刊中,LLM使用策略的存在并不理想。鼓励制定报告准则,以促进报告质量和透明度。
    如果利益相关者制定了共享的完整报告指南,然后由期刊认可,则可以提高LLM在科学写作中使用的质量和透明度。
    结论:在放射学期刊中使用LLM的政策尚未探索。一些放射学期刊提出了有关LLM使用的政策。需要LLM使用的共享完整报告指南。
    OBJECTIVE: To evaluate whether and how the radiological journals present their policies on the use of large language models (LLMs), and identify the journal characteristic variables that are associated with the presence.
    METHODS: In this meta-research study, we screened Journals from the Radiology, Nuclear Medicine and Medical Imaging Category, 2022 Journal Citation Reports, excluding journals in non-English languages and relevant documents unavailable. We assessed their LLM use policies: (1) whether the policy is present; (2) whether the policy for the authors, the reviewers, and the editors is present; and (3) whether the policy asks the author to report the usage of LLMs, the name of LLMs, the section that used LLMs, the role of LLMs, the verification of LLMs, and the potential influence of LLMs. The association between the presence of policies and journal characteristic variables was evaluated.
    RESULTS: The LLM use policies were presented in 43.9% (83/189) of journals, and those for the authors, the reviewers, and the editor were presented in 43.4% (82/189), 29.6% (56/189) and 25.9% (49/189) of journals, respectively. Many journals mentioned the aspects of the usage (43.4%, 82/189), the name (34.9%, 66/189), the verification (33.3%, 63/189), and the role (31.7%, 60/189) of LLMs, while the potential influence of LLMs (4.2%, 8/189), and the section that used LLMs (1.6%, 3/189) were seldomly touched. The publisher is related to the presence of LLM use policies (p < 0.001).
    CONCLUSIONS: The presence of LLM use policies is suboptimal in radiological journals. A reporting guideline is encouraged to facilitate reporting quality and transparency.
    UNASSIGNED: It may facilitate the quality and transparency of the use of LLMs in scientific writing if a shared complete reporting guideline is developed by stakeholders and then endorsed by journals.
    CONCLUSIONS: The policies on LLM use in radiological journals are unexplored. Some of the radiological journals presented policies on LLM use. A shared complete reporting guideline for LLM use is desired.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:吸引研究人员作为研究对象是制定有效和相关研究实践的关键。重要的是要了解如何最好地吸引研究人员作为研究对象。
    方法:24阶乘实验,作为多阶段优化策略的一部分,进行了评估四个招聘策略组件对参与者打开电子邮件调查链接和完成调查的影响。参与者是三个美国国家健康研究联盟的成员。使用分层的简单随机样本将潜在的调查参与者分配给16种招募方案之一。招聘战略组成部分旨在解决内在和外在的动机来源,包括:50美元的礼物,$1,000抽奖,利他的信息,和利己主义的信息。多变量广义线性回归分析调整联盟估计的成分对结果的影响。测试了组分之间的潜在相互作用。结果报告为具有95%置信区间(95%CI)的调整比值比(aOR)。
    结果:调查收集于2023年6月至12月。共有418名参与者来自财团,最终分析样本为400名符合条件的参与者。在最终样本中,82%(341)打开了调查链接,35%(147)完成了调查。利他主义信息增加了开启调查的几率(aOR2.02,95%CI:1.35-2.69,p=0.033),而利己主义信息显着降低了打开调查的几率(aOR0.56,95CI0.38-0.75,p=0.08)。利己主义信息的接收增加了一旦开始完成调查的几率(aOR1.81,95CI:1.39-2.23,p<0.05)。对于调查完成结果,利他主义吸引力和利己主义消息传递策略之间存在显着的负交互作用。货币激励措施对调查完成没有重大影响。
    结论:内在动机可能是健康研究人员参与调查研究的更大驱动因素,而不是外在动机。利他主义和利己主义的信息传递可能会对最初的兴趣和调查完成产生不同的影响,如果结合在一起,可能会导致招聘率的提高。但不是调查完成。需要进一步的研究来确定如何最佳地优化消息内容以及观察到的效果是否被调查负担所修改。
    BACKGROUND: Engaging researchers as research subjects is key to informing the development of effective and relevant research practices. It is important to understand how best to engage researchers as research subjects.
    METHODS: A 24 factorial experiment, as part of a Multiphase Optimization Strategy, was performed to evaluate effects of four recruitment strategy components on participant opening of an emailed survey link and survey completion. Participants were members of three US-based national health research consortia. A stratified simple random sample was used to assign potential survey participants to one of 16 recruitment scenarios. Recruitment strategy components were intended to address both intrinsic and extrinsic sources of motivation, including: $50 gift, $1,000 raffle, altruistic messaging, and egoistic messaging. Multivariable generalized linear regression analyses adjusting for consortium estimated component effects on outcomes. Potential interactions among components were tested. Results are reported as adjusted odds ratios (aOR) with 95% confidence intervals (95% CI).
    RESULTS: Surveys were collected from June to December 2023. A total of 418 participants were included from the consortia, with final analytical sample of 400 eligible participants. Out of the final sample, 82% (341) opened the survey link and 35% (147) completed the survey. Altruistic messaging increased the odds of opening the survey (aOR 2.02, 95% CI: 1.35-2.69, p = 0.033), while egoistic messaging significantly reduced the odds of opening the survey (aOR 0.56, 95%CI 0.38-0.75, p = 0.08). The receipt of egoistic messaging increased the odds of completing the survey once opened (aOR 1.81, 95%CI: 1.39-2.23, p < 0.05). There was a significant negative interaction effect between the altruistic appeal and egoistic messaging strategies for survey completion outcome. Monetary incentives did not a have a significant impact on survey completion.
    CONCLUSIONS: Intrinsic motivation is likely to be a greater driver of health researcher participation in survey research than extrinsic motivation. Altruistic and egoistic messaging may differentially impact initial interest and survey completion and when combined may lead to improved rates of recruitment, but not survey completion. Further research is needed to determine how to best optimize message content and whether the effects observed are modified by survey burden.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    暂无摘要。
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    目标:为了追求健康公平,世界卫生组织最近呼吁对眼睛健康的不平等进行更广泛的监测。基于人群的眼睛健康调查可以提供这些信息,但是在设计中是否考虑到服务不足的群体,实施,和调查报告是未知的。我们对自2000年以来发表的调查进行了系统的方法审查,以检查有多少基于人群的眼睛健康调查在其设计中考虑了服务不足的群体。reporting,或实施。
    方法:我们确定了所有基于人群的横断面调查,这些调查报告了客观测量的视力障碍或失明的患病率。使用PROGRESS+框架来识别服务不足的群体,我们评估了每项研究是否在整个理论基础上考虑了15个项目中服务不足的群体,抽样或招聘方法,或参与和患病率的报告。
    结果:本综述纳入了388项眼部健康调查。很少有研究在研究计划或实施期间前瞻性地考虑服务不足的群体,例如,在他们的样本量计算(n=5,≈1%)或招聘策略(n=70,18%)中。研究考虑服务不足群体的最常见方式是报告患病率估计值(n=374,96%)。在研究期间,我们观察到出版物所考虑的不同PROGRESS+因素的数量略有增加。95%(n=267)的研究认为性别/性别在至少一个项目中。43%(n=166)的纳入研究主要针对服务不足的人群,特别是对于居住在农村地区的人们的地方研究,我们确定了在社会排斥群体中进行稳健的基于人群的研究的例子.
    结论:需要更多的努力来改进设计,实施,和报告调查,以监测不平等和促进眼睛健康的公平。理想情况下,国家一级对视力损害和服务覆盖面的监测将辅之以小规模研究,以了解服务最不足群体所经历的差距。
    OBJECTIVE: In pursuit of health equity, the World Health Organization has recently called for more extensive monitoring of inequalities in eye health. Population-based eye health surveys can provide this information, but whether underserved groups are considered in the design, implementation, and reporting of surveys is unknown. We conducted a systematic methodological review of surveys published since 2000 to examine how many population-based eye health surveys have considered underserved groups in their design, implementation, or reporting.
    METHODS: We identified all population-based cross-sectional surveys reporting the prevalence of objectively measured vision impairment or blindness. Using the PROGRESS + framework to identify underserved groups, we assessed whether each study considered underserved groups within 15 items across the rationale, sampling or recruitment methods, or the reporting of participation and prevalence rates.
    RESULTS: 388 eye health surveys were included in this review. Few studies prospectively considered underserved groups during study planning or implementation, for example within their sample size calculations (n = 5, ∼1%) or recruitment strategies (n = 70, 18%). The most common way that studies considered underserved groups was in the reporting of prevalence estimates (n = 374, 96%). We observed a modest increase in the number of distinct PROGRESS + factors considered by a publication over the study period. Gender/sex was considered within at least one item by 95% (n = 367) of studies. Forty-three percent (n = 166) of included studies were conducted primarily on underserved population groups, particularly for subnational studies of people living in rural areas, and we identified examples of robust population-based studies in socially excluded groups.
    CONCLUSIONS: More effort is needed to improve the design, implementation, and reporting of surveys to monitor inequality and promote equity in eye health. Ideally, national-level monitoring of vision impairment and service coverage would be supplemented with smaller-scale studies to understand the disparities experienced by the most underserved groups.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    背景:尽管在标准方案项目:干预试验建议(SPIRIT)指南发布后,随机试验方案报告的完整性有所改善,许多项目报告仍然很差。本研究旨在评估使用SPIRIT定制的试验方案模板的有效性,以提高硕士学生作为硕士论文一部分编写的方案报告的完整性。
    方法:在加泰罗尼亚国际大学骨科手动物理治疗大学硕士学位进行实验研究之前和之后(巴塞罗那,西班牙)。虽然干预后的学生被指示使用为SPIRIT量身定制的试验方案模板,干预前的学生未使用该模板.
    方法:干预前和干预后期间充分报告项目的平均数之间的差异(0-10量表)。结果由两名盲法评估员独立和一式两份进行评估。学生和他们的导师不知道他们是研究项目的一部分。对于统计分析,我们使用广义线性回归模型(因变量:方案中充分报告的项目数;自变量:干预期,call,语言)。
    结果:纳入了34项试验方案(17项,干预前;17项,干预后)。在干预后期间产生的方案(平均值:8.24;SD:1.52)比在干预前期间产生的方案(平均值:6.35;SD:1.80)更完整地报告;调整后差异:1.79(95%CI:0.58至3.00)。
    结论:基于SPIRIT的模板可用于提高随机试验方案报告的完整性。
    BACKGROUND: Despite the improvements in the completeness of reporting of randomized trial protocols after the publication of the Standard Protocol Items: Recommendations for Interventional Trial (SPIRIT) guidelines, many items remain poorly reported. This study aimed to assess the effectiveness of using SPIRIT-tailored templates for trial protocols to improve the completeness of reporting of the protocols that master\'s students write as part of their master\'s theses.
    METHODS: Before and after experimental study performed at the University Master\'s Degree in Orthopaedic Manual Physiotherapy of the Universitat Internacional de Catalunya (Barcelona, Spain). While students in the post-intervention period were instructed to use a trial protocol template that was tailored to SPIRIT, students in the pre-intervention period did not use the template.
    METHODS: Difference between the pre- and post-intervention periods in the mean number of adequately reported items (0-10 scale). The outcomes were evaluated independently and in duplicate by two blinded assessors. Students and their supervisors were not aware that they were part of a research project. For the statistical analysis, we used a generalized linear regression model (dependent variable: number of adequately reported items in the protocol; independent variables: intervention period, call, language).
    RESULTS: Thirty-four trial protocols were included (17, pre-intervention; 17, post-intervention). Protocols produced during the post-intervention period (mean: 8.24; SD: 1.52) were more completely reported than those produced during the pre-intervention period (mean: 6.35; SD: 1.80); adjusted difference: 1.79 (95% CI: 0.58 to 3.00).
    CONCLUSIONS: SPIRIT-based templates could be used to improve the completeness of reporting of randomized trial protocols.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    在几个大规模的复制项目中,在原始和复制研究中,统计学上无显著性的结果被解释为复制成功。\'这里,我们讨论了这种方法的逻辑问题:两项研究的非显著性并不能确保研究提供了没有效应的证据,如果样本量足够小,“复制成功”几乎总是可以实现。此外,相关错误率无法控制。我们展示了方法,如等价测试和贝叶斯因子,可用于充分量化没有效果的证据以及如何在复制设置中应用它们。使用来自重复性项目的数据:癌症生物学,实验哲学可复制性项目,和可重复性项目:心理学我们说明了许多具有“空结果”的原始和复制研究实际上没有定论。我们得出的结论是,同样重要的是要复制具有统计学意义上无显著结果的研究,但是它们应该被设计出来,分析,并适当解释。
    In several large-scale replication projects, statistically non-significant results in both the original and the replication study have been interpreted as a \'replication success.\' Here, we discuss the logical problems with this approach: Non-significance in both studies does not ensure that the studies provide evidence for the absence of an effect and \'replication success\' can virtually always be achieved if the sample sizes are small enough. In addition, the relevant error rates are not controlled. We show how methods, such as equivalence testing and Bayes factors, can be used to adequately quantify the evidence for the absence of an effect and how they can be applied in the replication setting. Using data from the Reproducibility Project: Cancer Biology, the Experimental Philosophy Replicability Project, and the Reproducibility Project: Psychology we illustrate that many original and replication studies with \'null results\' are in fact inconclusive. We conclude that it is important to also replicate studies with statistically non-significant results, but that they should be designed, analyzed, and interpreted appropriately.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号