statistical significance

统计意义
  • 文章类型: Journal Article
    背景:脆弱性分析是一种根据统计结果的稳定性进一步表征结果的方法。这项研究评估了最近的随机对照试验(RCT)的统计脆弱性,该试验评估了机器人辅助与常规全膝关节置换术(RA-TKA与C-TKA)。
    方法:我们向PubMed查询了比较对齐的RCT,函数,RA-TKA和C-TKA之间的结果。脆弱性指数(FI)和反向脆弱性指数(RFI)(统称,计算“FI”)作为改变统计显著性所需的结果逆转次数。通过将FI除以该结果事件的样本大小来计算脆性商(FQ)。计算所有结果以及每个单独结果的平均FI和FQ。根据结局事件类型和统计学意义进行分分析以评估FI和FQ,以及随访和发表年份的研究损失。
    结果:总体中位数FI为3.0(四分位距,[IQR]1.0至6.3),中位数RFI为3.0(IQR2.0至4.0)。总体中位数FQ为0.027(IQR0.012至0.050)。在评估的38项结果中,有23项随访损失大于FI。
    结论:少量的替代结果通常足以逆转RA-TKA与C-TKA中评估二分结果的RCT结果的统计学意义。我们建议报告FI和FQ以及P值,以提高RCT结果的可解释性。
    BACKGROUND: Fragility analysis is a method of further characterizing outcomes in terms of the stability of statistical findings. This study assesses the statistical fragility of recent randomized controlled trials (RCTs) evaluating robotic-assisted versus conventional total knee arthroplasty (RA-TKA versus C-TKA).
    METHODS: We queried PubMed for RCTs comparing alignment, function, and outcomes between RA-TKA and C-TKA. Fragility index (FI) and reverse fragility index (RFI) (collectively, \"FI\") were calculated for dichotomous outcomes as the number of outcome reversals needed to change statistical significance. Fragility quotient (FQ) was calculated by dividing the FI by the sample size for that outcome event. Median FI and FQ were calculated for all outcomes collectively as well as for each individual outcome. Subanalyses were performed to assess FI and FQ based on outcome event type and statistical significance, as well as study loss to follow-up and year of publication.
    RESULTS: The overall median FI was 3.0 (interquartile range, [IQR] 1.0 to 6.3) and the median reverse fragility index was 3.0 (IQR 2.0 to 4.0). The overall median FQ was 0.027 (IQR 0.012 to 0.050). Loss to follow-up was greater than FI for 23 of the 38 outcomes assessed.
    CONCLUSIONS: A small number of alternative outcomes is often enough to reverse the statistical significance of findings in RCTs evaluating dichotomous outcomes in RA-TKA versus C-TKA. We recommend reporting FI and FQ alongside P values to improve the interpretability of RCT results.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Systematic Review
    背景:本研究的目的是利用脆性指数评估跟骨骨折治疗的随机对照试验(RCTs)的稳健性。我们假设跟骨骨折文献中的二分法结果在统计学上是脆弱的,并且与其他骨科专业相当。
    方法:我们从2000年至2022年使用系统评价和荟萃分析(PRISMA)的首选报告项目进行了PubMed搜索跟骨骨折RCT。每个结果的脆弱性指数(FI)是通过单个结果事件的逆转来计算的,直到显著性被逆转。通过将每个脆性指数除以研究样本量来计算脆性商(FQ)。还计算了FI和FQ的四分位间距(IQR)。
    结果:在筛选的3003项研究中,97符合搜索标准,19项RCT评估跟骨骨折纳入分析。确定了79个二分结局,其中30个有统计学意义(P<0.05),49个无统计学意义(P>0.05)。所有结局的总FI和FQ分别为6(IQR3-8)和0.067(IQR0.032-0.100),分别。
    结论:与跟骨骨折相关的文献在统计学上可能不像以前认为的那样稳定。对P值的唯一依赖可能描绘误导性结果。我们,因此,建议将P值与FI和FQ一起报告,以提供跟骨骨折文献中临床发现的可靠背景.
    BACKGROUND: The purpose of this study was to utilize the fragility index to assess the robustness of randomized controlled trials (RCTs) evaluating the management of calcaneus fractures. We hypothesize that the dichotomous outcomes in calcaneus fracture literature will be statistically fragile and comparable to other orthopedic specialties.
    METHODS: We performed a PubMed search for calcaneus fracture RCTs from 2000 to 2022 using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The fragility index (FI) of each outcome was calculated through the reversal of a single outcome event until significance was reversed. The fragility quotient (FQ) was calculated by dividing each fragility index by study sample size. The interquartile range (IQR) was also calculated for the FI and FQ.
    RESULTS: Of the 3003 studies screened, 97 met the search criteria, with 19 RCTs evaluating calcaneus fractures included in the analysis. Seventy-nine dichotomous outcomes with 30 significant (P < 0.05) outcomes and 49 with nonsignificant (P> 0.05) outcomes were identified. The overall FI and FQ of all outcomes were 6 (IQR 3-8) and 0.067 (IQR 0.032-0.100), respectively.
    CONCLUSIONS: The literature surrounding calcaneus fractures may not be as statistically stable as previously thought. The sole reliance on the P value may depict misleading results. We, therefore, recommend reporting the P value in conjunction with the FI and FQ to give a robust contextualization of clinical findings in the calcaneus fracture literature.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    随机对照试验(RCT)和比较研究的统计学意义通常使用P值传达。然而,P值是一种不完美的度量,可能容易受到少量结果逆转的影响,从而改变统计显著性。通过纳入脆弱性指数(FI)和脆弱性商(FQ),可以帮助解释这些研究的统计强度。这项研究检查了比较跟腱断裂手术和非手术治疗的研究的统计稳定性。
    在2000年至2021年之间,对10种骨科期刊进行了系统搜索,以进行比较研究,重点关注跟腱断裂的管理,报告二分结局指标。每个结果的FI由改变显著性所必需的事件逆转的数量确定(P<.05)。FQ通过将FI除以相应的样品大小来计算。进行了其他亚组分析。
    在筛选的8020项研究中,1062符合初始搜索标准,最终纳入17项比较研究进行分析,其中10个是RCT。共检查了40个结果。总的来说,中位数FI为2.5(四分位距[IQR]2-4),平均FI为2.90(±1.58),FQ中位数为0.032(IQR0.012-0.069),平均FQ为0.049(±0.062)。在78%的结果中,FI低于失去随访的患者数量。
    关于跟腱断裂手术与非手术治疗疗效的研究可能不像以前认为的那样具有统计学上的稳定性。改变给定研究的显著性所需的结果逆转的平均次数为2.90。未来的分析可能会受益于在其统计分析中包含脆弱性指数和脆弱性商。
    The statistical significance of randomized controlled trials (RCTs) and comparative studies is often conveyed utilizing the P value. However, P values are an imperfect measure and may be vulnerable to a small number of outcome reversals to alter statistical significance. The interpretation of the statistical strength of these studies may be aided by the inclusion of a Fragility Index (FI) and Fragility Quotient (FQ). This study examines the statistical stability of studies comparing operative vs nonoperative management for Achilles tendon rupture.
    A systematic search was performed of 10 orthopaedic journals between 2000 and 2021 for comparative studies focusing on management of Achilles tendon rupture reporting dichotomous outcome measures. FI for each outcome was determined by the number of event reversals necessary to alter significance (P < .05). FQ was calculated by dividing the FI by the respective sample size. Additional subgroup analyses were performed.
    Of 8020 studies screened, 1062 met initial search criteria with 17 comparative studies ultimately included for analysis, 10 of which were RCTs. A total of 40 outcomes were examined. Overall, the median FI was 2.5 (interquartile range [IQR] 2-4), the mean FI was 2.90 (±1.58), the median FQ was 0.032 (IQR 0.012-0.069), and the mean FQ was 0.049 (±0.062). The FI was less than the number of patients lost to follow-up for 78% of outcomes.
    Studies examining the efficacy of operative vs nonoperative management of Achilles tendon rupture may not be as statistically stable as previously thought. The average number of outcome reversals needed to alter the significance of a given study was 2.90. Future analyses may benefit from the inclusion of a fragility index and a fragility quotient in their statistical analyses.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Systematic Review
    在姑息治疗研究中解释患者报告结果(PRO)的临床意义是循证实践的关键。最小的临床重要差异(MCID)可以帮助解释PRO的变化是否对患者有意义。
    在最近的一项关于将姑息治疗纳入美国成人非癌症严重慢性疾病的门诊治疗的系统评价中,研究MCID的使用及其对关键PRO解释的影响。
    配对调查人员在PubMed的系统综述中提取了每个PRO的MCID,特定于工具的网站,谷歌学者。调查人员比较了调查结果,并通过共识解决了分歧。MCID与荟萃分析或个别研究的结果一起进行解释,以得出有关干预措施有效性的结论。
    可以确定23种仪器中的10种影响9种结果中的7种的MCID。最显著的效果是抑郁症状,其中三项试验报告了基于可用的MCID的无临床意义的统计学差异。尽管其他结果在统计学意义和MCID方面存在差异,他们在荟萃分析中被考虑或影响结局类别中最少数量的研究.
    纳入MCID影响了系统评价中几乎所有PRO的解释。MCID是解释涉及PRO的姑息治疗研究的临床意义的重要指标。研究人员应考虑使用具有完善的MCID的仪器,并纳入MCID,当可用时,在研究设计和解释中。
    Interpreting clinical meaningfulness of patient reported outcomes (PROs) in palliative care research is key in evidence-based practice. Minimal clinically important differences (MCIDs) can help interpret whether changes in PROs are meaningful to patients.
    To examine use of MCIDs in a recent systematic review on integrating palliative care into ambulatory care for U.S. adults with noncancer serious chronic illness and their effect on interpretation of key PROs.
    Paired investigators abstracted MCIDs for each PRO in the systematic review from PubMed, tool specific websites, and Google Scholar. Investigators compared findings and resolved differences through consensus. MCIDs were interpreted alongside results from meta-analyses or individual studies to draw conclusions on effectiveness of interventions.
    MCIDs could be identified for 10 of 23 instruments affecting seven of nine outcomes. The most notable effect was for depressive symptoms, where three trials reported statistically significant differences that were not clinically meaningful based on available MCIDs. Although differences in statistical significance and MCIDs were noted for other outcomes, they were accounted for in meta-analyses or affected a minimal number of studies within the outcome category.
    Incorporating MCIDs affected the interpretation of almost all PROs in the systematic review. MCIDs are important measures of clinical meaningfulness for the interpretation of palliative care research involving PROs. Researchers should consider using instruments with well-established MCIDs and incorporate MCIDs, when available, in study design and interpretation.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    UNASSIGNED:比较研究和随机对照试验(RCT)通常使用P(概率)值来传达其发现的统计学意义。P值是一个不完美的度量,然而,并且容易受到少数结果逆转的影响,以改变统计意义。包含脆弱性指数(FI)和脆弱性商(FQ)可能有助于解释研究的统计强度。
    UNASSIGNED:这项研究的目的是检查比较单排至双排肩袖修复的研究的统计稳定性。据推测,这些研究的结果容易受到少数结果事件逆转的影响,通常少于失去随访的患者数量。
    未经评估:系统评价;证据水平,3.
    UNASSIGNED:我们分析了2000年至2021年在10种主要骨科期刊上发表的关于主要单排和双排肩袖修复的比较研究和随机对照研究。统计学显著性定义为P<0.05。每个结果的FI由改变显著性所必需的事件逆转的数量确定。通过将FI除以相应的样品大小来计算FQ。
    未经评估:在筛选的4896项研究中,22项比较研究,其中10个是RCT,最终被纳入分析。共检查了74个结果。总的来说,中位数FI为2(四分位距[IQR],1-3),FQ中位数为0.035(IQR,0.020-0.057)。平均FI为2.55±1.29,平均FQ为0.043±0.027。在64%的结果中,FI低于失去随访的患者数量.)此外,81%的重要结果只需要一个单一的结果逆转就失去了意义。
    UNASSIGNED:目前用于指导临床实践的研究中,有超过一半的患者失访率高于他们的FI。这些研究的结果应该在这些限制的背景下进行解释。未来的分析可能会受益于将FI和FQ纳入其统计分析。
    UNASSIGNED: Comparative studies and randomized controlled trials (RCTs) often use the P (probability) value to convey the statistical significance of their findings. P values are an imperfect measure, however, and are vulnerable to a small number of outcome reversals to alter statistical significance. The inclusion of a fragility index (FI) and fragility quotient (FQ) may aid in the interpretation of a study\'s statistical strength.
    UNASSIGNED: The purpose of this study was to examine the statistical stability of studies comparing single-row to double-row rotator cuff repair. It was hypothesized that the findings of these studies would be vulnerable to a small number of outcome event reversals, often fewer than the number of patients lost to follow-up.
    UNASSIGNED: Systematic review; Level of evidence, 3.
    UNASSIGNED: We analyzed comparative studies and RCTs on primary single-row versus double-row rotator cuff repair that were published between 2000 and 2021 in 10 leading orthopaedic journals. Statistical significance was defined as a P < .05. The FI for each outcome was determined by the number of event reversals necessary to alter significance. The FQ was calculated by dividing the FI by the respective sample size.
    UNASSIGNED: Of 4896 studies screened, 22 comparative studies, 10 of which were RCTs, were ultimately included for analysis. A total of 74 outcomes were examined. Overall, the median FI was 2 (interquartile range [IQR], 1-3), and the median FQ was 0.035 (IQR, 0.020-0.057). The mean FI was 2.55 ± 1.29, and the mean FQ was 0.043 ± 0.027. In 64% of outcomes, the FI was less than the number of patients lost to follow-up.) Additionally, 81% of significant outcomes needed just a single outcome reversal to lose their significance.
    UNASSIGNED: Over half of the studies currently used to guide clinical practice have a number of patients lost to follow-up greater than their FI. The results of these studies should be interpreted within the context of these limitations. Future analyses may benefit from the inclusion of the FI and the FQ in their statistical analyses.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    BACKGROUND: The statistical significance of a given study outcome can be liable to small changes in findings. P values are common, but imperfect statistical methods to convey significance, and inclusion of the fragility index (FI) and fragility quotient (FQ) may provide a clearer perception of statistical strength.
    OBJECTIVE: The purpose was to examine the statistical stability of studies comparing primary single-bundle to double-bundle anterior cruciate ligament reconstruction (ACLR) utilizing autograft and independent tunnel drilling. It was hypothesized that the study findings would be vulnerable to a small number of outcome event reversals, often less than the number of patients lost to follow-up.
    METHODS: Systematic review; Level of evidence, 2.
    METHODS: Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, the authors searched PubMed for comparative studies and randomized controlled trials (RCTs) published in select journals, based on impact factor, between 2005 and 2020. Risk-of-bias assessment and methodology scoring were conducted for the included studies. A total of 48 dichotomous outcome measures were examined for possible event reversals. The FI for each outcome was determined by the number of event reversals necessary to alter significance. The FQ was calculated by dividing the FI by the respective sample size.
    RESULTS: Of the 1794 studies screened, 15 comparative studies were included for analysis; 13 studies were RCTs. Overall, the mean FI and FQ were 3.14 (IQR, 2-4) and 0.050 (IQR, 0.032-0.062), respectively. For 72.9% of outcomes, the FI was less than the number of patients lost to follow-up.
    CONCLUSIONS: Studies comparing single-bundle versus double-bundle ACLR may not be as statistically stable as previously thought. Comparative studies and RCTs are at substantial risk for statistical fragility, with few event reversals required to alter significance. The reversal of fewer than 4 outcome events in a treatment group can alter the statistical significance of a given result; this is commonly less than the number of patients lost to follow-up. Future comparative study analyses might consider including FI and FQ with P values in their statistical analysis.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    UNASSIGNED: The Fragility Index (FI) and Reverse Fragility Index are powerful tools to supplement the P value in evaluation of randomized clinical trial (RCT) outcomes. These metrics are defined as the number of patients needed to change the significance level of an outcome. The purpose of this study was to calculate these metrics for published RCTs in total joint arthroplasty (TJA).
    UNASSIGNED: We performed a systematic review of RCTs in TJA over the last decade. For each study, we calculated the FI (for statistically significant outcomes) or Reverse Fragility Index (for nonstatistically significant outcomes) for all dichotomous, categorical outcomes. We also used the Pearson correlation coefficient to evaluate publication-level variables.
    UNASSIGNED: We included 104 studies with 473 outcomes; 92 were significant, and 381 were nonstatistically significant. The median FI was 6 overall and 4 and 7 for significant and nonsignificant outcomes, respectively. There was a positive correlation between FI and sample size (R = 0.14, P = .002) and between FI and P values (R = 0.197, P = .000012).
    UNASSIGNED: This study is the largest evaluation of FI in orthopedics literature to date. We found a median FI that was comparable to or higher than FIs calculated in other orthopedic subspecialties. Although the mean and median FIs were greater than the 2 recommended by the American Academy of Orthopaedic Surgeons Clinical Practice Guidelines to demonstrate strong evidence, a large percentage of studies have an FI < 2. This suggests that the TJA literature is on par or slightly better than other subspecialties, but improvements must be made.
    UNASSIGNED: Level I; Systematic Review.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    这项研究的目的是利用脆弱性分析来评估随机对照试验(RCT)的稳健性,该试验评估了膝关节软骨缺损的治疗方法。我们假设软骨修复文献将是脆弱的,只有少数结果事件需要改变统计学意义。
    纳入了2000年至2020年在PubMed上索引的11种骨科期刊的RCT,这些期刊报告了与膝关节软骨缺损的管理有关的二分结果测量。每个结果的脆弱性指数(FI)通过单个结果事件的迭代逆转来计算,直到显著性被逆转。通过将每个FI除以研究样本量来计算脆性商(FQ)。进行额外的统计分析以提供各个亚组的中值FI和FQ。
    19个包含60个二分结果的RCT被纳入分析。所有结局的FI和FQ分别为4(IQR2-7)和0.067(IQR0.034-0.096),分别。失去随访(LTF)的患者平均人数为3.9名患者,其中15.8%的纳入研究报告LTF大于或等于4,所有纳入结局的FI。
    评估膝关节软骨缺损的骨科文献是脆弱的,因为相对较少的结果事件的逆转可能会改变统计学结果的显著性。因此,我们建议对P值进行全面的脆弱性分析和三重报告,FI,和FQ,以帮助对软骨修复文献中报道的临床发现进行解释和情境化。
    The purpose of this study was to utilize fragility analysis to assess the robustness of randomized controlled trials (RCTs) evaluating the management of articular cartilage defects of the knee. We hypothesize that the cartilage restorative literature will be fragile with the reversal of only a few outcome events required to change statistical significance.
    RCTs from 11 orthopedic journals indexed on PubMed from 2000 to 2020 reporting dichotomous outcome measures relating to the management of articular cartilage defects of the knee were included. The Fragility Index (FI) for each outcome was calculated through the iterative reversal of a single outcome event until significance was reversed. The Fragility Quotient (FQ) was calculated by dividing each FI by study sample size. Additional statistical analysis was performed to provide median FI and FQ across subgroups.
    Nineteen RCTs containing 60 dichotomous outcomes were included for analysis. The FI and FQ of all outcomes was 4 (IQR 2-7) and 0.067 (IQR 0.034-0.096), respectively. The average number of patients lost to follow-up (LTF) was 3.9 patients with 15.8% of the included studies reporting LTF greater than or equal to 4, the FI of all included outcomes.
    The orthopedic literature evaluating articular cartilage defects of the knee is fragile as the reversal of relatively few outcome events may alter the significance of statistical findings. We therefore recommend comprehensive fragility analysis and triple reporting of the P value, FI, and FQ to aid in the interpretation and contextualization of clinical findings reported in the cartilage restoration literature.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    The practice of evidence-based medicine relies on objective data to guide clinical decision-making with specific statistical thresholds conveying study significance.
    To determine the utility of applying the fragility index (FI) and the fragility quotient (FQ) analysis to randomized controlled trials (RCTs) evaluating the utilization of platelet-rich plasma (PRP) in rotator cuff repairs (RCRs).
    Systematic review and meta-analysis.
    RCTs pertaining to the utilization of PRP in surgical RCRs published in 13 peer-reviewed journals from 2000 to 2020 were evaluated. The FI was determined by manipulating each reported outcome event until a reversal of significance was appreciated. The associated FQ was determined by dividing the FI by the sample size.
    Of the 9746 studies screened, 19 RCTs were ultimately included for analysis. The overall FI incorporating all 19 RCTs was only 4, suggesting that the reversal of only 4 events is required to change study significance. The associated FQ was determined as 0.092. Of the 43 outcome events reporting lost to follow-up data, 13 (30.2%) represented lost to follow-up >4.
    Our analysis suggests that RCTs evaluating PRP for surgical RCRs may lack statistical stability with only a few outcome events required to alter trial significance. Therefore, we recommend the reporting of an FI and an FQ in conjunction with P value analysis to carefully interpret the integrity of statistical stability in future comparative trials.
    Clinical decisions are often informed by statistically significant results. Thus, a true understanding of the robustness of the statistical findings informing clinical decision-making is of critical importance.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Journal Article
    Evidence-based medicine utilizes data to inform clinical decision making, despite the ability of a small number of outcome reversals to change statistical significance. P values are common measurements of statistical significance that possess inherent flaws. The inclusion of the fragility index (FI) and fragility quotient (FQ) may provide a clearer conveyance of statistical strength.
    The purpose was to examine the statistical stability of studies comparing hamstring tendon and bone-patellar tendon-bone autografts in primary single-bundle anterior cruciate ligament reconstruction with independent tunnel drilling. We hypothesized that the findings of these studies are vulnerable to a small number of outcome event reversals, often fewer than the number of patients lost to follow-up.
    Systematic review.
    Comparative studies and randomized controlled trials (RCTs) published in 10 leading orthopaedic journals between 2000 and 2020 were analyzed. Statistical significance was defined as a P value ≤.05. FI for each outcome was determined by the number of event reversals necessary to alter significance. FQ was calculated by dividing the FI by the respective sample size.
    Of the 1803 studies screened, 643 met initial search criteria, with 18 comparative studies ultimately included for analysis, 8 of which were RCTs. A total of 114 outcomes were examined. Overall, the mean (interquartile range) FI and FQ were 3.77 (2-4) and 0.040 (0.016-0.055), respectively. The FI was less than the number of patients lost to follow-up for 76.3% of outcomes.
    Studies examining graft choice for anterior cruciate ligament reconstruction may not be as statistically stable as previously thought. Comparative studies and RCTs are at substantial risk for statistical fragility, with few event reversals required to alter significance. The reversal of <4 outcome events in a treatment group can alter the statistical significance of a given result; this is commonly fewer than the number of patients lost to follow-up. Future comparative study analyses might consider including FI and FQ with P values in their statistical analysis.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号