Inter-observer

观察者间
  • 文章类型: Multicenter Study
    目的:胶质母细胞瘤的O-(2-[18F]-氟乙基)-L-酪氨酸(FET)PET试验是澳大利亚前瞻性的,多中心研究评估FETPET用于胶质母细胞瘤患者管理。FETPET成像时间点是放化疗前(FET1),放化疗后1个月(FET2),和可疑进展(FET3)。在招募参与者之前,现场核医学医师(NMP)接受了FETPET轮廓和图像解释的认证。
    方法:在基准病例(n=6)评估生物肿瘤体积(BTV)轮廓(3×FET1)和图像解释(3×FET3)上,需要通过≥2NMPs来完成轮廓和动态分析。专家审查了数据,并指出了违规行为。BTV定义包括肿瘤背景比(TBR)阈值为1.6,在对侧正常脑中具有新月形背景轮廓。复发/假性进展解释(FET3)需要评估最大TBR(TBRmax),动态分析(时间活动曲线[TAC]型,到达峰值的时间),和定性评估。组内相关系数(ICC)评估体积协议,变异系数(CoV)比较不同病例的最大/平均TBR(TBRmax/TBRmean),和成对分析评估空间(骰子相似系数[DSC])和边界一致性(豪斯多夫距离[HD],平均绝对表面距离[MASD])。
    结果:数据来自21个NMP(10个中心,各n≥2个),20个接受了审查。最初的通过率为93/119(78.2%),并且完成了27/30要求的重新提交。在FET1的25/72(34.7%;13/12次/大)和FET3的22/74(29.7%;14/8次/大)报告中发现了违规行为。重新提交的主要原因如下:BTV过度轮廓(15/30,50.0%),背景放置(8/30,26.7%),TAC分类(9/30,30.0%),和图像解释(7/30,23.3%)。BTV的CoV中位数和范围,TBRmax,TBRmean为21.53%(12.00-30.10%),5.89%(5.01-6.68%),和5.01%(3.37-6.34%),分别。BTV一致性中等至优秀(ICC=0.82;95%CI,0.63-0.97),具有良好的空间(DSC=0.84±0.09)和边界(HD=15.78±8.30mm;MASD=1.47±1.36mm)一致性。
    结论:FIG研究认证计划增加了研究地点的专业知识。TBRmax和TBRmean是稳健的,观察到的BTV描绘和图像解释具有相当大的可变性。
    The O-(2-[18F]-fluoroethyl)-L-tyrosine (FET) PET in Glioblastoma (FIG) trial is an Australian prospective, multi-centre study evaluating FET PET for glioblastoma patient management. FET PET imaging timepoints are pre-chemoradiotherapy (FET1), 1-month post-chemoradiotherapy (FET2), and at suspected progression (FET3). Before participant recruitment, site nuclear medicine physicians (NMPs) underwent credentialing of FET PET delineation and image interpretation.
    Sites were required to complete contouring and dynamic analysis by ≥ 2 NMPs on benchmarking cases (n = 6) assessing biological tumour volume (BTV) delineation (3 × FET1) and image interpretation (3 × FET3). Data was reviewed by experts and violations noted. BTV definition includes tumour-to-background ratio (TBR) threshold of 1.6 with crescent-shaped background contour in the contralateral normal brain. Recurrence/pseudoprogression interpretation (FET3) required assessment of maximum TBR (TBRmax), dynamic analysis (time activity curve [TAC] type, time to peak), and qualitative assessment. Intraclass correlation coefficient (ICC) assessed volume agreement, coefficient of variation (CoV) compared maximum/mean TBR (TBRmax/TBRmean) across cases, and pairwise analysis assessed spatial (Dice similarity coefficient [DSC]) and boundary agreement (Hausdorff distance [HD], mean absolute surface distance [MASD]).
    Data was accrued from 21 NMPs (10 centres, n ≥ 2 each) and 20 underwent review. The initial pass rate was 93/119 (78.2%) and 27/30 requested resubmissions were completed. Violations were found in 25/72 (34.7%; 13/12 minor/major) of FET1 and 22/74 (29.7%; 14/8 minor/major) of FET3 reports. The primary reasons for resubmission were as follows: BTV over-contour (15/30, 50.0%), background placement (8/30, 26.7%), TAC classification (9/30, 30.0%), and image interpretation (7/30, 23.3%). CoV median and range for BTV, TBRmax, and TBRmean were 21.53% (12.00-30.10%), 5.89% (5.01-6.68%), and 5.01% (3.37-6.34%), respectively. BTV agreement was moderate to excellent (ICC = 0.82; 95% CI, 0.63-0.97) with good spatial (DSC = 0.84 ± 0.09) and boundary (HD = 15.78 ± 8.30 mm; MASD = 1.47 ± 1.36 mm) agreement.
    The FIG study credentialing program has increased expertise across study sites. TBRmax and TBRmean were robust, with considerable variability in BTV delineation and image interpretation observed.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:肩锁关节分离是一种常见的肩关节损伤。当损伤在Rockwood分类中被分级为III型或更高等级时,可以提出手术治疗。然而,越来越多的从业者正转向保守治疗,因为它与更少的并发症和看似接近的功能结局相关.我们研究的目的是评估III级或更高AC关节损伤的手术和非手术患者的功能恢复。其次,在评估者内部和评估者之间评估了Rockwood分类的可靠性和相关性。
    方法:我们对2014年至2020年间接受治疗的38例患者进行了一项回顾性的双中心研究。临床评估涉及各种功能结局评分(Constant,QuickDASH,ASES,加州大学洛杉矶分校,SSV,STT)和疼痛评估(VAS)。还记录了重返运动和工作的过程。放射学评估包括受伤后立即进行的ZancaAP和腋窝侧视以及每次影像学随访直至最后一次访视。还对Rockwood分类进行了内部和内部分析。
    结果:在最终评估时,功能评分(Constant评分手术组=91,非手术组=83;p=0.09)或VAS疼痛没有显着差异。非手术治疗的患者恢复工作和运动的速度明显更快。非手术患者均未发现并发症,而9名手术患者出现并发症。Rockwood分类的评分者间可靠性较差(kappa=0.08)至一般(kappa=0.35),而评分者内部可靠性中等(kappa=0.6)至良好(kappa=0.63)。
    结论:无论采用哪种治疗方法,损伤后至少1年的功能结局和患者满意度似乎相同.因此,手术应仅适用于受伤后7天AC关节疼痛(VAS>7)且功能未改善的患者。对于年轻和运动的患者,或者只是想恢复正常功能的患者,重要的是要记住,恢复工作和运动的时间更长的手术管理,并考虑到潜在的术后并发症。虽然没有接受非手术治疗的患者需要二次稳定手术,这是一个可能的追索权。
    方法:III.
    Acromioclavicular (AC) joint separation is a common shoulder injury. When the injury is graded as type III or higher in the Rockwood classification, surgical treatment can be proposed. However, an increasing number of practitioners are shifting back to conservative treatment as it is associated with fewer complications and seemingly close functional outcomes. The aim of our study was to evaluate the functional recovery of operated and non-operated patients with grade III or higher AC joint injuries. Secondarily, the reliability and relevance of the Rockwood classification was evaluated within and between raters.
    We did a retrospective two-center study of 38 patients treated between 2014 and 2020. The clinical evaluation involved various functional outcome scores (Constant, QuickDASH, ASES, UCLA, SSV, STT) and a pain assessment (VAS). Return to sports and to work was also documented. The radiological evaluation consisted of Zanca AP and lateral axillary views immediately after the injury and at each radiographic follow-up visit until the final visit. An intra- and inter-rater analysis was also done for the Rockwood classification.
    There was no significant difference in the functional scores (Constant score surgery group=91, nonoperative group=83; p=0.09) or the pain on VAS at the final assessment. Return to work and to sports was significantly faster in patients treated non-operatively. No complication was found in the non-operated patients, while nine of the operated patients suffered a complication. The inter-rater reliability of the Rockwood classification was found to be poor (kappa=0.08) to fair (kappa=0.35), while the intra-rater reliability was moderate (kappa=0.6) to good (kappa=0.63).
    No matter which treatment is used, the functional outcomes and patient satisfaction level a minimum of 1 year after the injury appear to be identical. Thus, surgery should be only for patients whose AC joint is painful 7 days after the injury (VAS>7) and whose function has not improved. For young and athletic patients or for patients who simply want to regain nearly normal function, it is important to remember that the time to return to work and sports is longer with surgical management and to take into consideration the potential postoperative complications. While none of the patients who received the non-operative treatment required a secondary stabilizing surgery, this is a possible recourse.
    III.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    衰减成像是一种新颖的,基于超声的技术来客观地检测和量化肝脏脂肪变性。在这项研究中,我们评估了衰减成像的性能和观察者间的变异性,并将其与已知的肝脏脂肪定量方法进行了比较。肝肾指数(HRI)。两个观察者测量了衰减体模中的衰减系数(AC),20名健康志愿者和27名疑似弥漫性肝病患者进行活检。将结果与HRI和组织学发现进行比较。两个观察者都不知道活检的结果和另一个观察者的测量结果。我们的结果表明,与肝脏脂肪分数低于33%(S0/1)的患者相比,中度(S2,33-66%)和严重的肝脏脂肪浸润(S3,>66%)的患者显示出明显更高的ACs。脂肪浸润小于5%(S0)和5-32%(S1)的患者的AC值没有显着差异。在接收机工作特性(ROC)分析中,检测中度和重度脂肪变性的曲线下面积(AUC)值优异,为0.98.检测S2-的截止值为0.64dB/cm/MHz,检测S3-脂肪变性的截止值为0.68dB/cm/MHz。衰减成像的观察者之间的一致性非常好,患者的组内相关系数(ICC)为0.92,体模测量为0.96。ICC随着体模测量的深度而减小。总之,衰减成像显示观察者之间的一致性非常好,是检测和定量中度和重度肝性脂肪变性的有前途的工具。
    Attenuation imaging is a novel, ultrasound-based technique to objectively detect and quantify liver steatosis. In this study, we evaluated the performance and inter-observer variability of attenuation imaging and compared it to a known quantification method of liver fat, the hepatorenal index (HRI). Two observers measured attenuation coefficients (AC) in an attenuation phantom, 20 healthy volunteers and 27 patients scheduled for biopsy for suspected diffuse liver disease. Results were compared with the HRI and histological findings. Both observers were blinded to the results of the biopsy and the measurements of the other observer. Our results showed that patients with moderate (S2, 33-66%) and severe fatty infiltration of the liver (S3, >66%) showed significantly higher ACs in comparison to patients with a liver fat fraction of less than 33% (S0/1). There was no significant difference in AC-values of patients with fatty infiltration of less than 5% (S0) and 5-32% (S1). In the Receiver Operating Characteristic (ROC)-analysis, the area under the curve (AUC)-values for the detection of moderate and severe steatosis were excellent at 0.98. Cut-off values were 0.64 dB/cm/MHz for the detection of S2- and 0.68 dB/cm/MHz for the detection of S3-steatosis. The inter-observer agreement of attenuation imaging was very good with an intraclass correlation coefficient (ICC) of 0.92 in patient and 0.96 in phantom measurements. The ICC decreased with depth in the phantom measurements. In summary, attenuation imaging showed very good inter-observer agreement and is a promising tool for the detection and quantification of moderate and severe hepatic steatosis.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:口腔上皮异型增生(OED)的存在和分级被认为是预测口腔潜在恶性疾病恶性风险的金标准。然而,在报告OED评分的背景下,观察员之间和观察员内部的协议被认为是不可靠的。
    方法:我们对六名印度口腔病理学家进行了一项多中心研究,以评估使用世界卫生组织(WHO;2005)系统以及最近引入的二元系统报告OED的差异。使用kappa统计来评估观察者的变异性。
    结果:与二元分级系统(κ=0.1563)和WHO分级系统(κw=0.4297)相比,在按两个等级分为无和轻度发育不良与中度和重度发育不良的两个等级分组时,观察者内的加权kappa一致性得分提高(κw=0.5012)。使用WHO分级系统(κ=0.051-0.231;κw=0.145至0.361;35%至46%)和二元分级系统(κ=0.049至0.326;50至65%),在主要研究者(PI)和其他五名观察者之间观察到了较差的观察者之间的一致分数。
    结论:使用任何一种系统来帮助标准化报告,对OED的评估仍有相当大的改进空间。印度的专业病理学组织应采取措施,为从事头颈部标本常规报告的口腔和普通病理学家提供报告OED的外部质量评估。
    BACKGROUND: The presence and grading of oral epithelial dysplasia (OED) are considered the gold standard for predicting the malignant risk of oral potentially malignant disorders. However, inter-observer and intra-observer agreement in the context of reporting on OED grading has been reputedly considered unreliable.
    METHODS: We undertook a multi-centre study of six Indian oral pathologists to assess variations in reporting OED using the World Health Organization (WHO; 2005) system and also the recently introduced binary system. The observer variability was assessed with the use of kappa statistics.
    RESULTS: The weighted kappa intra-observer agreement scores improved (κw  = 0.5012) on grouping by two grades as no and mild dysplasia versus moderate and severe dysplasia compared to binary grading system (κ = 0.1563) and WHO grading system (κw  = 0.4297). Poor to fair inter-observer agreement scores were seen between the principal investigator (PI) and the other five observers using the WHO grading system (κ = 0.051-0.231; κw  = 0.145 to 0.361; 35% to 46%) and binary grading system (κ = 0.049 to 0.326; 50 to 65%).
    CONCLUSIONS: There is considerable room for improvement in the assessment of OED using either system to help in standardised reporting. The professional pathology organisations in India should take steps to provide external quality assessment in reporting OED among oral and general pathologists who are engaged in routine reporting of head and neck specimens.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号