Inter-observer

观察者间
  • DOI:
    文章类型: Journal Article
    这项工作的目的是评估轮廓前庭神经鞘瘤(VS)和危险器官(OAR)的观察者之间和观察者之间的变化,及其在体积调制电弧治疗(VMAT)中的剂量学影响。4名临床医生对3例VS典型病例进行了轮廓分析。VS的协议量指数(AVI)似乎明显高于OAR,这样VS的剂量覆盖是相当稳健的。在OAR中,最大的变化是脑干dmax+1.02Gy,耳蜗dmean+0.78Gy,三叉神经dmax+1.05Gy。因此,决定所有立体定向放射外科(SRS)的VS轮廓,以及所有基于帧的SRS轮廓,应该总是由第二个医生检查。此外,还通过了在每日同行评审会议上对VS案例的回顾性介绍,以确保共识不断更新,以及培训目的。
    The aim of this work was to evaluate the inter- and intra-observer variation in contouring vestibular schwannoma (VS) and the organs-at-risk (OAR), and its dosimetric impact in Volumetric Modulated Arc Therapy (VMAT). Three VS typical cases were contoured by four clinicians. The Agreement Volume Index (AVI) appeared to be notably higher in VS than in OARs, such that the dose coverage of VS is fairly robust. In OARs, the largest variation was +1.02Gy in dmax for the brainstem, +0.78Gy in dmean for the cochlea and +1.05Gy in dmax of the trigeminal nerve. Accordingly, it was decided that all VS delineations for stereotactic radiosurgery (SRS), and all frame-based SRS contouring in general, should always be reviewed by a second physician. In addition, the retrospective presentation of VS cases at daily peer review meetings has also been adopted to ensure that the consensus is constantly updated, as well as for training purposes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    在大流行的早期阶段,胸部计算机断层扫描(CT),以及血清学和临床数据,经常用于诊断COVID-19,特别是在面临PCR试剂盒短缺等挑战的地区。在这种情况下,CT扫描在诊断COVID-19和指导患者管理中起着至关重要的作用。建立了COVID-19报告和数据系统(CO-RADS),作为COVID-19肺炎病例的标准化报告系统。它的实施需要观察员之间达成高度一致,以防止任何潜在的混乱。这项研究旨在评估来自不同专业的医生在对确诊的COVID-19患者的CT胸部CO-RADS评分中,具有不同经验水平的观察者之间的共识。并评估将此报告系统应用于经验不足的人的可行性。回顾性分析了7名观察者对COVID-19RT-PCR检测阳性的患者的胸部CT图像。观察员根据他们的专业类型分为三组(三名放射科医生,三名内务人员,和一名肺科医师)。观察者评估每个图像并将患者分为五个CO-RADS组。共有630名参与者参加了这项研究。在放射科医生中,观察者之间的协议几乎是完美的,在肺科医生和内务人员中,在放射科医生中中等到实质性,肺科医生,和房屋官员。在具有不同经验水平的观察员之间使用CO-RADS进行报告时,观察员之间达成了实质性到几乎完美的协议。尽管放射科医师之间的观察者间差异很大,与肺科医生和内务人员相比,它有所下降。放射科医生,房屋官员,肺科医师应用CO-RADS可以准确,及时地识别COVID-19肺部受累的典型CT影像学特征。
    During the early stages of the pandemic, computed tomography (CT) of the chest, along with serological and clinical data, was frequently utilized in diagnosing COVID-19, particularly in regions facing challenges such as shortages of PCR kits. In these circumstances, CT scans played a crucial role in diagnosing COVID-19 and guiding patient management. The COVID-19 Reporting and Data System (CO-RADS) was established as a standardized reporting system for cases of COVID-19 pneumonia. Its implementation necessitates a high level of agreement among observers to prevent any potential confusion. This study aimed to assess the inter-observer agreement between physicians from different specialties with variable levels of experience in their CO-RADS scoring of CT chests for confirmed COVID-19 patients, and to assess the feasibility of applying this reporting system to those having little experience with it. All chest CT images of patients with positive RT-PCR tests for COVID-19 were retrospectively reviewed by seven observers. The observers were divided into three groups according to their type of specialty (three radiologists, three house officers, and one pulmonologist). The observers assessed each image and categorized the patients into five CO-RADS groups. A total of 630 participants were included in this study. The inter-observer agreement was almost perfect among the radiologists, substantial among a pulmonologist and the house officers, and moderate-to-substantial among the radiologists, the pulmonologist, and the house officers. There was substantial to almost perfect inter-observer agreement when reporting using the CO-RADS among observers with different experience levels. Although the inter-observer variability among the radiologists was high, it decreased compared to the pulmonologist and house officers. Radiologists, house officers, and pulmonologists applying the CO-RADS can accurately and promptly identify typical CT imaging features of lung involvement in COVID-19.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Multicenter Study
    目的:胶质母细胞瘤的O-(2-[18F]-氟乙基)-L-酪氨酸(FET)PET试验是澳大利亚前瞻性的,多中心研究评估FETPET用于胶质母细胞瘤患者管理。FETPET成像时间点是放化疗前(FET1),放化疗后1个月(FET2),和可疑进展(FET3)。在招募参与者之前,现场核医学医师(NMP)接受了FETPET轮廓和图像解释的认证。
    方法:在基准病例(n=6)评估生物肿瘤体积(BTV)轮廓(3×FET1)和图像解释(3×FET3)上,需要通过≥2NMPs来完成轮廓和动态分析。专家审查了数据,并指出了违规行为。BTV定义包括肿瘤背景比(TBR)阈值为1.6,在对侧正常脑中具有新月形背景轮廓。复发/假性进展解释(FET3)需要评估最大TBR(TBRmax),动态分析(时间活动曲线[TAC]型,到达峰值的时间),和定性评估。组内相关系数(ICC)评估体积协议,变异系数(CoV)比较不同病例的最大/平均TBR(TBRmax/TBRmean),和成对分析评估空间(骰子相似系数[DSC])和边界一致性(豪斯多夫距离[HD],平均绝对表面距离[MASD])。
    结果:数据来自21个NMP(10个中心,各n≥2个),20个接受了审查。最初的通过率为93/119(78.2%),并且完成了27/30要求的重新提交。在FET1的25/72(34.7%;13/12次/大)和FET3的22/74(29.7%;14/8次/大)报告中发现了违规行为。重新提交的主要原因如下:BTV过度轮廓(15/30,50.0%),背景放置(8/30,26.7%),TAC分类(9/30,30.0%),和图像解释(7/30,23.3%)。BTV的CoV中位数和范围,TBRmax,TBRmean为21.53%(12.00-30.10%),5.89%(5.01-6.68%),和5.01%(3.37-6.34%),分别。BTV一致性中等至优秀(ICC=0.82;95%CI,0.63-0.97),具有良好的空间(DSC=0.84±0.09)和边界(HD=15.78±8.30mm;MASD=1.47±1.36mm)一致性。
    结论:FIG研究认证计划增加了研究地点的专业知识。TBRmax和TBRmean是稳健的,观察到的BTV描绘和图像解释具有相当大的可变性。
    The O-(2-[18F]-fluoroethyl)-L-tyrosine (FET) PET in Glioblastoma (FIG) trial is an Australian prospective, multi-centre study evaluating FET PET for glioblastoma patient management. FET PET imaging timepoints are pre-chemoradiotherapy (FET1), 1-month post-chemoradiotherapy (FET2), and at suspected progression (FET3). Before participant recruitment, site nuclear medicine physicians (NMPs) underwent credentialing of FET PET delineation and image interpretation.
    Sites were required to complete contouring and dynamic analysis by ≥ 2 NMPs on benchmarking cases (n = 6) assessing biological tumour volume (BTV) delineation (3 × FET1) and image interpretation (3 × FET3). Data was reviewed by experts and violations noted. BTV definition includes tumour-to-background ratio (TBR) threshold of 1.6 with crescent-shaped background contour in the contralateral normal brain. Recurrence/pseudoprogression interpretation (FET3) required assessment of maximum TBR (TBRmax), dynamic analysis (time activity curve [TAC] type, time to peak), and qualitative assessment. Intraclass correlation coefficient (ICC) assessed volume agreement, coefficient of variation (CoV) compared maximum/mean TBR (TBRmax/TBRmean) across cases, and pairwise analysis assessed spatial (Dice similarity coefficient [DSC]) and boundary agreement (Hausdorff distance [HD], mean absolute surface distance [MASD]).
    Data was accrued from 21 NMPs (10 centres, n ≥ 2 each) and 20 underwent review. The initial pass rate was 93/119 (78.2%) and 27/30 requested resubmissions were completed. Violations were found in 25/72 (34.7%; 13/12 minor/major) of FET1 and 22/74 (29.7%; 14/8 minor/major) of FET3 reports. The primary reasons for resubmission were as follows: BTV over-contour (15/30, 50.0%), background placement (8/30, 26.7%), TAC classification (9/30, 30.0%), and image interpretation (7/30, 23.3%). CoV median and range for BTV, TBRmax, and TBRmean were 21.53% (12.00-30.10%), 5.89% (5.01-6.68%), and 5.01% (3.37-6.34%), respectively. BTV agreement was moderate to excellent (ICC = 0.82; 95% CI, 0.63-0.97) with good spatial (DSC = 0.84 ± 0.09) and boundary (HD = 15.78 ± 8.30 mm; MASD = 1.47 ± 1.36 mm) agreement.
    The FIG study credentialing program has increased expertise across study sites. TBRmax and TBRmean were robust, with considerable variability in BTV delineation and image interpretation observed.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:为了在临床实践中实施新的标记,可靠性评估,验证,必须应用标准化利用。这项研究通过比较观察者的估计,通过常规显微镜评估了肿瘤浸润淋巴细胞(TIL)和肿瘤基质比(TSR)评估的可靠性。
    方法:肿瘤内和肿瘤前间质TILs,和TSR,由三名病理学家使用86张CRCHE载玻片进行评估。TSR和TIL使用一种和四种不同的拟议截止系统进行了分类,分别,使用组内系数(ICC)和科恩的卡帕统计数据评估一致性。使用Fleisskappa统计量和一致率对协议进行成对评估,并通过Bland-Altman地块进行可视化。为了研究生物标志物和患者数据之间的关联,采用Pearson相关分析。
    结果:对于肿瘤内基质TILs的评估,ICC为0.505(95%CI:0.35-0.64),kappa值在0.21至0.38的范围内,一致率在0.61至0.72的范围内。对于肿瘤前TILs的评估,ICC为0.52(95%CI:0.32-0.67),总体kappa值范围为0.24~0.30,一致率范围为0.66~0.72.为了估计TSR,ICC为0.48(95%CI:0.35-0.60),kappa值为0.49,一致率为0.76。我们观察到肿瘤分级与TSR中位数之间存在显着相关性(0.29(95%CI:0.032-0.51),p值=0.03)。
    结论:病理学家在评估这些标志物时的一致性对应于差到中等的一致性;在日常实践中实施免疫评分需要更多的观察者间协议。
    BACKGROUND: To implement the new marker in clinical practice, reliability assessment, validation, and standardization of utilization must be applied. This study evaluated the reliability of tumor-infiltrating lymphocytes (TILs) and tumor-stroma ratio (TSR) assessment through conventional microscopy by comparing observers\' estimations.
    METHODS: Intratumoral and tumor-front stromal TILs, and TSR, were assessed by three pathologists using 86 CRC HE slides. TSR and TILs were categorized using one and four different proposed cutoff systems, respectively, and agreement was assessed using the intraclass coefficient (ICC) and Cohen\'s kappa statistics. Pairwise evaluation of agreement was performed using the Fleiss kappa statistic and the concordance rate and it was visualized by Bland-Altman plots. To investigate the association between biomarkers and patient data, Pearson\'s correlation analysis was applied.
    RESULTS: For the evaluation of intratumoral stromal TILs, ICC of 0.505 (95% CI: 0.35-0.64) was obtained, kappa values were in the range of 0.21 to 0.38, and concordance rates in the range of 0.61 to 0.72. For the evaluation of tumor-front TILs, ICC was 0.52 (95% CI: 0.32-0.67), the overall kappa value ranged from 0.24 to 0.30, and the concordance rate ranged from 0.66 to 0.72. For estimating the TSR, the ICC was 0.48 (95% CI: 0.35-0.60), the kappa value was 0.49 and the concordance rate was 0.76. We observed a significant correlation between tumor grade and the median of TSR (0.29 (95% CI: 0.032-0.51), p-value = 0.03).
    CONCLUSIONS: The agreement between pathologists in estimating these markers corresponds to poor-to-moderate agreement; implementing immune scores in daily practice requires more concentration in inter-observer agreements.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    放射组学图像分析有可能发现疾病特征,以开发预测性特征和个性化放射治疗。已知观察者间和软件间描述变量对影像组学特征有下游影响,降低了分析的可靠性。这项研究的目的是研究这些变化对临床前锥形束计算机断层扫描(CBCT)扫描的影像组学输出的影响。使用小鼠肺的手动和半自动轮廓评估观察者间的变异性(n=16)。在两个工具(3DSlicer和ITK-SNAP)之间确定软件间可变性。使用Dice相似性系数(DSC)得分和Hausdorff距离(HD95p)度量的第95百分位数比较轮廓。使用组内相关系数(ICC)及其95%置信区间定义了影像组学输出的良好可靠性。DSC评分中位数较高(0.82-0.94),所有比较的HD95p指标都在亚毫米范围内。形状和NGTDM特征受到的影响最大。手动轮廓具有最可靠的功能(73%),其次是半自动(66%)和软件间(51%)变化。从总共842个功能中,314个健壮特征在所有轮廓方法中重叠。此外,我们的结果与临床观察者间研究确定的特征有70%的重叠.
    Radiomics image analysis has the potential to uncover disease characteristics for the development of predictive signatures and personalised radiotherapy treatment. Inter-observer and inter-software delineation variabilities are known to have downstream effects on radiomics features, reducing the reliability of the analysis. The purpose of this study was to investigate the impact of these variabilities on radiomics outputs from preclinical cone-beam computed tomography (CBCT) scans. Inter-observer variabilities were assessed using manual and semi-automated contours of mouse lungs (n = 16). Inter-software variabilities were determined between two tools (3D Slicer and ITK-SNAP). The contours were compared using Dice similarity coefficient (DSC) scores and the 95th percentile of the Hausdorff distance (HD95p) metrics. The good reliability of the radiomics outputs was defined using intraclass correlation coefficients (ICC) and their 95% confidence intervals. The median DSC scores were high (0.82-0.94), and the HD95p metrics were within the submillimetre range for all comparisons. the shape and NGTDM features were impacted the most. Manual contours had the most reliable features (73%), followed by semi-automated (66%) and inter-software (51%) variabilities. From a total of 842 features, 314 robust features overlapped across all contouring methodologies. In addition, our results have a 70% overlap with features identified from clinical inter-observer studies.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:唾液腺肿瘤(SGT)是由主要和次要腺体引起的一组不同的肿瘤。口腔是次要SGT(IMSGT)最常见的部位,由于重叠的组织病理学特征和有限的分析材料,这些病变经常对病理学家构成挑战。我们的目标是确定与IMSGT诊断和病理学家同意的挑战相关的特定临床和组织病理学特征。
    方法:我们对2010年至2019年收到的248例IMSGT进行了回顾性分析。我们通过分层评估病例的诊断挑战,根据是否确定,青睐,或提供了不确定的(挑战性的)诊断。评估了观察者之间的一致性以及活检诊断与肿瘤切除后最终诊断的一致性。
    结果:在248例活检中,191有明确的诊断,38个有利的诊断,19个是不确定的。不确定类别的主要诊断为多形性腺瘤/肌上皮瘤(PA),多形性腺癌(PAC),腺样囊性癌(AdCC),和低度腺癌。使用临床特征的多变量分析,患者年龄较小,较小的肿瘤大小,较大的活检大小增加了明确诊断的可能性(p=0.014,p=0.037,p=0.012).68例代表性病例的观察者间共识总体中等(FleissKappa0.575),对于40例确诊病例(FleissKappa0.66)良好。65例活检诊断与相应的肿瘤切除诊断相匹配,并显示出良好的一致性(CramerV检验0.76)。不一致的诊断主要涉及PA,癌EXPA,PAC,AdCC,和腺癌NOS。
    结论:IMSGT切开活检的诊断挑战很少见,特别是如果咨询了多个病理学家。PA,PAC,AdCC,和腺癌NOS是更常见的诊断挑战的组织学类型。患者年龄较小,较小的肿瘤大小,和更大的活检与明确的诊断有关。该数据突出了在IMSGT中适当采样的重要性。
    BACKGROUND: Salivary gland tumors (SGT) are a diverse group of neoplasms arising from the major and minor glands. The oral cavity is the most common site for minor SGT (IMSGT), and these lesions frequently pose a challenge to the pathologist due to overlapping histopathological features and limited material for analysis. Our objective was to determine specific clinical and histopathological features associated with challenges in IMSGT diagnoses and pathologists\' agreement.
    METHODS: We conducted a retrospective analysis of 248 IMSGT received between 2010 and 2019. We evaluated the diagnostic challenge of the cases by stratifying according to whether a definitive, favored, or indeterminate (challenging) diagnosis was provided. Inter-observer agreement and concordance of biopsy diagnoses with the final diagnoses after tumor resection were evaluated.
    RESULTS: Of the 248 biopsies, 191 had a definitive diagnosis, 38 favored diagnoses, and 19 were indeterminate. The predominant diagnoses considered for the indeterminate category were pleomorphic adenoma/myoepithelioma (PA), polymorphous adenocarcinoma (PAC), adenoid cystic carcinoma (AdCC), and low-grade adenocarcinoma. Using multivariate analysis of clinical features, younger patient age, smaller tumor size, and larger biopsy size increased the likelihood of a definitive diagnosis (p = 0.014, p = 0.037, p = 0.012). The inter-observer agreement for 68 representative cases was moderate overall (Fleiss\'s Kappa 0.575) and good for the 40 cases with a definitive diagnosis (Fleiss\'s Kappa 0.66). Sixty-five biopsy diagnoses were matched with corresponding tumor resection diagnoses and found to show a good concordance (Cramer\'s V test 0.76). The discordant diagnoses predominantly involved PA, carcinoma exPA, PAC, AdCC, and adenocarcinoma NOS.
    CONCLUSIONS: Diagnostic challenges in IMSGT incisional biopsies were infrequent, especially if multiple pathologists were consulted. PA, PAC, AdCC, and adenocarcinoma NOS were the histologic types more commonly posing diagnostic challenges. Younger patient age, smaller tumor size, and larger biopsy are associated with a definitive diagnosis. This data highlights the importance of appropriate sampling in IMSGT.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    OBJECTIVE: Inter-modality image registration between computed tomography (CT) and magnetic resonance (MR) images is associated with systematic uncertainties and the magnitude of these uncertainties is not well documented. The purpose of this study was to investigate the potential uncertainty of gold fiducial marker (GFM) registration for localized prostate cancer and to estimate the inter-observer bias in a clinical setting.
    METHODS: Four experienced observers registered CT and MR images for 42 prostate cancer patients. Manual GFM identification was followed by a landmark-based registration. The absolute difference between observers in GFM identification and the displacement of the clinical target volume (CTV) was investigated. The CTV center of mass (CoM) vector displacements, DICE-index and Hausdorff distances for the observer registrations were compared against a clinical baseline registration. The time allocated for the manual registrations was compared.
    RESULTS: Absolute difference in GFM identification between observers ranged from 0.0 to 3.0 mm. The maximum CTV CoM displacement from the clinical baseline was 3.1 mm. Displacements larger than or equal to 1 mm, 2 mm and 3 mm were 46%, 18% and 4%, respectively. No statistically significant difference was detected between observers in terms of CTV displacement. Median DICE-index and Hausdorff distance for the CTV, with their respective ranges were 0.94 [0.70-1.00] and 2.5 mm [0.7-8.7].
    CONCLUSIONS: Registration of CT and MR images using GFMs for localized prostate cancer patients was subject to inter-observer bias on an individual patient level. A CTV displacement as large as 3 mm occurred for individual patients. These results show that GFM registration in a clinical setting is associated with uncertainties, which motivates the removal of inter-modality registrations in the radiotherapy workflow and a transition to an MRI-only workflow for localized prostate cancer.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Letter
    暂无摘要。
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Journal Article
    口腔扁平苔藓(OLP)和口腔苔藓样病变(OLL)均可表现为组织学发育不良。尽管存在WHO定义的上皮发育不良评估标准,它的评估通常是主观的(观察者间的可变性)。在存在苔藓样炎症的情况下,发育异常评估中缺乏可重复性甚至更加复杂。为了研究观察者之间和观察者之间的差异,我们评估了112例伴有苔藓样炎症的口腔活检组织中的发育不良。
    Oral lichen planus (OLP) and oral lichenoid lesions (OLL) can both present with histological dysplasia. Despite the presence of WHO-defined criteria for the evaluation of epithelial dysplasia, its assessment is frequently subjective (inter-observer variability). The lack of reproducibility in the evaluation of dysplasia is even more complex in the presence of a lichenoid inflammation. We evaluated dysplasia in 112 oral biopsies with lichenoid inflammation in order to study the inter-observer and the intra-observer variability.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    BACKGROUND: Computed tomography (CT) gives an idea about the prognosis in patients with COVID-19 lung infiltration.
    OBJECTIVE: To evaluate the success rates of various scoring methods utilized in order to predict survival periods, on the basis of the imaging findings of COVID-19. Another purpose, on the other hand, was to evaluate the agreements among the evaluating radiologists.
    METHODS: A total of 100 cases of known COVID-19 pneumonia, of which 50 were deceased and 50 were living, were included in the study. Pre-existing scoring systems, which were the Total Severity Score (TSS), Chest Computed Tomography Severity Score (CT-SS), and Total CT Score, were utilized, together with the Early Decision Severity Score (ED-SS), which was developed by our team, to evaluate the initial lung CT scans of the patients obtained at their initial admission to the hospital. The scans were evaluated retrospectively by two radiologists. Area under the curve (AUC) values were acquired for each scoring system, according to their performances in predicting survival times.
    RESULTS: The mean age of the patients was 61 ± 14.85 years (age range = 18-87 years). There was no difference in co-morbidities between the living and deceased patients. The survival predicted AUC values of ED-SS, CT-SS, TSS, and Total CT Score systems were 0.876, 0.823, 0.753, and 0.744, respectively.
    CONCLUSIONS: Algorithms based on lung infiltration patterns of COVID-19 may be utilized for both survival prediction and therapy planning.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号