OBJECTIVE: In this systematic review, we evaluate the effect of radiographs and 2D and 3D imaging techniques on the interobserver agreement of six commonly used classification systems for tibial plateau fractures.
METHODS: In accordance with PRISMA guidelines, PubMed, Cochrane, Embase and Web of Science were searched for studies regarding the effect of 2D and 3D imaging techniques on the interobserver agreement of tibial plateau classification systems. Studies validating new classification systems, not providing own data or only providing information on the interobserver agreement for radiographs were excluded. Studies were scored based on the ROBINS-I risk of bias tool.
RESULTS: Our review analysed 14 studies on different classification systems used for tibial plateau fractures in clinical practice, with the Schatzker classification being the most commonly used classification system. The results showed that the addition of 2D CT led to a significant improvement of interobserver agreement for one study. However, other included studies showed varying levels of interobserver agreement, ranging from fair to substantial according to the interpretation by Landis and Koch. The addition of 3D CT resulted in a significant deterioration in one study for the Schatzker classification. Similar to the addition of 2D CT, the interobserver agreement for the Schatzker classification with the addition of 3D CT were heterogeneous ranging from fair to almost perfect according to the interpretation by Landis and Koch.
CONCLUSIONS: The use of 2D CT can be recommended for classifying tibial plateau fractures with the Schatzker classification, AO/OTA classification and Hohl classification. The value of 3D CT on the interobserver agreement of commonly used classification systems remains uncertain and unproven. Therefore, we do not recommend the use of 3D CT for the classification of tibial plateau fractures. Overall, the advancement of imaging techniques is not in line with the advancement in interobserver agreement on fracture classification.

OBJECTIVE: To present the latest evidence related to interobserver agreement and accuracy; evaluate the strengths, weaknesses, and implications of use; and outline opportunities for improvement and future development of the Prostate Imaging Reporting and Data System version 2.1 (PI-RADS v2.1) for detection of prostate cancer (PCa) on multiparametric magnetic resonance imaging (mpMRI).
RESULTS: Our review of currently available evidence suggests that recent improvements to the PI-RADS system with PI-RADS v2.1 slightly improved interobserver agreement, with generally high sensitivity and moderate specificity for the detection of clinically significant PCa. Recent evidence additionally demonstrates substantial improvement in diagnostic specificity with PI-RADS v2.1 compared with PI-RADS v2. However, results of studies examining the comparative performance of v2.1 are limited by small sample sizes and retrospective cohorts, potentially introducing selection bias. Some studies suggest a substantial improvement between v2.1 and v2, while others report no statistically significant difference. Additionally, in PI-RADS v2.1, the interpretation and reporting of certain findings remain subjective, particularly for category 2 lesions, and reader experience continues to vary significantly. These factors further contribute to a remaining degree of interobserver variability and findings of improved performance among more experienced readers. PI-RADS v2.1 appears to show at least minimal improvement in interobserver agreement, diagnostic performance, and both sensitivity and specificity, with greater improvements seen among more experienced readers. However, given the decrescent nature of these improvements and the limited power of all studies examined, the clinical impact of this progress may be marginal. Despite improvements in PI-RADS v2.1, practitioner experience in interpreting mpMRI of the prostate remains the most important factor in prostate cancer detection.

OBJECTIVE: Pathology reviews for upper urinary tract cancer (UTUC) remained scarce in the literature. Here, we reported the interobserver variation among the review and local pathologies of featured histologic characteristics for UTUC.
METHODS: Patients who underwent definitive surgical treatments for UTUC were retrospectively reviewed for eligibility of pathology review. In the Taiwan UTUC Collaboration cohort, 212 cases were reviewed, of which 154 cases were eligible for pathology review. Agreement between original pathology and review pathology was measured by the total percentage of agreement and by simple kappa statistics. The prognostic impact was analyzed by the Cox regression model with the estimation of hazard ratios (HR) and 95% confidence intervals.
RESULTS: There were 80 women and 74 men enrolled in this study, and the median age at treatment was 71.7 years. The agreement is moderate agreement for surgical margin status (87.7%; κ = 0.61), tumor grade (82.5%; κ = 0.43), tumor invasiveness (76.6%; κ = 0.45), lymphovascular invasion (70.8%; κ = 0.42) and T stage (67.5%; κ = 0.52). The interobserver agreements for perineural invasion and variant histology identification were slight. Kaplan-Meier analysis for disease-free survival revealed comparable results in local and review pathology for localized (Tis, Ta, T1-2) or advanced T stage (T3-4).
CONCLUSIONS: Pathology review of UTUC had minimal impact on clinical practice based on current available disease treatment guidelines. However, significant interobserver variations were observed in featured adverse histopathological characters.

BACKGROUND: Hepatocellular carcinoma is the most common primary liver malignancy. From the results of previous studies, Liver Imaging Reporting and Data System (LI-RADS) on contrast-enhanced ultrasound (CEUS) has shown satisfactory diagnostic value. However, a unified conclusion on the interobserver stability of this innovative ultrasound imaging has not been determined. The present meta-analysis examined the interobserver agreement of CEUS LI-RADS to provide some reference for subsequent related research.
OBJECTIVE: To evaluate the interobserver agreement of LI-RADS on CEUS and analyze the sources of heterogeneity between studies.
METHODS: Relevant papers on the subject of interobserver agreement on CEUS LI-RADS published before March 1, 2020 in China and other countries were analyzed. The studies were filtered, and the diagnostic criteria were evaluated. The selected references were analyzed using the \"meta\" and \"metafor\" packages of R software version 3.6.2.
RESULTS: Eight studies were ultimately included in the present analysis. Meta-analysis results revealed that the summary Kappa value of included studies was 0.76 [95% confidence interval, 0.67-0.83], which shows substantial agreement. Higgins I 2 statistics also confirmed the substantial heterogeneity (I 2 = 91.30%, 95% confidence interval, 85.3%-94.9%, P < 0.01). Meta-regression identified the variables, including the method of patient enrollment, method of consistency testing, and patient race, which explained the substantial study heterogeneity.
CONCLUSIONS: CEUS LI-RADS demonstrated overall substantial interobserver agreement, but heterogeneous results between studies were also obvious. Further clinical investigations should consider a modified recommendation about the experimental design.

The International Extranodal Lymphoma Study Group (IELSG)-37 is a prospective randomized trial assessing the role of consolidation mediastinal radiotherapy after immunochemotherapy to patients with newly diagnosed primary mediastinal large B-cell lymphoma (PMBCL). It is a positron emission tomography (PET) response-guided study where patients obtaining a complete metabolic response on an end-of-therapy PET-computed tomography (CT) scan evaluated by a central review are randomized to receive radiotherapy or no further treatment. The aims of this study were to measure agreement between reviewers reporting PET-CT scans for this trial and to determine the effect of training upon concordance rates. The review panel comprised 6 experienced nuclear physicians who read PET-CT scans using the 5-point Deauville scale. Interobserver agreement (IOA) was measured at 4 time points: after a blinded review of a \"training set\" of 20 patients with PMBCL from the previous IELSG-26 study (phase 1); after the first 10 clinical cases enrolled in the IELSG-37 (phase 2); and after 2 further groups of 50 (phase 3) and 40 clinical cases (phase 4). After feedback from the training set and the first 10 cases, a meeting was held to discuss interpretation, and a detailed set of instructions for the review procedure was agreed and acted upon. Between 2012 and 2014, the first 100 patients were reviewed. Using Deauville score 3 as the cutoff for a complete metabolic response, the overall IOA among the reviewers was good (Krippendorff α = 0.72.) The binary concordance between pairs of reviewers (Cohen κ) ranged from 0.60 to 0.78. The IOA, initially moderate, improved progressively from phase 1 to 4 (Krippendorff α from 0.53 to 0.81; Cohen κ from 0.35-0.72 to 0.77-0.87). Our experience indicates that the agreement among \"expert\" nuclear physicians reporting PMBCL, even using standardized criteria, was only moderate when the study began. However, agreement improved using a harmonization process, which included a training exercise with discussion of points leading to disagreement and compiling practical rules to sit alongside commonly adopted interpretation criteria.

OBJECTIVE: The objective of the study was to evaluate the intra- and interobserver agreement among obstetric experts in court regarding the retrospective review of abnormal fetal heart rate tracings and obstetrical management of patients with abnormal fetal heart rate during labor.
METHODS: A total of 22 French obstetric experts in court reviewed 30 cases of term deliveries of singleton pregnancies diagnosed with at least 1 hour of abnormal fetal heart rate, including 10 cases with adverse neonatal outcome. The experts reviewed all cases twice within a 3-month interval, with the first review being blinded to neonatal outcome. For each case reviewed, the experts were provided with the obstetric data and copies of the complete fetal heart rate recording and the partogram. The experts were asked to classify the abnormal fetal heart rate tracing and to express whether they agreed with the obstetrical management performed. When they disagreed, the experts were asked whether they concluded that an error had been made and whether they considered the obstetrical management as the cause of cerebral palsy in children if any.
RESULTS: Compared with blinded review, the experts were significantly more likely to agree with the obstetric management performed (P < .001) and with the mode of delivery (P < .001) when informed about the neonatal outcome and were less likely to conclude that an error had been made (P < .001) or to establish a link with potential cerebral palsy (P = .003). The experts\' intraobserver agreement for the review of abnormal fetal heart rate tracing and obstetrical management were both mediocre (kappa = 0.46-0.51 and kappa = 0.48-0.53, respectively). The interobserver agreement for the review of abnormal fetal heart rate tracing was low and was not improved by knowledge of the neonatal outcome (kappa = 0.11-0.18). The interobserver agreement for the interpretation of obstetrical management was also low (kappa = 0.08-0.19) but appeared to be improved by knowledge of the neonatal outcome (kappa = 0.15-0.32).
CONCLUSIONS: The intra- and interobserver agreement among obstetric experts in court for the review of abnormal fetal heart rate tracing and the appropriateness of obstetrical care is poor, suggesting a lack of objectivity of obstetrical expertise as currently performed in court.