BACKGROUND: Since the field of dermatopathology is not an exact science, it is prone to personal subjectivity, which sometimes causes disagreements on the diagnosis and assessment of some histological features. In the case of melanoma, some variables such as regression are associated with low interobserver agreement. On the contrary, other variables such as the measurement of Breslow thickness show high reproducibility.
OBJECTIVE: The main objective of our study was to investigate multiple features of 60 consecutive cases of melanoma to establish interobserver reproducibility.
RESULTS: We conducted an observational and descriptive study at Hospital de Manises, Valencia, Spain, IVO Foundation, Valencia, Spain, and Hospital 12 de Octubre, Madrid, Spain. The mean level of agreement of all study variables was moderate (Cohen\'s kappa coefficient statistic = 0.5). The highest agreement corresponded to polypoid morphology, pigmentation, ulceration, and solar elastosis. On the other hand, the lowest level agreement was reached for the presence of cellular pleomorphism and tumor necrosis.
CONCLUSIONS: Our mean level of agreement was moderate, which reflects that some of the measured characteristics such as cellular pleomorphism or the presence of necrosis cannot be used for future studies or must be redefined and their reproducibility, reestablished. When conducting a research study, it is necessary to analyze the study variables to demonstrate their validity to measure or classify a certain feature. It is also advisable to warrant that that the variables are reproducible to be able to use them for other studies or in the routine clinical practice.

Procedural fidelity refers to the degree to which procedures for an assessment or intervention (i.e., independent variables) are implemented consistent with the prescribed protocols. Procedural fidelity is an important factor in demonstrating the internal validity of an experiment and clinical treatments. Previous reviews evaluating the inclusion of procedural fidelity in published empirical articles demonstrated underreporting of procedural fidelity procedures and measures within specific journals. We conducted a systematic review of The Analysis of Verbal Behavior (TAVB) to evaluate the trends in procedural fidelity reporting from 2007 to 2021. Of the 253 articles published in TAVB during the reporting period, 144 of the articles (168 studies) met inclusionary criteria for further analysis. Our results showed that 54% of studies reported procedural fidelity data, which is slightly higher than previous reviews. In comparison, interobserver-agreement data were reported for a high percentage of studies reviewed (i.e., 93%). Further discussion of results and applied research implications are included.

BACKGROUND: Congo red staining of fat pad fine needle aspiration specimens is a method utilized for evaluation of amyloid deposition. However, these specimens can pose diagnostic challenges for cytopathologists. As part of ongoing internal quality improvement measures, the objective of this study was to evaluate the intradepartmental interobserver agreement of these specimens and to identify factors that affect the variability of the interpretations.
METHODS: There were 7 participants, which included 3 trainees, 3 cytopathologists, and 1 cytotechnologist. Each participant reviewed 50 Congo red stained fat pad fine needle aspiration slides. The interpretations were categorized into 3 groups: negative, indeterminate/suspicious, and positive. The participants also noted any interpretation challenges they encountered for each case.
RESULTS: There was only slight interobserver agreement among all participants (κ = 0.133). Stratified by participant group, the interobserver agreement among the trainees was slight bordering on poor (κ = 0.028) and among cytopathologists was fair (κ = 0.249). The highest agreement between 2 observers was between 2 cytopathologists and the level of agreement was moderate bordering on fair (κ = 0.426). There were only 3 cases (6.0%) with full agreement among observers, while in 25 cases (50.0%), there were 2 category differences in interpretations. The primary diagnostic challenge reported by participants was when weak or focal birefringence was encountered as well as cases complicated by poor stain quality and overstaining.
CONCLUSIONS: We found only slight interobserver agreement among all study participants. A major area of challenge was cases with weak birefringence resulting in high variance of interpretation among participants.

UNASSIGNED: To evaluate and compare magnetic resonance imaging (MRI) sequences that could potentially be used in the diagnosis of coronavirus disease 2019 (COVID-19).
UNASSIGNED: Included in the study were 42 patient who underwent thorax computed tomography (CT) for COVID-19 pneumonia and thorax MRI for any reason within 24 h after CT. The T2-weighted fast spin echo periodically rotated overlapping parallel lines with enhanced reconstruction (PROPELLER) (T2W-FSE-P), fast imaging employing steady-state acquisition, T2 fat-saturated FSE, axial T1 liver acquisition with volume acceleration (LAVA) and single-shot FSE images were compared in terms of their ability to show COVID-19 findings.
UNASSIGNED: The mean age of the patients was 47.2 ± 24 years. Of the patients, 22 were male (52.4%) and 20 (47.6%) were female. The interobserver intraclass coefficient (ICC) for the image quality score was the highest in the T2W-FSE-P sequence and lowest in the T1 LAVA sequence. All of the lesion-based evaluations of the interobserver agreement were statistically significant, with the kappa value varying between 0.798 and 0.998.
UNASSIGNED: All 5 sequences evaluated in the study were successful in showing the parenchymal findings of COVID-19. Since the T2W-FSE-P sequence had the best scores in both interobserver agreement and ICC for the image quality score, it was considered that it can be included in thorax MRI examinations to assist the diagnosis of COVID-19.

BACKGROUND: The scoring system for bile cytology (SSBC) aims to improve bile cytology diagnostic accuracy. Here, the practicality of SSBC was verified by multiple cytotechnologists.
METHODS: Bile cytological specimens were evaluated by 24 cytotechnologists using SSBC. The samples were assessed before using the SSBC (first-time assessment) according to three categories: benign, indeterminate, and malignant. A first scoring evaluation (FSE) was then performed using SSBC; each item in the scoring system was classified as present or absent. After distributing an instruction sheet with diagnostic criteria, a second scoring evaluation (SSE) was performed using SSBC. Each method was evaluated using diagnostic accuracy and interobserver and intraobserver agreement.
RESULTS: Several samples were assessed as indeterminate in the first-time assessment. Although the specificity of the SSE improved, the sensitivity and accuracy decreased compared with those of the FSE. The overall interobserver agreement was fair for all parameters, including abnormal chromatin, irregular internuclear distances, irregularly overlapped nuclei, irregular cluster margins, and final evaluation in the FSE and SSE. The final evaluation by histological type exhibited slight agreement for well-differentiated tubular adenocarcinoma and almost perfect agreement for poorly differentiated tubular adenocarcinoma in the FSE and SSE. For moderately differentiated tubular adenocarcinoma, agreement was moderate in the FSE and fair in the SSE. For cholangitis, a slight agreement was observed in the FSE, which improved to fair in the SSE.
CONCLUSIONS: Although the SSBC is expected to improve specificity, there exists ambiguity regarding SSBC criteria and interindividual assessment differences. Therefore, the objective assessment method should be revised.

BACKGROUND: In 2024, the World Health Organization (WHO) is scheduled to publish the WHO Reporting System for Soft Tissue Cytopathology (WHORSSTC). This system establishes categories with well-defined definitions, criteria, and estimated risks of malignancy (ROMs) for soft tissue tumors. The estimates of ROM are based on a relatively small number of published studies. Interobserver reproducibility is not addressed in the reporting system even though reproducibility of a reporting system is highly important.
METHODS: A manual search of one authors personal consultation files and teaching set (L.J.L.) was conducted for all cytologic specimens of soft tissue tumors accessioned between January 1, 1985 and December 31, 2022. Only cases with documented surgical pathology follow-up were included in the study. Slides from each case were evaluated independently by three cytopathologists with each case assigned to one of the WHORSSTC categories. A ROM for each of the WHORSSTC categories was calculated. Interobserver agreement was evaluated by the kappa and weighted kappa statistics.
RESULTS: Risk for malignancy by category were: Category 1: 0%, Category 2: 28%, Category 3: 57%, Category 4: 47%, Category 5: 63%, and Category 6: 88%. Kappa statistics for agreement between raters varied from 0.2183 to 0.3465 and weighted kappa varied from 0.3778 to 0.5217.
CONCLUSIONS: The WHORSSTC showed a progression of malignancy risk from the category \"benign\" (28%) to the category \"malignant\" (88%). Interobserver agreement was only fair.

OBJECTIVE: Few cytologically indeterminate thyroid fine-needle aspirations (FNAs) harbor BRAF V600E. Here, we assess interobserver agreement for The Bethesda System for Reporting Thyroid Cytopathology (TBSRTC) category III (atypia of undetermined significance [AUS]) FNAs harboring BRAF V600E and contrast their features with those harboring non-BRAF V600E alterations, with attention to cytopathology experience.
METHODS: Seven reviewers evaluated 5 AUS thyroid FNAs harboring BRAF V600E. To blind reviewers, cases were intermixed with 19 FNAs falling within other TBSRTC categories and in which genetic alterations other than BRAF V600E had been identified (24 FNAs total). Interobserver agreement against both \"index\" and most popular (\"mode\") diagnoses was calculated. Four additional BRAF V600E cases were independently reviewed.
RESULTS: Reviewers included 3 trainees and 3 American Board of Pathology (board)-certified cytopathologists. Board-certified cytopathologists, whose experience ranged from 2 to more than 15 subspecialty practice years, had known AUS rates. BRAF V600E was identified in 5 of 260 (2%) AUS FNAs. Interobserver agreement was higher among cytopathologists with more experience. Mode diagnosis differed from index diagnosis in 6 of 11 cases harboring RAS-like alterations; mode diagnosis was AUS in 4 of 5 BRAF V600E FNAs.
CONCLUSIONS: Atypia of undetermined significance of thyroid FNAs harboring BRAF V600E is uncommon yet relatively reproducible, particularly among pathologists with experience. It is advisable to sequence BRAF across V600 in such cases.

OBJECTIVE: In the Netherlands, antenatal cardiotocography (aCTG) to assess fetal well-being is performed in obstetrician-led care. An innovative initiative was started to evaluate whether aCTG for specific indications-reduced fetal movements, external cephalic version, or postdate pregnancy-is feasible in non-obstetrician-led care settings by independent primary care midwives. Quality assessment is essential when reorganizing and shifting tasks and responsibilities. Therefore, we aimed to assess the inter- and intraobserver agreement for aCTG assessments between and within four professional groups involved in Dutch maternity care regarding the overall classification and assessment of the various components of aCTG.
METHODS: This was a prospective study among 47 Dutch primary care midwives, hospital-based midwives, residents, and obstetricians. Ten aCTG traces were assessed twice at a 1 month interval. To ensure a representative sample, we used two different sets of 10 aCTG traces each. We calculated the degree of agreement using the proportions of agreement.
RESULTS: The proportions of agreement for interobserver agreement on the classification of aCTG between and within the four professional groups varied from 0.82 to 0.94. The proportions of agreement for each professional group were slightly higher for intraobserver (0.86-0.94) than for interobserver agreement. For the various aCTG components, the proportions of agreement for interobserver agreement varied from 0.64 (presence of contractions) to 0.98 (baseline heart frequency).
CONCLUSIONS: The proportion of agreement levels between and within the maternity care professionals in the classification of aCTG traces among healthy women were comparable. This means that these professional groups are equally well able to classify aCTGs in healthy pregnant women.

OBJECTIVE: The modified Rutgeerts score (mRS) is widely used for the assessment of endoscopic postoperative recurrence (ePOR) in Crohn\'s disease (CD) after ileocolic resection to guide therapeutic decisions. To improve the validity and prognostic value of this endoscopic assessment, 2 new scores have been proposed. This study assessed the interobserver agreement of the current score (mRS) and the new endoscopic score for ePOR in CD.
METHODS: Sixteen Dutch academic and nonacademic inflammatory bowel disease specialists assessed endoscopic videos (n = 71) of postoperative CD patients (n = 66) retrieved from 9 Dutch centers. Each video was assessed for degree of inflammation by 4 gastroenterologists using the mRS and the new proposed endoscopic score: the REMIND score (separate score of anastomosis and neoterminal ileum) and the updated Rutgeerts score (assessment of lesions at the anastomotic line, ileal inlet, ileal body, and neoterminal ileum). In addition, lesions at the ileal body, ileal inlet, neoterminal ileum, and colonic and/or ileal blind loop were separately assessed. Interobserver agreement was assessed by using Fleiss\' weighted kappa.
RESULTS: Fleiss\' weighted kappa for the mRS was .67 (95% confidence interval [CI], .59-.74). The weighted kappa for the REMIND score was .73 (95% CI, .65-.80) for lesions in the neoterminal ileum and .46 (95% CI, .35-.58) for anastomotic lesions. The weighted kappa for the updated Rutgeerts score was .69 (95% CI, .62-.77). The weighted kappa for lesions in the ileal body, ileal inlet, neoterminal ileum, and colonic and ileal blind loop was .61 (95% CI, .49-.73), .63 (95% CI, .54-.72), .61 (95% CI, .49-.74), .83 (95% CI, .62-1.00) and .68 (95% CI, .46-.89), respectively.
CONCLUSIONS: The interobserver agreement of the mRS is substantial. Similarly, the interobserver agreement is substantial for the updated Rutgeerts score. According to the REMIND score, the interobserver agreement was substantial for lesions in the neoterminal ileum, although only moderate for anastomotic lesions. Because therapeutic decisions in clinical practice are based on these assessments, and these scores are used as outcome measure in clinical studies, further improvement of the interobserver agreement is essential.

BACKGROUND: Anal cytology represents a tool for anal cancer screening in high-risk populations. In addition to accuracy, the reproducibility of the interpretation is of key importance. The authors evaluated the agreement of anal cytologic interpretation between two cytopathologists.
METHODS: Liquid-based cytologic slides from human immunodeficiency virus (HIV)-negative men who have sex with men (MSM) were evaluated by two readers with at least 10 years of expertise in cervical cytology. Cases with a discordant interpretation were reviewed, and a consensus was reached. Human papillomavirus (HPV) genotyping was performed using a proprietary HPV genotyping test. Unweighted and weighted Cohen kappa and 95% confidence interval (CI) values were calculated.
RESULTS: Overall, 713 slides that were adequate for interpretation were evaluated (MSM: median age, 33 years). An HPV test was performed on 620 samples (87.0%). Considering a dichotomous interpretation (negative for intraepithelial lesion or malignancy vs. atypical squamous cells of undetermined significance or worse), the crude agreement between the two readers was 93.3% (kappa = 0.82; 95% CI, 0.77-0.87). Once a consensus for discordant cases was reached, the best agreement was found for the negative for intraepithelial lesion or malignancy category (511 of 528 samples; 96.8%), whereas the atypical squamous cells of undetermined significance category showed the lowest agreement (90 of 117 samples, 76.9%). Considering the individual cytologic categories, overall agreement was 92.1% (kappa = 0.85; 95% CI, 0.81-0.89). The discordant interpretations were not associated with high-risk HPV infection, HPV16 infection, or MSM age.
CONCLUSIONS: The results indicating excellent interobserver agreement in this study substantiate the use of anal cytology in the setting of human immunodeficiency virus-negative MSM.