OBJECTIVE: To evaluate the veracity of self-reports of month-level health insurance coverage in the Current Population Survey Annual Social and Economic Supplement (CPS).
METHODS: The CHIME (Comparing Health Insurance Measurement Error) study used health insurance enrollment records from a large regional Midwest insurer as sample for primary data collection in spring 2015.
METHODS: A sample of individuals enrolled in a range of public and private coverage types (including Medicaid and marketplace) was administered the CPS health insurance module, which included questions about month-level coverage, by type, over a 17-18-month time span. Survey data was then matched to enrollment records covering that same time frame, and concordance between the records and self-reports was assessed.
METHODS: Sample was drawn by the insurer\'s informatics specialists and Census Bureau interviewers conducted the survey. Following data collection, updated enrollment records were matched to the survey data to produce a person-level file of coverage by type at the month-level.
RESULTS: For 91% of the overall sample, coverage status and type were reported accurately for at least 75% of observed months. Results varied somewhat by stability of coverage. Among those who were continuously covered throughout the 17-18 month observation period (which comprised 64% of the overall sample), that level of reporting accuracy was observed for 94% of the sample; for those who had censored spells (34% of the overall sample), the figure was 87%; and among those with gaps and/or changes according to the records (2% of the overall sample), for 82% of the group at least 75% of months were reported accurately.
CONCLUSIONS: Findings suggest that reporting accuracy of month-level coverage in the CPS is high and that the survey could become a valuable new data source for studying the dynamics of coverage, including the Medicaid unwinding.

BACKGROUND: Psychological autopsy methods often include measures of impulsivity and aggression. The aim is to assess their reliability and validity in a Spanish sample.
METHODS: Cross-sectional web-based survey was fulfilled by 184 proband and proxy pairs. Data was collected on sociodemographic characteristics, impulsivity through Barratt Impulsiveness Scale (BIS-11), aggression through Buss-Perry Aggression Questionnaire (BPAQ), and history of suicide ideation. Proxies filled out BIS-11, BPAQ and suicide ideation with the responses they would expect from the probands. Reliability was assessed using intraclass correlation coefficients (ICC) between proband and proxies. Logistic regression analysis was performed to assess the predictive validity of proxy reports in predicting probands\' suicide ideation.
RESULTS: Bivariate analysis showed differences in BPAQ (Median 68 vs. 62; p=0.001), but not in BIS-11 (p>.050). BIS-11 showed good concordance (ICC=0.754; CI 95% 0.671-0.816) and BPAQ acceptable (ICC=0.592; CI 95% 0.442-0.699). In the probands regression model BPAQ predicted suicide ideation (OR 1.038; CI 95% 1.016-1.061) but not BIS-11 (OR 0.991; CI 95% 0.958-1.025). In the proxy-report model BPAQ also predicted probands\' suicide ideation (OR 1.036; CI 95% 1.014-1.058) but not BIS-11 (OR 0.973; CI 95% 0.942-1.004).
CONCLUSIONS: Used as proxy-reported assessment tools, BIS-11 showed better reliability than the BPAQ. However, both showed validity in Spanish population and could be included in psychological autopsy protocols.

To evaluate the positive predictive value (PPV) of an endometrial cancer case finding algorithm using International Classification of Disease 10th revision Clinical Modification (ICD-10-CM) diagnosis codes from US insurance claims for implementation in a planned post-marketing safety study. Two algorithm variants were evaluated.
Provisional incident endometrial cancer cases were identified from 2016 through 2020 among women aged ≥50 years. One algorithm variant used diagnosis codes for malignant neoplasms of uterine sites (C54.x), excluding C54.2 (malignant neoplasm of myometrium); the other used only C54.1 (malignant neoplasm of endometrium). A random sample of medical records of recent incident provisional cases (2018-2020) was requested for adjudication. Confirmed cases showed biopsy evidence of endometrial cancer, documentation of cancer staging, or hysterectomy following diagnosis. We estimated the PPV of the variants with 95% confidence intervals (CI) excluding cases that had insufficient information.
Of 294 provisional cases adjudicated, 85% were from outpatient settings (n = 249). Mean age at diagnosis was 69.3 years. Among the 294 adjudicated cases (identified with the broader algorithm variant), the same 223 were confirmed endometrial cancer cases by both algorithm variants. The PPV (95% CI) for the broader algorithm variant was 84.2% (79.2% and 88.3%), and for the variant using only C54.1 was 85.8% (80.9% and 89.8%).
We developed and validated an algorithm using ICD-10-CM diagnosis codes to identify endometrial cancer cases in health insurance claims with a sufficiently high PPV to use in a planned post-marketing safety study.

Objectives: This study was aimed to assess validation and reliability of knowledge of, attitude toward and practice (KAP) of a Case-mix and Diagnosis Related Group (DRG) system questionnaire. Methods: A sample of 238 health care providers selected conveniently from three public hospitals in Turkey was enrolled in a cross-sectional study from September 1 until November 30, 2012. The mean age was 38.63 years (standard deviation [SD] 10.52), ranging from age 21 to 60 years. More than one-half were males (52.1%), nearly two-fifths were medical doctors (39.9%), one-third were nurses (33.2%), one-sixth were auxiliary staff (16.4%) and the remaining were coders (10.5%). Only one-third (33.6%) of respondents attended a workshop or training program in the Case-mix or DRG system. After examining content validity, factor analysis was conducted, internal consistency of the questionnaire was assessed by Cronbach\'s alpha estimate, and test-retest reliability was evaluated. Results: The sample adequacy for extraction of the factors was confirmed by the Kaiser-Meyer-Olkin test (0.915) and the Bartlett test (1052). Factor analysis showed three factors, including attitude (36.43%), practice (23.39%) and knowledge (17%), with a total variance of 76.82%. The reliability of each section of the questionnaire was as follows: knowledge (0.963), attitude (0.964) and practice (0.973). Cronbach\'s alpha total was 0.941, which showed excellent internal consistency. Conclusions: This study demonstrated that the designed questionnaire provided high construct validity and reliability, and could be adequately used to measure KAP among health care staff of the Case-mix and DRG system in Turkey.

We aimed to examine the reliability and validity of Chengdu pediatric emergency triage criteria in order to provide a reference for the development of pediatric emergency triage within other hospitals.
We developed Chengdu pediatric emergency triage criteria based on the conditions/symptom, vital signs, and the Pediatric Early Warning Score system within our hospital using the Delphi method in 2020. The simulation scenario triage and real-life triage which were conducted in our hospital during January - March 2021, and the retrospective study of triage records extracted from our hospital\'s health information system in February 2022, were used to measure the agreement in triage decisions between the triage nurses, and between the triage nurses and the expert team.
For the 20 simulation cases, the Kappa value of triage decisions between the triage nurses was 0.6 (95% CI 0.352-0.849), and the Kappa value of triage decisions between the triage nurses and the expert team was 0.73 (95% CI 0.540-0.911). For the 252 cases in the real-life triage, the Kappa value of triage decisions between the triage nurses and the expert team was 0.824 (95% CI 0.680-0.962). For the 20,540 cases selected for the retrospective study of triage records, the Kappa value of triage decisions between the triage nurses was 0.702 (95% CI 0.691-0.713); that between Triage Nurse 1 and the expert team was 0.634 (95% CI 0.623-0.647); and that between Triage Nurse 2 and the expert team was 0.725 (95% CI 0.713-0.736). The overall agreement rate in triage decisions between the triage nurses and the expert team in the simulation scenario triage was 80%; that between the triage nurses and the expert team in the real-life triage was 97.6%; and that between the triage nurses in the retrospective study was 91.9%. In the retrospective study, the agreement rates in triage decisions between Triage Nurse 1 and the expert team, and between Triage Nurse 2 and the expert team, were 88.0% and 92.3%, respectively.
Chengdu pediatric emergency triage criteria that developed within our hospital is reliable and valid, and can promote rapid and effective triage by triage nurses.

This article presents key findings from a research project that evaluated the validity and probative value of cartridge-case comparisons under field-based conditions. Decisions provided by 228 trained firearm examiners across the US showed that forensic cartridge-case comparison is characterized by low error rates. However, inconclusive decisions constituted over one-fifth of all decisions rendered, complicating evaluation of the technique\'s ability to yield unambiguously correct decisions. Specifically, restricting evaluation to only the conclusive decisions of identification and elimination yielded true-positive and true-negative rates exceeding 99%, but incorporating inconclusives caused these values to drop to 93.4% and 63.5%, respectively. The asymmetric effect on the two rates occurred because inconclusive decisions were rendered six times more frequently for different-source than same-source comparisons. Considering probative value, which is a decision\'s usefulness for determining a comparison\'s ground-truth state, conclusive decisions predicted their corresponding ground-truth states with near perfection. Likelihood ratios (LRs) further showed that conclusive decisions greatly increase the odds of a comparison\'s ground-truth state matching the ground-truth state asserted by the decision. Inconclusive decisions also possessed probative value, predicting different-source status and having a LR indicating that they increase the odds of different-source status. The study also manipulated comparison difficulty by using two firearm models that produce dissimilar cartridge-case markings. The model chosen for being more difficult received more inconclusive decisions for same-source comparisons, resulting in a lower true-positive rate compared to the less difficult model. Relatedly, inconclusive decisions for the less difficult model exhibited more probative value, being more strongly predictive of different-source status.

Many authors used reporting checklists as an assessment tool to analyze the reporting quality of diverse types of evidence. We aimed to analyze methodological approaches used by researchers assessing reporting quality of evidence in randomized controlled trials, systematic reviews, and observational studies.
We analyzed articles reporting quality assessment of evidence with Preferred Reporting Items of Systematic Reviews and Meta-Analyses (PRISMA), CONsolidated Standards of Reporting Trials (CONSORT), or the Strengthening the Reporting of Observational studies in Epidemiology (STROBE) checklists published up to 18 July 2021. We analyzed methods used for assessing reporting quality.
Among 356 analyzed articles, 293 (88%) investigated a specific thematic field. The CONSORT checklist (N = 225; 67%) was most often used, in its original, modified, partial form, or its extension. Numerical scores were given for adherence to checklist items in 252 articles (75%), of which 36 articles (11%) used various reporting quality thresholds. In 158 (47%) articles, predictors of adherence to reporting checklist were analyzed. The most studied factor associated with adherence to reporting checklist was the year of article publication (N = 82; 52%).
The methodology used for assessing reporting quality of evidence varied considerably. The research community needs a consensus on a consistent methodology for assessing the quality of reporting.

Childhood maltreatment is associated with the etiology and clinical course of bipolar disorder. Most studies employ retrospective maltreatment self-reports which are vulnerable to bias, raising questions about their validity and reliability. This study examined the test-retest reliability over 10 years, the convergent validity and the impact of current mood on retrospective reports of childhood maltreatment in a bipolar sample. 85 participants with bipolar I disorder completed the Childhood Trauma Questionnaire [CTQ] and the Parental Bonding Instrument [PBI] at baseline. Beck Depression Inventory and Self Report Mania Inventory assessed depressive and manic symptoms, respectively. 53 participants completed the CTQ at baseline and 10-year follow-up. Good levels of convergent validity were observed between the CTQ and PBI. Correlations ranged from rs= -0.35 (CTQ emotional abuse and PBI paternal care) to rs= -0.65 (CTQ emotional neglect and PBI maternal care). Good agreement between CTQ reports at baseline and 10-year follow-up were found (range: κ=0.41 for physical neglect to κ=0.83 for sexual abuse). Higher depression and mania scores were recorded among participants who reported abuse (but not neglect) compared to those without such reports. These findings support using this method in research and clinical practice, though current mood should be taken into account.

The aims of this study were to examine the psychometric properties of the Brief Assessment of Impaired Cognition (BASIC) case-finding instrument in clinical settings focusing on (i) test-retest reliability, (ii) the discriminative validity of BASIC and its components for identification of Alzheimer disease (AD) dementia and non-AD dementia, and (iii) the association of expert clinical rating of cognitive status with BASIC performance.
The test-retest reliability analysis was based on a sample of general practice patients (n = 59) retested with a mean interval of 19 days. Discriminative validity analyses and analysis of the association of cognitive status with BASIC performance were based on data from the primary validation study of BASIC in memory clinics.
The test-retest reliability of BASIC was high (r = 0.861). No significant difference in discriminative validity was found for identification of AD dementia (sensitivity = 0.99, specificity = 0.98) and non-AD dementia (sensitivity = 0.90, specificity = 0.98). All components of BASIC contributed to the high discriminative validity of both AD and non-AD dementia. BASIC performance was significantly correlated with expert clinical rating of the cognitive status of patients. A crude staging model for cognitive status using BASIC score intervals had superior classification accuracy (70%) compared to a Mini-Mental State Examination (MMSE) score range-based model (58% accuracy).
BASIC is a reliable and valid case-finding instrument for AD dementia and non-AD dementia in clinical settings. BASIC performance is significantly associated with the degree of cognitive impairment, and BASIC seems to be superior to MMSE for staging of impairment.

BACKGROUND: Story recall is a simple and sensitive cognitive test that is commonly used to measure changes in episodic memory function in early Alzheimer disease (AD). Recent advances in digital technology and natural language processing methods make this test a candidate for automated administration and scoring. Multiple parallel test stimuli are required for higher-frequency disease monitoring.
OBJECTIVE: This study aims to develop and validate a remote and fully automated story recall task, suitable for longitudinal assessment, in a population of older adults with and without mild cognitive impairment (MCI) or mild AD.
METHODS: The \"Amyloid Prediction in Early Stage Alzheimer\'s disease\" (AMYPRED) studies recruited participants in the United Kingdom (AMYPRED-UK: NCT04828122) and the United States (AMYPRED-US: NCT04928976). Participants were asked to complete optional daily self-administered assessments remotely on their smart devices over 7 to 8 days. Assessments included immediate and delayed recall of 3 stories from the Automatic Story Recall Task (ASRT), a test with multiple parallel stimuli (18 short stories and 18 long stories) balanced for key linguistic and discourse metrics. Verbal responses were recorded and securely transferred from participants\' personal devices and automatically transcribed and scored using text similarity metrics between the source text and retelling to derive a generalized match score. Group differences in adherence and task performance were examined using logistic and linear mixed models, respectively. Correlational analysis examined parallel-forms reliability of ASRTs and convergent validity with cognitive tests (Logical Memory Test and Preclinical Alzheimer\'s Cognitive Composite with semantic processing). Acceptability and usability data were obtained using a remotely administered questionnaire.
RESULTS: Of the 200 participants recruited in the AMYPRED studies, 151 (75.5%)-78 cognitively unimpaired (CU) and 73 MCI or mild AD-engaged in optional remote assessments. Adherence to daily assessment was moderate and did not decline over time but was higher in CU participants (ASRTs were completed each day by 73/106, 68.9% participants with MCI or mild AD and 78/94, 83% CU participants). Participants reported favorable task usability: infrequent technical problems, easy use of the app, and a broad interest in the tasks. Task performance improved modestly across the week and was better for immediate recall. The generalized match scores were lower in participants with MCI or mild AD (Cohen d=1.54). Parallel-forms reliability of ASRT stories was moderate to strong for immediate recall (mean rho 0.73, range 0.56-0.88) and delayed recall (mean rho=0.73, range=0.54-0.86). The ASRTs showed moderate convergent validity with established cognitive tests.
CONCLUSIONS: The unsupervised, self-administered ASRT task is sensitive to cognitive impairments in MCI and mild AD. The task showed good usability, high parallel-forms reliability, and high convergent validity with established cognitive tests. Remote, low-cost, low-burden, and automatically scored speech assessments could support diagnostic screening, health care, and treatment monitoring.