UNASSIGNED: Increasing and substantial reliance on electronic health records (EHRs) and data types (ie, diagnosis, medication, and laboratory data) demands assessment of their data quality as a fundamental approach, especially since there is a need to identify appropriate denominator populations with chronic conditions, such as type 2 diabetes (T2D), using commonly available computable phenotype definitions (ie, phenotypes).
UNASSIGNED: To bridge this gap, our study aims to assess how issues of EHR data quality and variations and robustness (or lack thereof) in phenotypes may have potential impacts in identifying denominator populations.
UNASSIGNED: Approximately 208,000 patients with T2D were included in our study, which used retrospective EHR data from the Johns Hopkins Medical Institution (JHMI) during 2017-2019. Our assessment included 4 published phenotypes and 1 definition from a panel of experts at Hopkins. We conducted descriptive analyses of demographics (ie, age, sex, race, and ethnicity), use of health care (inpatient and emergency room visits), and the average Charlson Comorbidity Index score of each phenotype. We then used different methods to induce or simulate data quality issues of completeness, accuracy, and timeliness separately across each phenotype. For induced data incompleteness, our model randomly dropped diagnosis, medication, and laboratory codes independently at increments of 10%; for induced data inaccuracy, our model randomly replaced a diagnosis or medication code with another code of the same data type and induced 2% incremental change from -100% to +10% in laboratory result values; and lastly, for timeliness, data were modeled for induced incremental shift of date records by 30 days to 365 days.
UNASSIGNED: Less than a quarter (n=47,326, 23%) of the population overlapped across all phenotypes using EHRs. The population identified by each phenotype varied across all combinations of data types. Induced incompleteness identified fewer patients with each increment; for example, at 100% diagnostic incompleteness, the Chronic Conditions Data Warehouse phenotype identified zero patients, as its phenotypic characteristics included only diagnosis codes. Induced inaccuracy and timeliness similarly demonstrated variations in performance of each phenotype, therefore resulting in fewer patients being identified with each incremental change.
UNASSIGNED: We used EHR data with diagnosis, medication, and laboratory data types from a large tertiary hospital system to understand T2D phenotypic differences and performance. We used induced data quality methods to learn how data quality issues may impact identification of the denominator populations upon which clinical (eg, clinical research and trials, population health evaluations) and financial or operational decisions are made. The novel results from our study may inform future approaches to shaping a common T2D computable phenotype definition that can be applied to clinical informatics, managing chronic conditions, and additional industry-wide efforts in health care.

Data Science emerged as a new cross-disciplinary discipline at the intersection of statistics, computer science, and expertise in a specific domain, such as health and biology. The data science field, alongside other data-related professions, is continuously evolving. We conducted a study examining tasks assigned to first-year internship students pursuing a Master\'s degree in Health Data Science, exploring the missions, technologies employed and skills required, and internship alignment with students\' training through semi-structured interviews with 32 participants. Three quarters of the students were placed in teams within the public sector. Among these entities, there were 11 hospitals and 12 universities. Although the majority of students did their internship as part of a methodological team, they often had a healthcare professional on their team. Nearly half of the missions involved descriptive analysis, followed by 9 missions focused on etiology or prediction and 8 missions on implementing a data warehouse. The majority of students had to perform data management and produce graphs, while only half conducted statistical analysis. The findings highlighted that data management remains a major challenge, and it should be taken into consideration when designing training programs. In future, it remains to determine whether this trend will continue with second-year students or if, with experience, they are more often assigned statistical analyses.

BACKGROUND: Leveraging electronic health record (EHR) data for clinical or research purposes heavily depends on data fitness. However, there is a lack of standardized frameworks to evaluate EHR data suitability, leading to inconsistent quality in data use projects (DUPs). This research focuses on the Medical Informatics for Research and Care in University Medicine (MIRACUM) Data Integration Centers (DICs) and examines empirical practices on assessing and automating the fitness-for-purpose of clinical data in German DIC settings.
OBJECTIVE: The study aims (1) to capture and discuss how MIRACUM DICs evaluate and enhance the fitness-for-purpose of observational health care data and examine the alignment with existing recommendations and (2) to identify the requirements for designing and implementing a computer-assisted solution to evaluate EHR data fitness within MIRACUM DICs.
METHODS: A qualitative approach was followed using an open-ended survey across DICs of 10 German university hospitals affiliated with MIRACUM. Data were analyzed using thematic analysis following an inductive qualitative method.
RESULTS: All 10 MIRACUM DICs participated, with 17 participants revealing various approaches to assessing data fitness, including the 4-eyes principle and data consistency checks such as cross-system data value comparison. Common practices included a DUP-related feedback loop on data fitness and using self-designed dashboards for monitoring. Most experts had a computer science background and a master\'s degree, suggesting strong technological proficiency but potentially lacking clinical or statistical expertise. Nine key requirements for a computer-assisted solution were identified, including flexibility, understandability, extendibility, and practicability. Participants used heterogeneous data repositories for evaluating data quality criteria and practical strategies to communicate with research and clinical teams.
CONCLUSIONS: The study identifies gaps between current practices in MIRACUM DICs and existing recommendations, offering insights into the complexities of assessing and reporting clinical data fitness. Additionally, a tripartite modular framework for fitness-for-purpose assessment was introduced to streamline the forthcoming implementation. It provides valuable input for developing and integrating an automated solution across multiple locations. This may include statistical comparisons to advanced machine learning algorithms for operationalizing frameworks such as the 3×3 data quality assessment framework. These findings provide foundational evidence for future design and implementation studies to enhance data quality assessments for specific DUPs in observational health care settings.

Metadata describe and provide context for other data, playing a pivotal role in enabling findability, accessibility, interoperability, and reusability (FAIR) data principles. By providing comprehensive and machine-readable descriptions of digital resources, metadata empower both machines and human users to seamlessly discover, access, integrate, and reuse data or content across diverse platforms and applications. However, the limited accessibility and machine-interpretability of existing metadata for population health data hinder effective data discovery and reuse.
To address these challenges, we propose a comprehensive framework using standardized formats, vocabularies, and protocols to render population health data machine-readable, significantly enhancing their FAIRness and enabling seamless discovery, access, and integration across diverse platforms and research applications.
The framework implements a 3-stage approach. The first stage is Data Documentation Initiative (DDI) integration, which involves leveraging the DDI Codebook metadata and documentation of detailed information for data and associated assets, while ensuring transparency and comprehensiveness. The second stage is Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) standardization. In this stage, the data are harmonized and standardized into the OMOP CDM, facilitating unified analysis across heterogeneous data sets. The third stage involves the integration of Schema.org and JavaScript Object Notation for Linked Data (JSON-LD), in which machine-readable metadata are generated using Schema.org entities and embedded within the data using JSON-LD, boosting discoverability and comprehension for both machines and human users. We demonstrated the implementation of these 3 stages using the Integrated Disease Surveillance and Response (IDSR) data from Malawi and Kenya.
The implementation of our framework significantly enhanced the FAIRness of population health data, resulting in improved discoverability through seamless integration with platforms such as Google Dataset Search. The adoption of standardized formats and protocols streamlined data accessibility and integration across various research environments, fostering collaboration and knowledge sharing. Additionally, the use of machine-interpretable metadata empowered researchers to efficiently reuse data for targeted analyses and insights, thereby maximizing the overall value of population health resources. The JSON-LD codes are accessible via a GitHub repository and the HTML code integrated with JSON-LD is available on the Implementation Network for Sharing Population Information from Research Entities website.
The adoption of machine-readable metadata standards is essential for ensuring the FAIRness of population health data. By embracing these standards, organizations can enhance diverse resource visibility, accessibility, and utility, leading to a broader impact, particularly in low- and middle-income countries. Machine-readable metadata can accelerate research, improve health care decision-making, and ultimately promote better health outcomes for populations worldwide.

BACKGROUND: The impact of missing data on individual continuous glucose monitoring (CGM) data is unknown but can influence clinical decision-making for patients.
OBJECTIVE: We aimed to investigate the consequences of data loss on glucose metrics in individual patient recordings from continuous glucose monitors and assess its implications on clinical decision-making.
METHODS: The CGM data were collected from patients with type 1 and 2 diabetes using the FreeStyle Libre sensor (Abbott Diabetes Care). We selected 7-28 days of 24 hours of continuous data without any missing values from each individual patient. To mimic real-world data loss, missing data ranging from 5% to 50% were introduced into the data set. From this modified data set, clinical metrics including time below range (TBR), TBR level 2 (TBR2), and other common glucose metrics were calculated in the data sets with and that without data loss. Recordings in which glucose metrics deviated relevantly due to data loss, as determined by clinical experts, were defined as expert panel boundary error (εEPB). These errors were expressed as a percentage of the total number of recordings. The errors for the recordings with glucose management indicator <53 mmol/mol were investigated.
RESULTS: A total of 84 patients contributed to 798 recordings over 28 days. With 5%-50% data loss for 7-28 days recordings, the εEPB varied from 0 out of 798 (0.0%) to 147 out of 736 (20.0%) for TBR and 0 out of 612 (0.0%) to 22 out of 408 (5.4%) recordings for TBR2. In the case of 14-day recordings, TBR and TBR2 episodes completely disappeared due to 30% data loss in 2 out of 786 (0.3%) and 32 out of 522 (6.1%) of the cases, respectively. However, the initial values of the disappeared TBR and TBR2 were relatively small (<0.1%). In the recordings with glucose management indicator <53 mmol/mol the εEPB was 9.6% for 14 days with 30% data loss.
CONCLUSIONS: With a maximum of 30% data loss in 14-day CGM recordings, there is minimal impact of missing data on the clinical interpretation of various glucose metrics.
BACKGROUND: ClinicalTrials.gov NCT05584293; https://clinicaltrials.gov/study/NCT05584293.

UNASSIGNED: Missed appointments can lead to treatment delays and adverse outcomes. Telemedicine may improve appointment completion because it addresses barriers to in-person visits, such as childcare and transportation. This study compared appointment completion for appointments using telemedicine versus in-person care in a large cohort of patients at an urban academic health sciences center.
UNASSIGNED: We conducted a retrospective cohort study of electronic health record data to determine whether telemedicine appointments have higher odds of completion compared to in-person care appointments, January 1, 2021, and April 30, 2023. The data were obtained from the University of South Florida (USF), a large academic health sciences center serving Tampa, FL, and surrounding communities. We implemented 1:1 propensity score matching based on age, gender, race, visit type, and Charlson Comorbidity Index (CCI).
UNASSIGNED: The matched cohort included 87 376 appointments, with diverse patient demographics. The percentage of completed telemedicine appointments exceeded that of completed in-person care appointments by 9.2 points (73.4% vs 64.2%, P < .001). The adjusted odds ratio for telemedicine versus in-person care in relation to appointment completion was 1.64 (95% CI, 1.59-1.69, P < .001), indicating that telemedicine appointments are associated with 64% higher odds of completion than in-person care appointments when controlling for other factors.
UNASSIGNED: This cohort study indicated that telemedicine appointments are more likely to be completed than in-person care appointments, regardless of demographics, comorbidity, payment type, or distance.
UNASSIGNED: Telemedicine appointments are more likely to be completed than in-person healthcare appointments.

The operational environment of complex sociotechnical systems is inherently uncertain, demanding constant coordination restructuring to adapt to dynamic situational demands. However, coordination changes in the Human Factors and Ergonomics Field have primarily been studied using static methods, overlooking moment-by-moment adjustments. In the current study, we address coordination restructuring by using THEME, a digital analytical tool capable of visualising and exploring coordination restructuring from a multi-layered perspective. We examine restructuring in coordination patterns during NASA\'s Apollo 13 Mission, revealing significant shifts from stable, long-duration \'coordination hubs\' in routine operations to shorter-duration patterns during a crisis situation. Additionally, the results highlight the importance of flexible switching between reciprocal and one-directed coordination, along with enhanced role distribution. This study underscores how exploring temporality-sensitive phenomena like coordination through digital technologies such as THEME, advances our understanding of incident analysis and resilient performance within complex systems.

BACKGROUND: The medical knowledge graph provides explainable decision support, helping clinicians with prompt diagnosis and treatment suggestions. However, in real-world clinical practice, patients visit different hospitals seeking various medical services, resulting in fragmented patient data across hospitals. With data security issues, data fragmentation limits the application of knowledge graphs because single-hospital data cannot provide complete evidence for generating precise decision support and comprehensive explanations. It is important to study new methods for knowledge graph systems to integrate into multicenter, information-sensitive medical environments, using fragmented patient records for decision support while maintaining data privacy and security.
OBJECTIVE: This study aims to propose an electronic health record (EHR)-oriented knowledge graph system for collaborative reasoning with multicenter fragmented patient medical data, all the while preserving data privacy.
METHODS: The study introduced an EHR knowledge graph framework and a novel collaborative reasoning process for utilizing multicenter fragmented information. The system was deployed in each hospital and used a unified semantic structure and Observational Medical Outcomes Partnership (OMOP) vocabulary to standardize the local EHR data set. The system transforms local EHR data into semantic formats and performs semantic reasoning to generate intermediate reasoning findings. The generated intermediate findings used hypernym concepts to isolate original medical data. The intermediate findings and hash-encrypted patient identities were synchronized through a blockchain network. The multicenter intermediate findings were collaborated for final reasoning and clinical decision support without gathering original EHR data.
RESULTS: The system underwent evaluation through an application study involving the utilization of multicenter fragmented EHR data to alert non-nephrology clinicians about overlooked patients with chronic kidney disease (CKD). The study covered 1185 patients in nonnephrology departments from 3 hospitals. The patients visited at least two of the hospitals. Of these, 124 patients were identified as meeting CKD diagnosis criteria through collaborative reasoning using multicenter EHR data, whereas the data from individual hospitals alone could not facilitate the identification of CKD in these patients. The assessment by clinicians indicated that 78/91 (86%) patients were CKD positive.
CONCLUSIONS: The proposed system was able to effectively utilize multicenter fragmented EHR data for clinical application. The application study showed the clinical benefits of the system with prompt and comprehensive decision support.

Guideline adherence in radiotherapy is crucial for maintaining treatment quality and consistency, particularly in non-trial patient settings where most treatments occur. The study aimed to assess the impact of guideline changes on treatment planning practices and compare manual registry data accuracy with treatment planning data.
This study utilised the DBCG RT Nation cohort, a collection of breast cancer radiotherapy data in Denmark, to evaluate adherence to guidelines from 2008 to 2016. The cohort included 7448 high-risk breast cancer patients. National guideline changes included, fractionation, introduction of respiratory gating, irradiation of the internal mammary lymph nodes, use of the simultaneous integrated boost technique and inclusion of the Left Anterior Descending coronary artery in delineation practice. Methods for structure name mapping, laterality detection, detection of temporal changes in population mean lung volume, and dose evaluation were presented and applied. Manually registered treatment characteristic data was obtained from the Danish Breast Cancer Database for comparison.
The study found immediate and consistent adherence to guideline changes across Danish radiotherapy centres. Treatment practices before guideline implementation were documented and showed a variation among centres. Discrepancies between manual registry data and actual treatment planning data were as high as 10% for some measures.
National guideline changes could be detected in the routine treatment data, with a high degree of compliance and short implementation time. Data extracted from treatment planning data files provides a more accurate and detailed characterisation of treatments and guideline adherence than medical register data.

Objective First responders\' mandatory reports of mental health episodes requiring emergency hospital care contain rich information about patients and their needs. In Queensland (Australia) much of the information contained in Emergency Examination Authorities (EEAs) remains unused. We propose and demonstrate a methodology to extract and translate vital information embedded in reports like EEAs and to use it to investigate the extreme propensity of incidence of serious mental health episodes. Methods The proposed method integrates clinical, demographic, spatial and free text information into a single data collection. The data is subjected to exploratory analysis for spatial pattern recognition leading to an observational epidemiology model for the association of maximum spatial recurrence of EEA episodes. Results Sentiment analysis revealed that among EEA presentations hospital and health service (HHS) region #4 had the lowest proportion of positive sentiments (18 %) compared to 33 % for HHS region #1 pointing to spatial differentiation of sentiments immanent in mandated free text which required more detailed analysis. At the postcode geographical level, we found that variation in maximum spatial recurrence of EEAs was significantly positively associated with spatial range of sentiments (0.29, p < 0.001) and the postcode-referenced sex ratio (0.45, p = 0.01). The volatility of sentiments significantly correlated with extremes of recurrence of EEA episodes. The predicted (probabilistic) incidence rate when mapped reflected this correlation. Conclusions The paper demonstrates the efficacy of integrating, machine extracted, human sentiments (as potential surrogates) with conventional exposure variables for evidence-based methods for mental health spatial epidemiology. Such insights from informatics-driven epidemiological observations may inform the strategic allocation of health system resources to address the highest levels of need and to improve the standard of care for mental patients while also enhancing their safe and humane treatment and management.