OBJECTIVE: This manuscript presents a comprehensive framework for the assessment of the value of real-world evidence (RWE) in healthcare decision-making. While RWE has been proposed to overcome some limitations of traditional, one-off studies, no systematic framework exists to measure if RWE actually lowers the burden. This framework aims to fill that gap by providing conceptual approaches for evaluating the time and cost efficiencies of RWE, thus guiding strategic investments in RWE infrastructure.
METHODS: The framework consists of four components: (114th Congress. 21st Century Cures Act.; 2015. https://www.congress.gov/114/plaws/publ255/PLAW-114publ255.pdf .) identification of stakeholders using and producing RWE, (National Health Council. Glossary of Patient Engagement Terms. Published 2019. Accessed May 18. 2021. https://nationalhealthcouncil.org/glossary-of-patient-engagement-terms/ .) understanding value propositions on how RWE can benefit stakeholders, (Center for Drug Evaluation and Research. CDER Patient-Focused Drug Development. U.S. Food & Drug Administration.) defining key performance indicators (KPIs), and (U.S. Department of Health and Human Services - Food and Drug Administration: Center for Devices and Radiological Health and Center for Biologics Evaluation and Research. Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices - Guidance for Industry and Food and Drug Administration Staff. 2017. http://www.fda.gov/BiologicsBloodVaccines/GuidanceComplianceRegulatoryInformation/Guida .) establishing metrics and case studies to assess value. KPIs are categorized as \'better, faster, or cheaper\" as an indicator of value: better focusing on high-quality actionable evidence; \'faster,\' denoting time-saving in evidence generation, and \'cheaper,\' emphasizing cost-efficiency decision compared to methodologies that do not involve data routinely collected in clinical practice. Metrics and relevant case studies are tailored based on stakeholder value propositions and selected KPIs that can be used to assess what value has been created by using RWE compared to traditional evidence-generation approaches and comparing different RWE sources.
RESULTS: Operationalized through metrics and case studies drawn from the literature, the value of RWE is documented as improving treatment effect heterogeneity evaluation, expanding medical product labels, and expediting post-market compliance. RWE is also shown to reduce the cost and time required to produce evidence compared to traditional one-off approaches. An original example of a metric that measures the time saved by RWE methods to detect a signal of a product failure was presented based on analysis of the National Cardiovascular Disease Registry.
CONCLUSIONS: The framework presented in this manuscript offers a comprehensive approach for evaluating the value of RWE, applicable to all stakeholders engaged in leveraging RWE for healthcare decision-making. Through the proposed metrics and illustrated case studies, valuable insights are provided into the heightened efficiency, cost-effectiveness, and improved decision-making within clinical and regulatory domains facilitated by RWE. While this framework is primarily focused on medical devices, it could potentially inform the determination of RWE value in other medical products. By discerning the variations in cost, time, and data utility among various evidence-generation methods, stakeholders are empowered to invest strategically in RWE infrastructure and shape future research endeavors.

暂无摘要。

Real-world data (RWD) are increasingly used to generate real-world evidence (RWE) of vaccine safety and effectiveness for regulatory purposes. Assessing feasibility of using RWD sources prior to implementing observational studies is recommended. As a use case, we described the process and findings of a feasibility assessment to identify reliable and relevant data sources for monitoring the safety and effectiveness of the AS04-HPV-16/18 human papillomavirus (HPV) vaccine in China.
Iterative multi-step process: (1) targeted literature review and data source mapping; (2) expert opinion from national RWD experts; (3) survey to evaluate the identified data source operational infrastructure; and (4) continuous appraisal of published studies using the identified data source.
The Yinzhou Regional Health Information Platform (YRHIP) was identified as a data source of main interest, based on its large population coverage, high cervical cancer screening rates, and availability of adult electronic immunization records. Field meetings with national RWD experts confirmed its suitability for post-authorization vaccine studies. Survey results showed that exposure data and relevant safety and effectiveness endpoints were recorded and linkable at the individual level across the platform. Iterative appraisal of emerging evidence from the literature corroborated these findings.
This feasibility assessment indicates that the YRHIP has the capacity to capture demographic, exposure, outcome and other data required to generate RWE on HPV vaccine safety and effectiveness in China. Studies using the YRHIP to monitor the AS04-HPV-16/18 vaccine in routine use building on this feasibility assessment are ongoing.

Rare disorders impact millions of children worldwide, and developing new medicines in this setting is associated with multiple challenges. In this paper, we share a successful story of how real-world data (RWD) were leveraged to accelerate evidence generation and patient access to a life-changing therapy in patients with severe manifestations of PIK3CA-related overgrowth spectrum who require systemic therapy. Despite all the existing regulatory guidelines considering real-world evidence (RWE), there is limited regulatory precedent of the use of this framework in support of a new indication. Thus, our case study illustrates design innovations based on the use of a compassionate use program, primarily in children, as a RWD source for approval of a new therapy in a rare disorder. We highlight the systematic considerations and mitigation of potential sources of bias in order to transform the data into actionable evidence. Our experience shows that RWE can be successfully used with appropriate study planning and mitigation in the context of a rare disorder with a high unmet medical need. Some lessons learned from this case study can benefit therapeutic development in rare disorders.