BACKGROUND: Clinical trials often involve some form of interim monitoring to determine futility before planned trial completion. While many options for interim monitoring exist (e.g., alpha-spending, conditional power), nonparametric based interim monitoring methods are also needed to account for more complex trial designs and analyses. The upstrap is one recently proposed nonparametric method that may be applied for interim monitoring.
METHODS: Upstrapping is motivated by the case resampling bootstrap and involves repeatedly sampling with replacement from the interim data to simulate thousands of fully enrolled trials. The p-value is calculated for each upstrapped trial and the proportion of upstrapped trials for which the p-value criteria are met is compared with a pre-specified decision threshold. To evaluate the potential utility for upstrapping as a form of interim futility monitoring, we conducted a simulation study considering different sample sizes with several different proposed calibration strategies for the upstrap. We first compared trial rejection rates across a selection of threshold combinations to validate the upstrapping method. Then, we applied upstrapping methods to simulated clinical trial data, directly comparing their performance with more traditional alpha-spending and conditional power interim monitoring methods for futility.
RESULTS: The method validation demonstrated that upstrapping is much more likely to find evidence of futility in the null scenario than the alternative across a variety of simulations settings. Our three proposed approaches for calibration of the upstrap had different strengths depending on the stopping rules used. Compared to O\'Brien-Fleming group sequential methods, upstrapped approaches had type I error rates that differed by at most 1.7% and expected sample size was 2-22% lower in the null scenario, while in the alternative scenario power fluctuated between 15.7% lower and 0.2% higher and expected sample size was 0-15% lower.
CONCLUSIONS: In this proof-of-concept simulation study, we evaluated the potential for upstrapping as a resampling-based method for futility monitoring in clinical trials. The trade-offs in expected sample size, power, and type I error rate control indicate that the upstrap can be calibrated to implement futility monitoring with varying degrees of aggressiveness and that performance similarities can be identified relative to considered alpha-spending and conditional power futility monitoring methods.

UNASSIGNED: Traditional vaccine development, often a lengthy and costly process of three separated phases. However, the swift development of COVID-19 vaccines highlighted the critical importance of accelerating the approval of vaccines. This article showcases a seamless phase 2/3 trial design to expedite the development process, particularly for multi-valent vaccines.
UNASSIGNED: This study utilizes simulation to compare the performance of seamless phase 2/3 design with that of conventional trial design, specifically by re-envisioning a 9-valent HPV vaccine trial. Across three cases, several key performance metrics are evaluated: overall power, type I error rate, average sample size, trial duration, the percentage of early stop, and the accuracy of dose selection.
UNASSIGNED: On average, when the experimental vaccine was assumed to be effective, the seamless design that performed interim analyses based solely on efficacy saved 555.73 subjects, shortened trials by 10.29 months, and increased power by 3.70%. When the experimental vaccine was less effective than control, it saved an average of 887.73 subjects while maintaining the type I error rate below 0.025.
UNASSIGNED: The seamless design proves to be a compelling strategy for vaccine development, given its versatility in early stopping, re-estimating sample sizes, and shortening trial durations.

Indirect mechanisms of cancer immunotherapies result in delayed treatment effects that vary among patients. Consequently, the use of the log-rank test in trial design and analysis can lead to significant power loss and pose additional challenges for interim decisions in adaptive designs. In this paper, we describe patients\' survival using a piecewise proportional hazard model with random lag time and propose an adaptive promising zone design for cancer immunotherapy with heterogeneous delayed effects. We provide solutions for calculating conditional power and adjusting the critical value for the log-rank test with interim data. We divide the sample space into three zones - unfavourable, promising, and favourable -based on re-estimations of the survival parameters, the log-rank test statistic at the interim analysis, and the initial and maximum sample sizes. If the interim results fall into the promising zone, the sample size is increased; otherwise, it remains unchanged. We show through simulations that our proposed approach has greater overall power than the fixed sample design and similar power to the matched group sequential trial. Furthermore, we confirm that critical value adjustment effectively controls the type I error rate inflation. Finally, we provide recommendations on the implementation of our proposed method in cancer immunotherapy trials.

Conditional power (CP) serves as a widely utilized approach for futility monitoring in group sequential designs. However, adopting the CP methods may lead to inadequate control of the type II error rate at the desired level. In this study, we introduce a flexible beta spending function tailored to regulate the type II error rate while employing CP based on a predetermined standardized effect size for futility monitoring (a so-called CP-beta spending function). This function delineates the expenditure of type II error rate across the entirety of the trial. Unlike other existing beta spending functions, the CP-beta spending function seamlessly incorporates beta spending concept into the CP framework, facilitating precise stagewise control of the type II error rate during futility monitoring. In addition, the stopping boundaries derived from the CP-beta spending function can be calculated via integration akin to other traditional beta spending function methods. Furthermore, the proposed CP-beta spending function accommodates various thresholds on the CP-scale at different stages of the trial, ensuring its adaptability across different information time scenarios. These attributes render the CP-beta spending function competitive among other forms of beta spending functions, making it applicable to any trials in group sequential designs with straightforward implementation. Both simulation study and example from an acute ischemic stroke trial demonstrate that the proposed method accurately captures expected power, even when the initially determined sample size does not consider futility stopping, and exhibits a good performance in maintaining overall type I error rates for evident futility.

Common statistical theory applicable to confirmatory phase III trial designs usually assumes that patients are enrolled simultaneously and there is no time gap between enrollment and outcome observation. However, in practice, patients are enrolled successively and there is a lag between the enrollment of a patient and the measurement of the primary outcome. For single-stage designs, the difference between theory and practice only impacts on the trial duration but not on the statistical analysis and its interpretation. For designs with interim analyses, however, the number of patients already enrolled into the trial and the number of patients with available outcome measurements differ, which can cause issues regarding the statistical analyses of the data. The main issue is that current methodologies either imply that at the time of the interim analysis there are so-called pipeline patients whose data are not used to make a statistical decision (like stopping early for efficacy) or the enrollment into the trial needs to be at least paused for interim analysis to avoid pipeline patients. There are methods for delayed responses available that introduced error-spending stopping boundaries for the enrollment of patients followed by critical values to reject the null hypothesis in case the stopping boundaries have been crossed beforehand. Here, we will discuss other solutions, considering different boundary determination algorithms using conditional power and introducing a design allowing for recruitment restart while keeping the type I error rate controlled.

Adaptive designs, such as group sequential designs (and the ones with additional adaptive features) or adaptive platform trials, have been quintessential efficient design strategies in trials of unmet medical needs, especially for generating evidence from global regions. Such designs allow interim decision making and making adjustment to study design when necessary, meanwhile maintaining study integrity and operating characteristics. However, driven by the heightened competitive landscape and the desire to bring effective treatment to patients faster, innovation in the already functional designs is still germane to further propel drug development to a more efficient path. One way to achieve this is by leveraging external real-world data (RWD) in the adaptive designs to support interim or final decision making. In this paper, we propose a novel framework of incorporating external RWD in adaptive design to improve interim and/or final analysis decision making. Within this framework, researchers can prespecify the decision process and choose the timing and amount of borrowing while maintaining objectivity and controlling of type I error. Simulation studies in various scenarios are provided to describe power, type I error, and other performance metrics for interim/final decision making. A case study in non-small cell lung cancer is used for illustration on proposed design framework.

There are very rich publications devoted to group sequential design, adaptive design and trial monitoring for continuous, binary and time to event endpoints. Many authors also discuss fixed design, blinded sample size re-estimation design and group sequential design for studies with a negative binomial outcome. Nonetheless, literature is sparse in adaptive design for a trial with a negative binomial endpoint. The features of such an endpoint in a flexible trial design setting remains inadequately understood. In this research, we seek to bridge this knowledge gap by offering a thorough examination of utilizing data components from a two-stage adaptive design for unblinded conditional power calculation and corresponding sample size re-estimation. We also provide expression for calculating the probability of meeting the futility criterion to determine the appropriate timing for the interim analysis. To evaluate the performance of the design, we conduct simulations to assess its operation characteristics. Finally, we provide a helpful and illustrative example to demonstrate the practical applications of the methods.

Seamless phase 2/3 design has become increasingly popular in clinical trials with a single endpoint. Trials that define success based on the achievement of all co-primary endpoints (CPEs) encounter the challenge of inflated type 2 error rates, often leading to an overly large sample size. To tackle this challenge, we introduced a seamless phase 2/3 design strategy that employs Bayesian predictive power (BPP) for futility monitoring and sample size re-estimation at interim analysis. The correlations among multiple CPEs are incorporated using a Dirichlet-multinomial distribution. An alternative approach based on conditional power (CP) was also discussed for comparison. A seamless phase 2/3 vaccine trial employing four binary endpoints under the non-inferior hypothesis serves as an example. Our results spotlight that, in scenarios with relatively small phase 2 sample sizes (e.g., 50 or 100 subjects), the BPP approach either outperforms or matches the CP approach in terms of overall power. Particularly, with n1 = 50 and ρ = 0, BPP showcases an overall power advantage over CP by as much as 8.54%. Furthermore, when the phase 2 stage enrolled more subjects (e.g., 150 or 200), especially with a phase 2 sample size of 200 and ρ = 0, the BPP approach evidences a peak difference of 5.76% in early stop probability over the CP approach, emphasizing its better efficiency in terminating futile trials. It\'s noteworthy that both BPP and CP methodologies maintained type 1 error rates under 2.5%. In conclusion, the integration of the Dirichlet-Multinominal model with the BPP approach offers improvement in certain scenarios over the CP approach for seamless phase 2/3 trials with multiple CPEs.

Random coefficient (RC) models are commonly used in clinical trials to estimate the rate of change over time in longitudinal data. Trials utilizing a surrogate endpoint for accelerated approval with a confirmatory longitudinal endpoint to show clinical benefit is a strategy implemented across various therapeutic areas, including immunoglobulin A nephropathy. Understanding conditional power (CP) and information fraction calculations of RC models may help in the design of clinical trials as well as provide support for the confirmatory endpoint at the time of accelerated approval. This paper provides calculation methods, with practical examples, for determining CP at an interim analysis for a RC model with longitudinal data, such as estimated glomerular filtration rate (eGFR) assessments to measure rate of change in eGFR slope.

Conditional power (CP) is a commonly used tool to inform interim decision-making in clinical trials, but the conventional approach using only primary endpoint data to calculate CP may not perform well when the primary endpoint requires a long follow-up period, or the treatment effect size changes during the trial. Several methods have been proposed to use additional short term auxiliary data observed at the interim analysis to improve the CP estimation in these situations, however, they may rely on strong assumptions, have limited applications, or use ad hoc choices of information fraction. In this paper we propose a general framework where the true CP formula is first derived in the presence of auxiliary data, and CP estimation is obtained by substituting the unknown parameters with consistent estimators. We conducted extensive simulations to examine the performance of both proposed and conventional approaches using the true CP as the benchmark. As the proposed approach is based on the true underlying CP, the simulations confirmed its superiority over the conventional approach in terms of efficiency and accuracy, especially if observed auxiliary data reflect the change of treatment effect size. The simulations also indicate that the magnitude of improvement in CP estimation is associated with the correlation between auxiliary and primary endpoints and/or the magnitude of the effect size change during the trial.