Adaptive designs for time-to-event trials

Size: px

Start display at page:

Download "Adaptive designs for time-to-event trials"

Arron Palmer
9 years ago
Views:

1 Adaptive designs for time-to-event trials Dominic Magirr 1, Thomas Jaki 1, Franz König 2 and Martin Posch 2 1 Department of Mathematics and Statistics, Lancaster University 2 Institut für Medizinische Statistik, Medical University of Vienna January 2014

Mathematics and Statistics, Lancaster University 2 Institut für

2 Outline Motivating example Adaptive methods Ignored data

3 Lung cancer trial (Schäfer and Müller, 2001) Patients randomized to Radiotherapy + Chemotherapy (E) or Chemotherapy (C) Median survival on C 14 months Anticipated survival on E 20 months Sample size: 255 deaths (α = 0.025, β = 0.2) Exponential model... this could be achieved with 40 months recruitment and 20 months min follow-up.

survival on E 20 months Sample size: 255 deaths (α = 0.025, β = 0.

4 40 months into the trial... (a) patient recruitment was much slower than expected only 136 patients had been randomized (b) the hazard rate had been over-estimated in the planning only 56 deaths had been observed Recommendation of Schäfer and Müller: abandon the trial because there [is] no chance of achieving the planned sample size within a reasonable time

randomized (b) the hazard rate had been over-estimated in the planning only 56 deaths had

5 Counterproposal of study group Look at the data to see if there is a larger treatment effect than originally anticipated. If so, reduce the initially planned sample size (required number of events). Larger the observed treatment effect earlier the study ends.

If so, reduce the initially planned sample size (required number

6 Reverse scenario (Irle & Schäfer, 2012) Look at data to see if there is a smaller than anticipated treatment effect. If so, increase the sample size (required number of events) to give a better chance of achieving a statistically significant result. Standard analysis will not control the type I error rate...

If so, increase the sample size (required number of events) to give a better

7 Adaptive design with immediate responses int X 1 Enrollment & follow-up Y Enrollment & follow-up Interim Analysis Final Analysis E.g., under H 0, Calendar time 1 2 Φ 1 { 1 p 1 (X int 1 ) } Φ 1 {1 p 2 (Y )} N (0, 1)

8 Adaptive design with delayed responses int X 1 Y Enrollment & follow-up Follow-up Enrollment & follow-up Follow-up Interim Analysis Final Analysis Calendar time 1 2 Φ 1 { 1 p 1 (X int 1 ) } Φ 1 {1 p 2 (Y )}? N (0, 1)

Follow-up Interim Analysis Final Analysis Calendar time

9 When is this valid? Interim decision strategy based solely on (primary endpoint) treatment effect estimate. Interim decisions are based on partial information from patients who are yet to provide full primary endpoint response e.g. second-stage sample size is chosen on basis of progression-free survival when primary endpoint is overall survival.

Interim decisions are based on partial information from patients who are yet to

10 Potential solution X 1 Enrollment & follow-up Follow-up Y Enrollment & follow-up Follow-up Interim Analysis Final Analysis Calendar time 1 2 Φ 1 {1 p 1 (X 1 )} Φ 1 {1 p 2 (Y )} N (0, 1) e.g., Liu & Pledger (2005) Gaussian responses Schmidli, Bretz & Racine-Poon (2007) Binary responses

1 {1 p 1 (X 1 )} + 1 2 Φ 1 {1 p 2 (Y )} N (0, 1) e.g.

11 Extra problem with time-to-event endpoint? Jenkins, Stone & Jennison (2011); Irle & Schäfer (2012) X 1 Enrollment & follow-up Follow-up Unspecified follow-up Y Enrollment & follow-up Follow-up Interim Analysis T 1 Final Analysis Calendar time Must pre-specify end of follow-up of first-stage patients, T 1, in definition of p 1. Otherwise, p 1 (X 1 ) x U[0, 1] under H 0, and type I error may be inflated.

Unspecified follow-up Y Enrollment & follow-up Follow-up Interim Analysis T 1 Final Analysis Calendar

12 Data is thrown away Final test decision only depends on a subset of the recorded survival times; part of the observed data is ignored. Particularly damaging if long-term survival is of most concern (it is the survival times of earliest recruited patients that is ignored). Therefore, we investigated the effect of naïvely incorporating this illegitimate data into the final test statistic...

Particularly damaging if long-term survival is of most concern (it is the survival times of

13 Adaptive log-rank test Correct adaptive test statistic Z CORRECT = w 1 L 1 (T 1 ) + w 2 Φ 1 (1 p 2 ) Naïve adaptive test statistic Z NAIVE = w 1 L 1 (T ) + w 2 Φ 1 (1 p 2 ) L 1 (t) is the log-rank statistic based on Stage 1 patients, followed up until calendar time t. w i are explicitly (Jenkins et al.) or implicitly (Irle & Schäfer) fixed weights with w w 2 2 = 1. T 1 is the (implicitly) fixed end of first-stage follow up. T is the time of final analysis (dependent on interim decisions).

until calendar time t. w i are explicitly (Jenkins et al.

14 Worst-case assumption The null distribution of Z CORRECT is N (0, 1). The null distribution of Z NAIVE is completely unknown. However, we can look at the stochastic process Z(t) = w 1 L 1 (t) + w 2 Φ 1 (1 p 2 ), t [T 1, T max ]. Worst-case: the interim data (PFS, early endpoints, etc) can be used to predict exactly when L 1 (t) reaches its maximum.

However, we can look at the stochastic process Z(t) = w 1 L 1 (t) + w 2 Φ 1 (1 p 2 ), t

15 Upper bound on type I error An upper bound can be found assuming second-stage design is engineered such that T coincides with arg max L 1 (t): } max α = P H0 {max w 1 L 1 (t) + w 2 Φ 1 (1 p 2 ) > 1.96 t T 1 = 1 0 P H0 [ 1 max B(u) > u u=u 1 { w2 Φ 1 (x) } ] w 1 dx, with u 1 = {# stage 1 deaths at T 1 } / {# stage 1 deaths at T max }

(t) + w 2 Φ 1 (1 p 2 ) > 1.96 t T 1 = 1 0 P H0 [ 1 max B(u) > u u=u 1 { 1.

16 w u 1 Figure: Worst case type I error for various choices of weights and information fractions.

17 Irle & Schäfer example revisited Original trial design: deaths; 40 months recruitment; 20 months min follow-up. Interim analysis after 23 months: patients recruited; 60 deaths. - Treatment effect in terms of PFS less impressive than expected. - Decision made to increase required number of deaths from 248 to 400. At calendar time T 1 60 months: first-stage patient deaths; 78 second-stage patient deaths. - u 1 = 170/190; w 1 = 170/248; max α =

- Treatment effect in terms of PFS less impressive than expected.

18 Guaranteed level-α test Simply increase cut-off such that P H0 {max t T1 Z(t) k } = α. In assessing the effect on power, four relevant probabilities are: ( A. P θ=θr Z CORRECT > 1.96 ) ( B. P θ=θr Z CORRECT > k ) C. P θ=θr {Z(T max ) > k } D. P θ=θr {max t T1 Z(t) > k }

19 Power Power p 2 p 2 (a) (b) Figure: Conditional power as defined by A (thin line), B (medium line), C (thick line) and D (dashed line) given p 2, under two scenarios. (a): u 1 = 170/190, w 1 = (170/248) 1/2 and θ R = (b): u 1 = 147/288, w 1 = (147/248) 1/2 and θ R = 0.36.

20 Conclusion: methods trade-off Type I Informed interim All survival Power control decisions times in test Independent increments Correct adaptive Naïve adaptive Naïve + k Other research avenue: use joint distribution of, e.g., PFS and overall survival.

increments Correct adaptive Naïve adaptive Naïve + k Other

21 References 1. Schäfer, H., & Müller, H. H. (2001). Modification of the sample size and the schedule of interim analyses in survival trials based on data inspections. Statistics in medicine, 20(24), Irle, S., & Schäfer, H. (2012). Interim Design Modifications in Time-to-Event Studies. Journal of the American Statistical Association, 107(497), Liu, Q., & Pledger, G. W. (2005). Phase 2 and 3 combination designs to accelerate drug development. Journal of the American Statistical Association, 100(470). 4. Schmidli, H., Bretz, F., & Racine-Poon, A. (2007). Bayesian predictive power for interim adaptation in seamless phase II/III trials where the endpoint is survival up to some specified timepoint. Statistics in medicine, 26(27), Jenkins, M., Stone, A., & Jennison, C. (2011). An adaptive seamless phase II/III design for oncology trials with subpopulation selection using correlated survival endpoints. Pharmaceutical statistics, 10(4),

Sequential Design of Phase II-III Cancer Trials

Sequential Design of Phase II-III Cancer Trials Tze Leung Lai 1,2, Philip W. Lavori 2,1 and Mei-Chiung Shih 2,3,, October 17, 2011 1 Department of Statistics, Stanford University, Stanford, CA 94305 2