Home |
Current Issue |
Past Issues |
In the Clinic |
ACP Journal Club |
CME |
Collections |
Audio/Video |
Mobile |
Subscribe |
Tools |
Help |
ACP Online
|
15 May 1994 | Volume 120 Issue 10 | Pages 876-881
The Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries (GUSTO) trial, a recent randomized "megatrial" of thrombolytic therapies in acute myocardial infarction, showed a statistically significant decrease of 30-day mortality in patients treated with accelerated-dose tissue plasminogen activator (tPA) compared with streptokinase. The therapeutic and cost implications of the results have been intensely scrutinized, and several commentaries have been written on the interpretation of the study. Questions have been raised about the treatment benefit in certain subgroups, the validity of the results because of the open-label design, the relevance of a 1% absolute benefit in mortality rates, the cost-effectiveness of the drug, and the generalizability of the results. These issues are all important considerations for translating the results of this study into clinical practice worldwide.
This article sheds additional light on the interpretation of GUSTO, clarifies misconceptions that may have clouded understanding of the trial results, and discusses the contributions of this trial in advancing our understanding of modern myocardial reperfusion therapy.
In the GUSTO trial, 41021 patients with acute myocardial infarction, presenting with ST-segment elevation within 6 hours of symptom onset, were randomly allocated to four thrombolytic strategies: streptokinase with subcutaneous heparin, streptokinase with intravenous heparin, accelerated-dose tissue plasminogen activator (tPA) with intravenous heparin, and the combination of streptokinase and tPA with intravenous heparin. Complete details about the thrombolytic agent and heparin dose regimen in each treatment arm, as well as about other adjunctive therapy, are contained in the recent GUSTO report [1]. For the primary end point of 30-day mortality, the results are given in Table 1. No significant difference between the two streptokinase strategies was noted (P = 0.731). Accelerated-dose tPA led to a 14% (95% CI, 5.9% to 21.3%) decrease in mortality compared with the two streptokinase strategies combined (7.3% compared with 6.3%, P = 0.001); a mortality benefit was also noted when tPA was compared with each streptokinase strategy separately (tPA compared with streptokinase with intravenous heparin, P = 0.003; tPA compared with streptokinase with subcutaneous heparin, P = 0.009). No significant difference in mortality was noted between the thrombolytic arm involving both streptokinase and tPA and the strategies involving streptokinase monotherapy (P = 0.352); however, a marginally significant difference was noted in 30-day mortality between accelerated-dose tPA and combination therapy with streptokinase and tPA (P = 0.04). As reported by the GUSTO investigators [1], an excess was noted of approximately 2 hemorrhagic strokes per 1000 patients treated with accelerated-dose tPA compared with streptokinase, but an overall statistically significant benefit was noted for accelerated-dose tPA compared with each of the streptokinase strategies for the combined end points of mortality plus any nonfatal stroke, mortality plus nonfatal hemorrhagic stroke, and mortality plus nonfatal disabling stroke. IN THE BALANCE
Holding GUSTO Up to the Light
Within a few days after the publication, on 2 September 1993, of the major results from the Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries (GUSTO) trial [1], several commentaries and editorials appeared that offered various interpretations of the data [2-4]. One article by Ridker and colleagues [4], which discussed GUSTO in the context of two other large-scale trials of thrombolytic therapy, was published in the 15 September 1993 issue of Annals. Although critical evaluation of studies such as GUSTO is essential to advancing scientific understanding and should be encouraged, the latter editorial (as well as other commentaries) contains information about the trial that is either incorrect, ambiguous, or potentially misleading. Our purpose in this article is to clarify misconceptions that might exist about the GUSTO trial, to correct inaccurate published statements, and to contribute additional perspective to the overall interpretation of the trial results.
|
Consistency of Results Across Subgroups
|
|---|
Of particular concern is the approach of comparing treatments within selected subgroups (particularly subgroups with considerably fewer patients than the overall trial), of finding that the P value does not achieve conventional significance, and of concluding that no treatment benefit exists for the patients in those particular subgroups. A study is generally never designed with sufficient patients in all major subgroups of interest to provide adequate power for statistically detecting clinically important treatment differences when treatments are compared within the individual subgroups. In the landmark Gruppo Italiano per lo Studio della Streptochinasi nell'Infarto Miocardico (GISSI-1) trial [10], although clear evidence was given that, overall, streptokinase achieved a statistically significant decrease in mortality compared with placebo, this effect was not statistically significant if one examined, for example, just the elderly (older than 65 years), or women, or those treated after 6 hours. This observation does not imply, however, that the treatment is of no benefit to patients in those particular subgroups. Given the number of patients in the GUSTO trial treated 4 or more hours after symptom onset, the power to detect a 1% mortality difference in that subgroup is less than 35%. Rather than statistically comparing treatments within multiple individual subgroups, it is more relevant to examine the direction of the treatment differences and the consistency of the estimate of treatment benefit across subgroups. This evaluation can be done quantitatively by carefully assessing whether interactions exist between treatment and specific patient strata (for example, by statistically assessing whether the relative benefit of a treatment varies across specific characteristics of the patients). Judgments about heterogeneity in treatment effects across specific subgroups should not be made by simply testing whether treatment differences achieve conventional significance within each individual subgroup.
Ridker and colleagues [4] provide misleading results when they claim that "for the more than 9000 patients in GUSTO-1 who were treated 4 or more hours after symptom onset, mortality was nonsignificantly lower among patients receiving streptokinase with subcutaneous heparin compared with those receiving accelerated-dose tPA with intravenous heparin". As shown in the published report from the GUSTO investigators [1], nearly 8000 (85%) of the 9400 patients treated 4 or more hours after symptom onset were treated within 6 hours. For patients treated 4 to 6 hours after symptom onset, the mortality rate was nonsignificantly lower in the accelerated-dose tPA arm than in the streptokinase arms (8.9% compared with 9.3%). Although this difference is smaller than the overall mortality benefit observed in the trial and does not achieve statistical significance if compared within this stratum (P = 0.256), it is not correct to conclude there is no benefit of tPA for patients treated 4 to 6 hours after symptom onset and to claim that the mortality is lower among patients treated with streptokinase. Less benefit may exist for tPA among patients enrolled within this time interval, and the data do suggest that the benefit diminishes as the time to treatment increases. However, less benefit in these smaller subgroups does not imply no benefit. It is only in the small number of patients treated after 6 hours that an indication exists of a possible lower mortality rate in streptokinase-treated patients. The mortality numbers we have quoted above for streptokinase patients treated 4 hours or more after symptom onset were taken from the published GUSTO report [1] and are the results in the pooled group of streptokinase patients. The discussion by Ridker and colleagues, however, refers to patients treated with streptokinase and subcutaneous heparin. Because the mortality in patients treated 4 hours or more from symptom onset with streptokinase and subcutaneous heparin was actually slightly higher than in the pooled streptokinase group, the argument above also applies if one considers tPA relative to streptokinase with subcutaneous heparin.
A further point made by Ridker and associates [4] and others [3] is that the patients in GUSTO were treated quite early and thus perhaps the study findings would not be generalizable. The median time to randomization in GUSTO was 2.0 hours, and the median time to treatment was 2.8 hours. Additional perspective on those figures can be obtained from comparative patients in Gruppo Italiano per lo Studio della Sopravvivenza nell'Infarto Miocardico (GISSI-2) and its International Study Group extension, the only other large-scale comparative trial of thrombolytic agents where patients were enrolled within a 6-hour time window [11, 12]. Those investigators reported time to randomization (rather than time to treatment) as shown in Table 2.
|
The GUSTO trial actually enrolled a lower percentage of its patients within the first hour than did GISSI-2, and the proportion of patients enrolled within 3 hours of symptom onset was similar in the studies. The issue of generalizability because of the relatively short time to treatment thus applies equally to both studies. However, given the current state of our knowledge of reperfusion therapy in acute myocardial infarction, no disagreement should exist that the goal of therapy is to treat patients early. In fact, widespread recognition of this need has stimulated national initiatives to study factors that impede rapid access to thrombolysis. In GUSTO, patients were enrolled from 1081 hospitals in 15 different countries, and most of those hospitals were community based. In North America, less than half of GUSTO sites had previously participated in a clinical trial involving patients with acute myocardial infarction. Hospitals participating in GUSTO, at least in the higher enrolling countries, were a representative cross-section of typical health care settings in which patients with acute myocardial infarctions are treated. With the increasing emphasis on treating patients earlier after symptom onset, and with education and a heightened awareness about decreasing the time to treatment, the results of studies such as GUSTO and GISSI-2 are even more relevant.
Ridker and colleagues claim that the benefit of accelerated-dose tPA observed in GUSTO was restricted to patients treated within the United States. In GUSTO, as in any large international trial, some degree of country-to-country variation exists in clinical event rates, and such variation is expected among geographically defined subgroups. Indeed, observations about intercountry variation have been reported from the International TPA and Streptokinase Mortality Trial [13]. Ridker and colleagues correctly point out that the observed mortality difference between patients receiving accelerated-dose tPA and those receiving streptokinase was larger and more statistically significant among U.S. patients (17% decrease; 1.2% absolute difference) than among non-U.S. patients (7% decrease; 0.5% absolute difference). A larger treatment difference was observed in the United States despite the fact that mortality among streptokinase-treated patients was lower in the United States than elsewhere (7.1% compared with 7.6%). To aid in judging whether the U.S. compared with non-U.S. variation in the benefit of accelerated-dose tPA compared with streptokinase represents real or random fluctuation, we used logistic regression analysis and examined the data for a treatment by country interaction. The test for whether tPA had a different effect compared with streptokinase in U.S. compared with non-U.S. patients yielded a P value of 0.304. Thus, although the variation observed in different health care settings is interesting and deserves thoughtful reflection, the U.S. compared with non-U.S. variation observed in GUSTO about the benefit of tPA compared with streptokinase falls within the range of what one could expect from the play of chance.
Other analyses done to assess the degree of heterogeneity of the treatment benefit across subgroups other than those defined by country and time to treatment showed a striking consistency of the treatment effects across subgroups defined by age, sex, infarction location, risk factors (hypertension, diabetes, history of smoking, and hypercholesterolemia), baseline medical history (previous myocardial infarction, coronary artery bypass surgery, or percutaneous transluminal coronary angioplasty), and presenting characteristics (blood pressure, heart rate, and Killip class). Certainly it is true that within particular subgroups (especially those with relatively small numbers of patients), treatment differences may not be statistically significant using conventional criteria for significance. However, as clearly advocated by the ISIS investigators [7] and emphasized by other clinicians involved in the clinical trials [9], where there is little evidence of any real heterogeneity (as occurred in GUSTO), more weight should be given to the overall results of the trial than to the apparent effect observed within a particular subgroup.
For clinicians faced with the responsibility of applying the results of these trials to individual patients, interpreting subgroup analyses can be a particularly vexing challenge. Individual patients obviously reflect a combination of clinical factors that influence prognosis. A given patient may fall into a low-risk subgroup on the basis of one factor or a high-risk subgroup on the basis of another factor, and have varying degrees of risk conferred by virtue of other characteristics. Along with a complete assessment of the randomized treatment comparisons in these trials, carefully developed statistical models that take into account multiple patient characteristics (which we are currently developing with the GUSTO data) can be usefully applied to estimate the risk of an event for an individual patient.
Unblinded Design
|
|---|
In considering the validity of the open-label design of GUSTO, it is important to keep in mind several points: 1) Patients enrolled in GUSTO were randomly allocated to the treatment arms, thus eliminating bias in the selection of thrombolytic therapy; 2) treatments were compared according to intention to treat; 3) compliance with the assigned thrombolytic therapy occurred in 98% of patients in each treatment arm; and 4) with a primary end point that involved the most objective assessment possible (namely, whether the patient was dead or alive at 30 days), this information could be (and was) collected in an unbiased and impartial way.
For the important secondary outcomes involving stroke incidence, data (consisting of computerized axial tomography of the head, magnetic resonance imaging, or autopsy in 94% of all patients where a focal neurologic dysfunction was noted) were independently examined by a stroke review committee, the members of which were fully blinded to treatment. Additionally, end point information (indeed, all patient information collected in the trial) was obtained and processed independently of the sponsors [15]. Furthermore, on-site monitoring of all submitted data, including comparisons and cross-checking with source documentation in the hospital medical records, was done in a randomly selected sample of over 10% of the patients. Every hospital participating in the trial had a sample of their patients monitored. In a trial where double-blinding was not practical without adding enormously to the complexity and expense of the study, it is difficult to conceive of any greater safeguards to ensure the quality and completeness of the data than were built into the conduct of GUSTO.
As further support to the credibility of the GUSTO mortality results, the GUSTO angiographic substudy (which conclusively showed a higher patency rate of the infarction-related artery at 90 minutes with accelerated-dose tPA) provides a logical pathophysiologic explanation for the effect of accelerated-dose tPA in decreasing mortality [16].
In connection with the issue of an open-label design, Ridker and colleagues suggest that the clinical benefits observed in GUSTO may be attributable to the fact that a higher proportion of patients treated with accelerated-dose tPA had coronary artery bypass surgery than did patients treated with streptokinase (9.0% compared with 8.3%). However, additional analyses showed that the difference in surgical procedures cannot be the explanation for the tPA benefit. Among GUSTO patients who did not have coronary artery bypass surgery during their hospitalization, 30-day mortality was 6.5% in patients treated with accelerated-dose tPA and 7.6% in patients treated with streptokinase, a highly statistically significant difference (P < 0.001). Among the small group of patients who did have bypass surgery during hospitalization, the observed 30-day mortality was similar for accelerated-dose tPA and streptokinase (4.0% compared with 4.1%, respectively). In regression analyses of these data, accelerated-dose tPA was still beneficial (P = 0.001) after adjusting for the effects of bypass surgery and for numerous other baseline prognostic factors. Interpretation of these data about the influence of bypass surgery on mortality must be made cautiously because bypass surgery is not a baseline variable and its occurrence may be influenced by patient selection or other clinical events after randomization. Nevertheless, the treatment benefit cannot be attributed to the slightly higher rate of bypass surgery among tPA-treated patients.
Compliance Issues
|
|---|
Magnitude of the Treatment Differences
|
|---|
Concerning the statistical significance of treatment differences, it is noteworthy that even at the first major prespecified interim efficacy analysis, when key outcome data were prepared for confidential review by the GUSTO Data and Safety Monitoring Board (which occurred when slightly more than 10 000 patients had been enrolled), the difference between accelerated-dose tPA and the better of the two streptokinase arms was statistically significant if judged only by the conventional 0.05 level criterion. The trial was continued, however, because, among other reasons, the relatively stringent O'Brien-Fleming group-sequential stopping boundaries prespecified in the interim analysis plan had not been crossed [18, 19]. The apparent benefit of tPA appeared relatively early and was maintained at subsequent interim analyses throughout the trial.
Cost-Effectiveness
|
|---|
Combining GUSTO Data with Other Trials
|
|---|
|
Comparing treatment effects among the three trials (for example, using logistic regression), an interaction [P = 0.012] exists between the effect of treatment and study. The effect of tPA compared with streptokinase is statistically different in GUSTO compared with that observed in the other studies. Combining data from the three studies for the purpose of judging the benefit of tPA compared with streptokinase is thus problematic. Important conclusions that can be derived from these three studies, however, are 1) the GISSI-2 International and ISIS-3 trials provide clear evidence that standard-dose tPA given with subcutaneous heparin has no mortality advantage compared with streptokinase and 2) GUSTO provides clear evidence that accelerated-dose tPA given with intravenous heparin does decrease mortality. There is neither a biological nor a statistical basis for combining dissimilar studies and clouding the clarity of these conclusions. We agree with Ridker and colleagues that early treatment is important, and considerations of which thrombolytic agent to give should not delay the initiation of treatment.
One (Not Two) Accelerated-Dose Tissue Plasminogen Activator Arms
|
|---|
Final Comment
|
|---|
Author and Article Information
|
|---|
|
|
|---|
References
|
|---|
|
|
|---|
1. The GUSTO investigators. An international randomized trial comparing four thrombolytic strategies for acute myocardial infarction. N Engl J Med. 1993; 329:673-82.
2. Rapaport E. GUSTO: Assessment of the preliminary results. J Myocard Ischemia. 1993; 5:15-24.
3. Sleight P. Thrombolysis after GUSTO: A European perspective. J Myocard Ischemia. 1993; 5:25-30.
4. Ridker PM, O'Donnell C, Marder VJ, Hennekens CH. Large-scale trials of thrombolytic therapy for acute myocardial infarction: GISSI-2, ISIS-3, and GUSTO-1 (Editorial). Ann Intern Med. 1993; 119:530-2.
5. Fuster V. Coronary thrombolysis-a perspective for the practicing physician (Editorial). N Engl J Med. 1993; 329:723-5.
6. Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, Howard SV, et al. Design and analysis of randomized clinical trials requiring prolonged observation of each patient. II. Analysis and examples. Br J Cancer. 1977; 35:1-39.
7. ISIS-2 (Second International Study of Infarct Survival) Collaborative Group. Randomised trial of intravenous streptokinase, oral aspirin, both, or neither among 17 187 cases of suspected acute myocardial infarction: ISIS-2. Lancet. 1988; 2:349-60.
8. Lee KL, McNeer JF, Starmer CF, Harris PJ, Rosati RA. Clinical judgment and statistics. Lessons from a simulated randomized trial in coronary artery disease. Circulation. 1980; 61:508-15.
9. Yusuf S, Wittes J, Probstfield J, Tyroler HA. Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials. JAMA. 1991; 266:93-8.
10. Gruppo Italiano per lo Studio della Streptochinasi nell'Infarto Miocardico (GISSI). Effectiveness of intravenous thrombolytic treatment in acute myocardial infarction. Lancet. 1986; 1:397-402.
11. Gruppo Italiano per lo Studio della Sopravvivenza nell'Infarto Miocardico. GISSI-2: a factorial randomized trial of alteplase versus streptokinase and heparin versus no heparin among 12 490 patients with acute myocardial infarction. Lancet. 1990; 336:65-71.
12. The International Study Group. In-hospital mortality and clinical course of 20 891 patients with suspected acute myocardial infarction randomised between alteplase and streptokinase with or without heparin. Lancet. 1990; 336:71-9.
13. Barbash GI, Modan M, Goldbourt U, White HD, Van de Werf F. Comparative case fatality analysis of the International Tissue Plasminogen Activator/Streptokinose Mortality Trial: variation by country beyond predictive profile. The Investigators of the International Tissue Plasminogen Activator/Streptokinase Mortality Trial. J Am Coll Cardiol. 1993; 21:281-6.
14. ISIS-3 (Third International Study of Infarct Survival) Collaborative Group. ISIS-3: a randomised comparison of streptokinese vs tissue plasminogen activator vs anistreplase and of aspirin plus heparin vs aspirin alone among 41 299 cases of suspected acute myocardial infarction. Lancet. 1992; 339:753-70.
15. Topol EJ, Armstrong P, Van de Werf F, Kleiman N, Lee K, Morris D, et al. Confronting the issues of patient safety and investigator conflict of interest in an international clinical trial of myocardial reperfusion. Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries (GUSTO) Steering Committee. J Am Coll Cardiol. 1992; 19:1123-8.
16. The effects of tissue plasminogen activator, streptokinase, or both on coronary-artery patency, ventricular function, and survival after acute myocardial infarction. The GUSTO Angiographic Investigators. N Engl J Med. 1993; 329:1615-22.
17. Indications for fibrinolytic therapy in suspected acute myocardial infarction: collaborative overview of mortality and major morbidity results from all randomized trials of more than 1000 patients. Fibrinolytic Therapy Trialists' (FTT) Collaborative Group. Lancet. 1994; 343:311-22.
18. O'Brien PC, Fleming TR. A multiple testing procedure for clinical trials. Biometrics. 1979; 35:549-56.
19. Lan KK, DeMets DL. Discrete sequential boundaries for clinical trials. Biometrika. 1983; 70:659-63.
20. Conti RC. Myocardial infarction, thrombolytic therapy, and economics (Editorial). Clin Cardiol. 1993; 16:635.
21. Neuhaus KL, Feuerer W, Jeep-Tebbe S, Niederer W, Vogt A, Tebbe U. Improved thrombolysis with a modified dose regimen of recombinant tissue-type plasminogen activator. J Am Coll Cardiol. 1989; 14:1566-9.
22. Neuhaus KL, von Essen R, Tebbe U, Vogt A, Roth M, Riess M, et al. Improved thrombolysis in acute myocardial infarction with front-loaded administration of alteplase: results of the rt-PA-APSAC patency study (TAPS). J Am Coll Cardiol. 1992; 19:885-91.
Related articles in Annals:
This article has been cited by other articles:
![]() |
T. WALLEY, Y. DUNDAR, R. HILL, and R. DICKSON Superiority and equivalence in thrombolytic drugs: an interpretation QJM, February 1, 2003; 96(2): 155 - 160. [Full Text] [PDF] |
||||
![]() |
S. Frei, J. Brophy, F. Andreotti, C. D. Thron, E. J. Topol, R. M. Califf, R. Wilcox, The GUSTO III Steering Committee, F. Van de Werf, The COBALT Investigators, et al. Thrombolytic Therapy for Myocardial Infarction N. Engl. J. Med., February 19, 1998; 338(8): 545 - 548. [Full Text] |
||||
![]() |
E. J. Topol, R. M. Califf, F. Van de Werf, M. Simoons, J. Hampton, K. L. Lee, H. White, J. Simes, and P. W. Armstrong Perspectives on Large-Scale Cardiovascular Clinical Trials for the New Millennium Circulation, February 18, 1997; 95(4): 1072 - 1082. [Full Text] |
||||
![]() |
L. Pilote, D. P. Miller, R. M. Califf, J. S. Rao, W. D. Weaver, and E. J. Topol Determinants of the Use of Coronary Angiography and Revascularization after Thrombolysis for Acute Myocardial Infarction N. Engl. J. Med., October 17, 1996; 335(16): 1198 - 1205. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Roberts La Difference: Long-term Benefit of One Thrombolytic Over Another Circulation, September 15, 1996; 94(6): 1203 - 1205. [Full Text] |
||||
![]() |
R. M. Califf, H. D. White, F. Van de Werf, Z. Sadowski, P. W. Armstrong, A. Vahanian, M. L. Simoons, R. J. Simes, K. L. Lee, and E. J. Topol One-Year Results From the Global Utilization of Streptokinase and TPA for Occluded Coronary Arteries (GUSTO-I) Trial Circulation, September 15, 1996; 94(6): 1233 - 1238. [Abstract] [Full Text] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||