Article    Table of Contents                    Full Text of this article    PDF of this article (PDFs free after 6 months)    Figures/Tables List  Services    Send comment/rapid response letter    Notify a friend about this article    Alert me when this article is cited    Add to Personal Archive    Download to Citation Manager    ACP Search                            Get Permissions  Google Scholar    Search for Related Content  PubMed Articles in PubMed by Author:    Greene, W. L.    Feinstein, A. R.    Related Articles in PubMed    PubMed Citation    PubMed

ACADEMIA AND CLINIC

Claims of Equivalence in Medical Research: Are They Supported by the Evidence?

William L. Greene, MD; John Concato, MD, MPH; and Alvan R. Feinstein, MD

2 May 2000 | Volume 132 Issue 9 | Pages 715-722

Background: Most clinical studies are done to show comparative superiority, but many reports now claim equivalence between the investigated entities. These assertions may not always be supported by the methods used and the results obtained.

Purpose: To assess the justification and support for claims of clinical or therapeutic equivalence in medical journals.

Data Sources: A search of MEDLINE for articles published from 1992 through 1996.

Study Selection: From 1209 citations that contained the word equivalence in the title or abstract or contained the Medical Subject Heading therapeutic equivalency, we excluded 1121 studies reporting nonoriginal research, purely laboratory or other nonhuman research, and studies in which equivalence was not the main claim. The remaining 88 eligible papers were evaluated for five methodologic attributes.

Data Synthesis: Only 45 (51%) of the 88 reports were specifically aimed at studying equivalence; the others either tried to show superiority or did not state a research aim. The quantitative distinctions regarded as "equivalent" ranged from 0% to 21% for direct increments and from 0% to 76% for proportionate differences. An equivalence boundary was set and confirmed with an appropriate statistical test in only 23% of reports. In 67% of reports, equivalence was declared after a failed test for comparative superiority, and in 10%, the claim of equivalence was not statistically evaluated. The sample size needed to confirm results had been calculated in advance for only 33% of reports. Sample size was 20 patients per group or fewer in 25% of reports.

Conclusions: Many studies of clinical equivalence do not set boundaries for equivalence. Claims of "difference" or "similarity" are often made not by thoughtful examination of the data but by tests of statistical significance that are often misapplied or accompanied by inadequate sample sizes. These methodologic flaws can lead to false claims, inconsistencies, and harm to patients.

Author and Article Information

From Yale University School of Medicine, New Haven, Connecticut; and West Haven Veterans Affairs Medical Center, Veterans Affairs Connecticut Healthcare System, West Haven, Connecticut.

Grant Support: Dr. Greene was a Robert Wood Johnson Clinical Scholar at Yale University School of Medicine at the time this work was done. Dr. Concato is supported by a Career Development Award from the Veterans Affairs Health Services Research and Development Service.

Requests for Single Reprints: William L. Greene, MD, Medical Affairs Department, Genentech, Inc., Mailstop 84, 1 DNA Way, South San Francisco, CA 94080; e-mail, wgreene{at}gene.com.

Requests To Purchase Bulk Reprints (minimum, 100 copies): the Reprints Coordinator; phone, 215-351-2657; e-mail, reprints{at}mail.acponline.org.

Current Author Addresses: Dr. Greene: Medical Affairs Department, Genentech, Inc., Mailstop 84, 1 DNA Way, South San Francisco, CA 94080.

Drs. Concato and Feinstein: Robert Wood Johnson Clinical Scholars Program, Yale University School of Medicine, 333 Cedar Street, SHM IE-61, New Haven, CT 06510.

This article has been cited by other articles:

				A. Covic, J. Cannata-Andia, G. Cancarini, R. Coppo, J. M. Frazao, D. Goldsmith, P. Ronco, G. B. Spasovski, P. Stenvinkel, C. Utas, et al. Biosimilars and biopharmaceuticals: what the nephrologists need to know--a position paper by the ERA-EDTA Council Nephrol. Dial. Transplant., October 2, 2008; (2008) gfn519v2. [Full Text] [PDF]

				B. Freidlin, E. L. Korn, S. L. George, and R. Gray Randomized Clinical Trial Design for Assessing Noninferiority When Superiority Is Expected J. Clin. Oncol., November 1, 2007; 25(31): 5019 - 5023. [Abstract] [Full Text] [PDF]

				M. Reddy, S. S. Gill, S. R. Kalkar, W. Wu, P. J. Anderson, and P. A. Rochon Oral Drug Therapy for Multiple Neglected Tropical Diseases: A Systematic Review JAMA, October 24, 2007; 298(16): 1911 - 1924. [Abstract] [Full Text] [PDF]

				P. Fueglistaler, M. Adamina, and U. Guller Non-Inferiority Trials in Surgical Oncology Ann. Surg. Oncol., May 1, 2007; 14(5): 1532 - 1539. [Abstract] [Full Text] [PDF]

				M. A. Puhan, G. Busching, H. J. Schunemann, E. vanOort, C. Zaugg, and M. Frey Interval versus Continuous High-Intensity Exercise in Chronic Obstructive Pulmonary Disease: A Randomized Trial Ann Intern Med, December 5, 2006; 145(11): 816 - 825. [Abstract] [Full Text] [PDF]

				S. Kaul and G. A. Diamond Good Enough: A Primer on the Analysis and Interpretation of Noninferiority Trials Ann Intern Med, July 4, 2006; 145(1): 62 - 69. [Abstract] [Full Text] [PDF]

				J. Tinmouth, G. Kandel, G. Tomlinson, S. Walmsley, A. H. Steinhart, and R. Glazier The Effect of Dairy Product Ingestion on Human Immunodeficiency Virus-Related Diarrhea in a Sample of Predominantly Gay Men: A Randomized, Controlled, Double-blind, Crossover Trial. Arch Intern Med, June 12, 2006; 166(11): 1178 - 1183. [Abstract] [Full Text] [PDF]

				A. Le Henanff, B. Giraudeau, G. Baron, and P. Ravaud Quality of Reporting of Noninferiority and Equivalence Randomized Trials JAMA, March 8, 2006; 295(10): 1147 - 1151. [Abstract] [Full Text] [PDF]

				G. Piaggio, D. R. Elbourne, D. G. Altman, S. J. Pocock, S. J. W. Evans, and for the CONSORT Group Reporting of Noninferiority and Equivalence Randomized Trials: An Extension of the CONSORT Statement JAMA, March 8, 2006; 295(10): 1152 - 1160. [Abstract] [Full Text] [PDF]

				B. C.-Y. Zee Planned Equivalence or Noninferiority Trials Versus Unplanned Noninferiority Claims: Are They Equal? J. Clin. Oncol., March 1, 2006; 24(7): 1026 - 1028. [Full Text] [PDF]

				B. Prigent An evaluation of class effect. Can. Med. Assoc. J., February 14, 2006; 174(4): 502 - 502. [Full Text] [PDF]

				J. Tinmouth, G. Tomlinson, N. Dalibon, M. Moutafis, M. Fischler, H. Nelson, and D. J. Sargent Laparoscopically Assisted versus Open Colectomy for Colon Cancer N. Engl. J. Med., August 26, 2004; 351(9): 933 - 934. [Full Text] [PDF]

				D. M. Kent, A. M. Fendrick, and K. M. Langa New and Dis-Improved: On the Evaluation and Use of Less Effective, Less Expensive Medical Interventions Med Decis Making, June 1, 2004; 24(3): 281 - 286. [Abstract] [PDF]

				P. Alderson Absence of evidence is not evidence of absence BMJ, February 28, 2004; 328(7438): 476 - 477. [Full Text] [PDF]

				E. M. Antman and J. J. Ferguson Should Evidence-Based Proof of Efficacy as Defined for a Specific Therapeutic Agent be Extrapolated to Encompass a Therapeutic Class of Agents? Circulation, November 25, 2003; 108(21): 2604 - 2607. [Full Text] [PDF]

				W. G. Nichols, T. H. Price, T. Gooley, L. Corey, and M. Boeckh Transfusion-transmitted cytomegalovirus infection after receipt of leukoreduced blood products Blood, May 15, 2003; 101(10): 4195 - 4200. [Abstract] [Full Text] [PDF]

				P. Alderson and I. Chalmers Research pointers: Survey of claims of no effect in abstracts of Cochrane reviews BMJ, March 1, 2003; 326(7387): 475 - 475. [Full Text] [PDF]

				H. M Jones, I. M Ali, J. E Martin, T. A Furukawa, C. Barbui, and H. McGuire Low dosage tricyclic antidepressants in depression BMJ, March 1, 2003; 326(7387): 499 - 499. [Full Text]

				J. B. Moseley, K. O'Malley, N. J. Petersen, T. J. Menke, B. A. Brody, D. H. Kuykendall, J. C. Hollingsworth, C. M. Ashton, and N. P. Wray A Controlled Trial of Arthroscopic Surgery for Osteoarthritis of the Knee N. Engl. J. Med., July 11, 2002; 347(2): 81 - 88. [Abstract] [Full Text] [PDF]

				J. P.A. Ioannidis, D. G. Contopoulos-Ioannidis, P. Chew, and J. Lau Meta-analysis of randomized controlled trials on the comparative efficacy and safety of azithromycin against other antibiotics for upper respiratory tract infections J. Antimicrob. Chemother., November 1, 2001; 48(5): 677 - 689. [Abstract] [Full Text] [PDF]

				K. B.Y. Chan, M. Man-Son-Hing, F. J. Molnar, and A. Laupacis How well is the clinical importance of study results reported? An assessment of randomized controlled trials Can. Med. Assoc. J., October 1, 2001; 165(9): 1197 - 1202. [Abstract] [Full Text] [PDF]

				N. M. Kaplan Should New Drugs Be Used Without Outcome Data?: Implications of ALLHAT and ELITE II Arch Intern Med, February 26, 2001; 161(4): 511 - 512. [Full Text] [PDF]

				A. V. Proto Radiology 2001-The Upcoming Year Radiology, January 1, 2001; 218(1): 1 - 2. [Full Text]

				E. J. Topol, E. M. Ohman, P. W. Armstrong, R. Wilcox, A. M. Skene, P. Aylward, J. Simes, A. Dalby, A. Betriu, C. Bode, et al. Survival Outcomes 1 Year After Reperfusion Therapy With Either Alteplase or Reteplase for Acute Myocardial Infarction : Results From the Global Utilization of Streptokinase and t-PA for Occluded Coronary Arteries (GUSTO) III Trial Circulation, October 10, 2000; 102(15): 1761 - 1765. [Abstract] [Full Text] [PDF]