 |
 |
|
|
|  PubMed
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4 December 2001 | Volume 135 Issue 11 | Pages 982-989
Purpose: To explore whether reported methodologic quality affects estimated intervention effects in randomized trials and contributes to discrepancies between the results of large randomized trials and small randomized trials in meta-analyses.
Data Sources: Meta-analyses of randomized trials that included at least one large trial (
Study Selection: Full-length randomized trials.
Data Extraction: Methodologic quality was assessed according to reported randomization, double blinding, and follow-up as separate components and by using the Jadad composite scale.
Data Synthesis: Fourteen meta-analyses involving 190 randomized trials from eight therapeutic areas were included. Compared with large trials, intervention effects were exaggerated in small trials with inadequate allocation sequence generation (ratio of odds ratios, 0.46 [95% CI, 0.25 to 0.83]; P = 0.011), inadequate allocation concealment (ratio of odds ratios, 0.49 [CI, 0.27 to 0.86]; P = 0.014), and no double blinding (ratio of odds ratios, 0.52 [CI, 0.28 to 0.96]; P = 0.01). Large trials did not differ significantly from small trials with adequate generation of the allocation sequence, adequate allocation concealment, or adequate double blinding. No association was seen between reported follow-up and intervention effects. The Jadad scale provided no additional information because the scale and the quality components overlapped substantially.
Conclusions: Inadequate generation of the allocation sequence, allocation concealment, and double blinding lead to exaggerated estimates of intervention benefit and may contribute to discrepancies between the results of large randomized trials and small randomized trials in meta-analyses.
Author and Article Information
From Cochrane Hepato-Biliary Group, the Copenhagen Trial Unit, Center for Clinical Intervention Research, Copenhagen University Hospital, H:S Rigshospitalet, Copenhagen, Denmark.
Acknowledgments: The authors thank Doug Altman and Peter Gøtzsche for valuable comments, Nader Salasshahri for computer assistance, and Dimitrinka Nikolova for secretarial assistance.
Grant Support: By grants from the Danish Medical Research Council and the 1991 Pharmacy Foundation in Denmark.
Requests for Single Reprints: Lise L. Kjaergard, MD, Cochrane Hepato-Biliary Group, the Copenhagen Trial Unit, Center for Clinical Intervention Research, Copenhagen University Hospital, H:S Rigshospitalet, DK-2100 Copenhagen, Denmark; e-mail, kjaergard{at}ctu.rh.dk.
Current Author Addresses: Drs. Kjaergard and Gluud and Mr. Villumsen: Cochrane Hepato-Biliary Group, the Copenhagen Trial Unit, Center for Clinical Intervention Research, Copenhagen University Hospital, H:S Rigshospitalet, DK-2100 Copenhagen, Denmark. ACADEMIA AND CLINIC
Reported Methodologic Quality and Discrepancies between Large and Small Randomized Trials in Meta-Analyses
1000 participants) were included, regardless of the therapeutic area. Eligible meta-analyses were identified through electronic searches and bibliographies of relevant articles.
CiteULike 
Complore 
Connotea 
Del.icio.us 
Digg 
Facebook 
Reddit 
Technorati 
Twitter What's this?
Related articles in Annals:
This article has been cited by other articles:
|
|
 |
|
  J. S. Berger, M. J. Krantz, J. M. Kittelson, and W. R. Hiatt Aspirin for the Prevention of Cardiovascular Events in Patients With Peripheral Artery Disease: A Meta-analysis of Randomized Trials JAMA, May 13, 2009; 301(18): 1909 - 1919. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Mente, L. de Koning, H. S. Shannon, and S. S. Anand A Systematic Review of the Evidence Supporting a Causal Link Between Dietary Factors and Coronary Heart Disease Arch Intern Med, April 13, 2009; 169(7): 659 - 669. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. Thorlund, P J Devereaux, J. Wetterslev, G. Guyatt, J. P A Ioannidis, L. Thabane, L.-L. Gluud, B. Als-Nielsen, and C. Gluud Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int. J. Epidemiol., February 1, 2009; 38(1): 276 - 286. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Brok, K. Thorlund, J. Wetterslev, and C. Gluud Apparently conclusive meta-analyses may be inconclusive--Trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses Int. J. Epidemiol., February 1, 2009; 38(1): 287 - 298. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. H. Moller, L. Penninga, J. Wetterslev, D. A. Steinbruchel, and C. Gluud Clinical outcomes in randomized trials of off- vs. on-pump coronary artery bypass surgery: systematic review with meta-analyses and trial sequential analyses Eur. Heart J., November 1, 2008; 29(21): 2601 - 2616. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. Seivewright, J. Green, P. Salkovskis, B. Barrett, U. Nur, and P. Tyrer Cognitive-behavioural therapy for health anxiety in a genitourinary medicine clinic: randomised controlled trial The British Journal of Psychiatry, October 1, 2008; 193(4): 332 - 337. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. L. Gluud, K. Thorlund, C. Gluud, L. Woods, R. Harris, and J. A.C. Sterne Correction: Reported Methodologic Quality and Discrepancies between Large and Small Randomized Trials in Meta-Analyses Ann Intern Med, August 5, 2008; 149(3): 219 - 219. [Full Text] [PDF]
|
|
|
|
|
|
B. G. Feagan, W. J. Sandborn, U. Mittmann, S. Bar-Meir, G. D'Haens, M. Bradette, A. Cohen, C. Dallaire, T. P. Ponich, J. W. D. McDonald, et al. Omega-3 Free Fatty Acids for the Maintenance of Remission in Crohn Disease: The EPIC Randomized Controlled Trials JAMA, April 9, 2008; 299(14): 1690 - 1697. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. Wood, M. Egger, L. L. Gluud, K. F Schulz, P. Juni, D. G Altman, C. Gluud, R. M Martin, A. J G Wood, and J. A C Sterne Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study BMJ, March 15, 2008; 336(7644): 601 - 605. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
I. Boutron, D. Moher, D. G. Altman, K. F. Schulz, P. Ravaud, and for the CONSORT Group Extending the CONSORT Statement to Randomized Trials of Nonpharmacologic Treatment: Explanation and Elaboration Ann Intern Med, February 19, 2008; 148(4): 295 - 309. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. A. Olivo, L. G. Macedo, I. C. Gadotti, J. Fuentes, T. Stanton, and D. J Magee Scales to Assess the Quality of Randomized Controlled Trials: A Systematic Review Physical Therapy, February 1, 2008; 88(2): 156 - 175. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. E. Slavin Response to Comments: Evidence-Based Reform in Education: Which Evidence Counts? Educational Researcher, January 1, 2008; 37(1): 47 - 50. [Full Text] [PDF]
|
|
|
|
|
|
S. Trelle, S. Reichenbach, and P. Juni Chondroitin for Osteoarthritis of the Knee or Hip Ann Intern Med, December 18, 2007; 147(12): 884 - 885. [Full Text] [PDF]
|
|
|
|
 |
|
 A. J. Campbell and M. C. Robertson Rethinking individual and community fall prevention strategies: a meta-regression comparing single and multifactorial interventions Age Ageing, November 1, 2007; 36(6): 656 - 662. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Moll, F. van der Veen, and M. van Wely The role of metformin in polycystic ovary syndrome: a systematic review Hum. Reprod. Update, November 1, 2007; 13(6): 527 - 537. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J Pildal, A Hrobjartsson, K. Jorgensen, J Hilden, D. Altman, and P. Gotzsche Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials Int. J. Epidemiol., August 1, 2007; 36(4): 847 - 857. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. W. Poolman, P. A.A. Struijs, R. Krips, I. N. Sierevelt, R. K. Marti, F. Farrokhyar, and M. Bhandari Reporting of Outcomes in Orthopaedic Randomized Trials: Does Blinding of Outcome Assessors Matter? J. Bone Joint Surg. Am., March 1, 2007; 89(3): 550 - 558. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
G. Bjelakovic, D. Nikolova, L. L. Gluud, R. G. Simonetti, and C. Gluud Mortality in Randomized Trials of Antioxidant Supplements for Primary and Secondary Prevention: Systematic Review and Meta-analysis JAMA, February 28, 2007; 297(8): 842 - 857. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. A. Kyzas, D. Denaxa-Kyza, and J. P. A. Ioannidis Quality of Reporting of Cancer Prognostic Marker Studies: Association With Reported Prognostic Effect J Natl Cancer Inst, February 7, 2007; 99(3): 236 - 243. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. S. Gangji, T. Cukierman, H. C. Gerstein, C. H. Goldsmith, and C. M. Clase A Systematic Review and Meta-Analysis of Hypoglycemia and Cardiovascular Events: A comparison of glyburide with other secretagogues and with insulin Diabetes Care, February 1, 2007; 30(2): 389 - 394. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Leeflang, J. Reitsma, R. Scholten, A. Rutjes, M. Di Nisio, J. Deeks, and P. Bossuyt Impact of Adjustment for Quality on Results of Metaanalyses of Diagnostic Accuracy Clin. Chem., February 1, 2007; 53(2): 164 - 172. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Pollack Clinical trials in hypertension. JAMA, September 27, 2006; 296(12): 1464 - 1464. [Full Text] [PDF]
|
|
|
|
|
|
S. Cockayne, J. Adamson, S. Lanham-New, M. J. Shearer, S. Gilbody, and D. J. Torgerson Vitamin K and the Prevention of Fractures: Systematic Review and Meta-analysis of Randomized Controlled Trials. Arch Intern Med, June 26, 2006; 166(12): 1256 - 1261. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. B. Juul, J. Wetterslev, C. Gluud, A. Kofoed-Enevoldsen, G. Jensen, T. Callesen, P. Norgaard, K. Fruergaard, M. Bestle, R. Vedelsdal, et al. Effect of perioperative beta blockade in patients with diabetes undergoing major non-cardiac surgery: randomised placebo controlled, blinded multicentre trial. BMJ, June 24, 2006; 332(7556): 1482 - 1482. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. L. Gluud Bias in Clinical Intervention Research Am. J. Epidemiol., March 15, 2006; 163(6): 493 - 501. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Lee, Y. Gong, J. Brok, E. H Boxall, and C. Gluud Effect of hepatitis B immunisation in newborn infants of mothers positive for hepatitis B surface antigen: systematic review and meta-analysis BMJ, February 11, 2006; 332(7537): 328 - 336. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. M Jespersen, B. Als-Nielsen, M. Damgaard, J. F. Hansen, S. Hansen, O. H Helo, P. Hildebrandt, J. Hilden, G. B Jensen, J. Kastrup, et al. Randomised placebo controlled multicentre trial to assess short term clarithromycin for patients with stable coronary heart disease: CLARICOR trial BMJ, January 7, 2006; 332(7532): 22 - 27. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 I. W. Tremont-Lukats, V. Challapalli, E. D. McNicol, J. Lau, and D. B. Carr Systemic Administration of Local Anesthetics to Relieve Neuropathic Pain: A Systematic Review and Meta-Analysis Anesth. Analg., December 1, 2005; 101(6): 1738 - 1749. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C Gluud Mortality from cirrhosis: lack of progress over the last 35 years Gut, November 1, 2005; 54(11): 1523 - 1526. [Full Text] [PDF]
|
|
|
|
|
|
J. Brok, L. L. Gluud, and C. Gluud Effects of Adding Ribavirin to Interferon to Treat Chronic Hepatitis C Infection: A Systematic Review and Meta-analysis of Randomized Trials Arch Intern Med, October 24, 2005; 165(19): 2206 - 2212. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. Petersen, P. Jeppesen, A. Thorup, M.-B. Abel, J. Ohlenschlaeger, T. O. Christensen, G. Krarup, P. Jorgensen, and M. Nordentoft A randomised multicentre trial of integrated versus standard treatment for patients with a first episode of psychotic illness BMJ, September 17, 2005; 331(7517): 602. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. J. Martin and M. C. Walsh Inhaled Nitric Oxide for Preterm Infants -- Who Benefits? N. Engl. J. Med., July 7, 2005; 353(1): 82 - 84. [Full Text] [PDF]
|
|
|
|
|
|
L. P Moja, E. Telaro, R. D'Amico, I. Moschetti, L. Coe, A. Liberati, and on behalf of the Metaquality Study Group Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study BMJ, May 7, 2005; 330(7499): 1053. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Pildal, A.-W. Chan, A. Hrobjartsson, E. Forfang, D. G Altman, and P. C Gotzsche Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study BMJ, May 7, 2005; 330(7499): 1049. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M A Puhan, H J Schunemann, M Frey, M Scharplatz, and L M Bachmann How should COPD patients exercise during respiratory rehabilitation? Comparison of exercise modalities and intensities to treat skeletal muscle dysfunction Thorax, May 1, 2005; 60(5): 367 - 375. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. Remy, E. Marret, and F. Bonnet Effects of acetaminophen on morphine side-effects and consumption after major surgery: meta-analysis of randomized controlled trials Br. J. Anaesth., April 1, 2005; 94(4): 505 - 513. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Gluud and L. L. Gluud Evidence based diagnostics BMJ, March 26, 2005; 330(7493): 724 - 726. [Full Text] [PDF]
|
|
|
|
|
|
P. Juni and M. Egger Commentary: Empirical evidence of attrition bias in clinical trials Int. J. Epidemiol., February 1, 2005; 34(1): 87 - 88. [Full Text] [PDF]
|
|
|
|
|
|
P. E Marik and G. P Zaloga Meta-analysis of parenteral nutrition versus enteral nutrition in patients with acute pancreatitis BMJ, June 12, 2004; 328(7453): 1407. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. E. Arterburn, P. K. Crane, and D. L. Veenstra The Efficacy and Safety of Sibutramine for Weight Loss: A Systematic Review Arch Intern Med, May 10, 2004; 164(9): 994 - 1003. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Als-Nielsen, L. L Gluud, and C. Gluud Non-absorbable disaccharides for hepatic encephalopathy: systematic review of randomised trials BMJ, May 1, 2004; 328(7447): 1046. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. M. De Maeseneer and A. De Sutter Why Research in Family Medicine? A Superfluous Question Ann. Fam. Med, May 1, 2004; 2(suppl_2): S17 - S22. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. F. M. Strippoli, J. C. Craig, and F. P. Schena The Number, Quality, and Coverage of Randomized Controlled Trials in Nephrology J. Am. Soc. Nephrol., February 1, 2004; 15(2): 411 - 419. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Als-Nielsen, W. Chen, C. Gluud, and L. L. Kjaergard Results of Clinical Trials Sponsored by For-Profit vs Nonprofit Entities--Reply JAMA, December 17, 2003; 290(23): 3071 - 3072. [Full Text] [PDF]
|
|
|
|
|
|
S. Puffer, D. Torgerson, and J. Watson Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals BMJ, October 4, 2003; 327(7418): 785 - 789. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Als-Nielsen, W. Chen, C. Gluud, and L. L. Kjaergard Association of Funding and Conclusions in Randomized Drug Trials: A Reflection of Treatment Effect or Adverse Events? JAMA, August 20, 2003; 290(7): 921 - 928. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. L. Kjaergard, J. Liu, B. Als-Nielsen, and C. Gluud Artificial and Bioartificial Support Systems for Acute and Acute-on-Chronic Liver Failure: A Systematic Review JAMA, January 8, 2003; 289(2): 217 - 222. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Pedersen, A. M. Moller, and J. Cracknell The Mission of the Cochrane Anesthesia Review Group: Preparing and Disseminating Systematic Reviews of the Effect of Health Care in Anesthesiology Anesth. Analg., October 1, 2002; 95(4): 1012 - 1018. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. L Kjaergard and B. Als-Nielsen Association between competing interests and authors' conclusions: epidemiological study of randomised clinical trials published in the BMJ BMJ, August 3, 2002; 325(7358): 249 - 249. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. M. Balk, P. A. L. Bonis, H. Moskowitz, C. H. Schmid, J. P. A. Ioannidis, C. Wang, and J. Lau Correlation of Quality Measures With Estimates of Treatment Effect in Meta-analyses of Randomized Controlled Trials JAMA, June 12, 2002; 287(22): 2973 - 2982. [Abstract] [Full Text] [PDF]
|
|
