Online citations, reference lists, and bibliographies.

Quantifying Heterogeneity In A Meta-analysis.

J. Higgins, S. Thompson
Published 2002 · Medicine, Mathematics

Cite This
Download PDF
Analyze on Scholarcy
The extent of heterogeneity in a meta-analysis partly determines the difficulty in drawing overall conclusions. This extent may be measured by estimating a between-study variance, but interpretation is then specific to a particular treatment effect metric. A test for the existence of heterogeneity exists, but depends on the number of studies in the meta-analysis. We develop measures of the impact of heterogeneity on a meta-analysis, from mathematical criteria, that are independent of the number of studies and the treatment effect metric. We derive and propose three suitable statistics: H is the square root of the chi2 heterogeneity statistic divided by its degrees of freedom; R is the ratio of the standard error of the underlying mean from a random effects meta-analysis to the standard error of a fixed effect meta-analytic estimate, and I2 is a transformation of (H) that describes the proportion of total variation in study estimates that is due to heterogeneity. We discuss interpretation, interval estimates and other properties of these measures and examine them in five example data sets showing different amounts of heterogeneity. We conclude that H and I2, which can usually be calculated for published meta-analyses, are particularly useful summaries of the impact of heterogeneity. One or both should be presented in published meta-analyses in preference to the test for heterogeneity.
This paper references
The combination of estimates from di erent experiments
WG Cochran (1954)
Explaining heterogeneity in meta-analysis: a comparison of methods.
S. Thompson (1999)
BUGS: Bayesian Inference Using Gibbs Sampling
D. Spiegelhalter (1993)
BUGS - Bayesian inference Using Gibbs Sampling Version 0.50
D. Spiegelhalter (1995)
Controversies in meta-analysis: the case of the trials of serum cholesterol reduction
S. Thompson (1993)
A note on graphical presentation of estimated odds ratios from several clinical trials.
R. Galbraith (1988)
How study design aaects outcomes in comparisons of therapy
Ga Colditz (1989)
The Cochrane Collaboration. Cochrane Database of Systematic Reviews
A general parametric approach to the meta-analysis of randomized clinical trials.
A. Whitehead (1991)
Incorporating variability in estimates of heterogeneity in the random effects model in meta-analysis.
B. Biggerstaff (1997)
Human albumin administration in critically ill patients: systematic review of randomised controlled trials.
Cochrane Injuries (1998)
How to review the evidence: systematic identification and review of the scientific literature
P. Glasziou (2000)
Bayesian approaches to random-effects meta-analysis: a comparative study.
T. C. Smith (1995)
The combination of estimates from diierent experiments
Wg Cochran (1954)
Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis.
B. Takkouche (1999)
Adjuvant chemotherapy for localised resectable soft-tissue sarcoma of adults: meta-analysis of individual data
J. Tierney (1997)
A likelihood approach to meta-analysis with random effects.
R. Hardy (1996)
Gamma and other cephalocondylic intramedullary nails versus extramedullary implants for extracapsular hip fractures.
M. Parker (2002)
Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses.
E. Engels (2000)
Human albumin administration in critically ill patients. Analysis is superficial and conclusions exaggerated.
R. J. Beale (1998)
Some Applications of Radial Plots
R. Galbraith (1994)
Adjuvant chemotherapy for localised resectable soft-tissue sarcoma of adults: meta-analysis of individual data. Sarcoma Meta-analysis Collaboration.
D. Crowther (1997)
Adjuvant chemotherapy for localised resectable soft-tissue sarcoma of adults: meta-analysis of individual data
Sarcoma Meta-analysis Collaboration (1997)
Cochrane Injuries Group Albumin ReviewersWhy albumin may not work
A. Berger (1998)
Heterogeneity and statistical signi cance in meta-analysis: an empirical study of 125 meta-analyses. Statistics in Medicine 2000; 19:1707–1728
EA Engels (2002)
Meta-analysis in clinical trials.
R. Dersimonian (1986)
How study design affects outcomes in comparisons of therapy. I: Medical.
G. Colditz (1989)
How study design a ects outcomes in comparisons of therapy. 1: Medical
GA Colditz (1989)
The combination of estimates from different experiments.
W. Cochran (1954)
Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables
M. Abramowitz (1964)
Bayesian approaches to random-e ects meta-analysis: a comparative study. Statistics in Medicine 1995; 14:2685–2699
TC Smith (2002)
Estimability and estimation in case-referent studies.
O. Miettinen (1976)
Prevention of first bleeding in cirrhosis. A meta-analysis of randomized trials of nonsurgical treatment.
L. Pagliaro (1992)
Cochrane Injuries Group Albumin Reviewers Human albumin administration in critically ill patients: systematic review of randomised controlled trials
Detecting and describing heterogeneity in meta-analysis.
R. Hardy (1998)
Cytidinediphosphocholine (CDP choline) for cognitive and behavioural disturbances associated with chronic cerebral disorders in the elderly.
M. Fioravanti (2000)
Beta blockade during and after myocardial infarction: an overview of the randomized trials.
S. Yusuf (1985)

This paper is referenced by
B7-H3 Overexpression Predicts Poor Survival of Cancer Patients: A Meta-Analysis
Z. Ye (2016)
Persistent organ dysfunction after severe sepsis: a systematic review.
F. Guirgis (2014)
Effects of Traditional Chinese Medicine in Treatment of Breast Cancer Patients After Mastectomy: A Meta-Analysis
W. Wang (2014)
Occupational trichloroethylene exposure and kidney cancer risk: a meta-analysis
S. Karami (2012)
Micro- and Nanoplastic Exposure Effects in Microalgae: A Meta-Analysis of Standard Growth Inhibition Tests
Sophia Reichelt (2020)
Prescribed hypocaloric nutrition support for critically‐ill adults
M. Perman (2009)
Combined calcium, magnesium and potassium supplementation for the management of primary hypertension in adults.
F. Beyer (2006)
Sexualizing Media Use and Self-Objectification
Kathrin Karsay (2018)
Outcomes of liver transplantation for nonalcoholic steatohepatitis: a systematic review and meta-analysis.
X. Wang (2014)
Case fatality rate and risk factors for Nipah virus encephalitis: A systematic review and meta-analysis.
S. Kenmoe (2019)
Effect of maternal calcium intake during pregnancy on children's blood pressure: A systematic review of the literature
E. Bergel (2007)
Physical Activity of Moderate Intensity and Risk of Type 2 Diabetes
C. Jeon (2007)
Evidence-based sample size calculations based upon updated meta-analysis.
A. Sutton (2007)
Evaluation of Serum and Plasma Interleukin-6 Levels in Obstructive Sleep Apnea Syndrome: A Meta-Analysis and Meta-Regression
M. Imani (2020)
A systematic review and meta-analyses of pregnancy and fetal outcomes in women with multiple sclerosis: a contribution from the IMI2 ConcePTION project
S. Lopez-Leon (2020)
Epidemiology of low birth weight in Iran: A systematic review and meta-analysis
M. Shokri (2020)
Cardiac Harms of Sofosbuvir: Systematic Review and Meta-Analysis
D. Caldeira (2017)
Overweight, obesity and risk of liver cancer: a meta-analysis of cohort studies
S. Larsson (2007)
Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity.
J. Peters (2007)
Systemic Leukofiltration Does Not Attenuate Pulmonary Injury after Cardiopulmonary Bypass
O. Warren (2008)
Control interventions for preventing spread of vancomycin-resistant enterococci (VRE) in hospitals
E. Tacconelli (2008)
Hormone replacement therapy and ovarian cancer risk: a meta-analysis.
B. Zhou (2008)
Techniques of biliary reconstruction for liver transplantation
K. Gurusamy (2008)
Chronic kidney disease and postoperative mortality: a systematic review and meta-analysis.
A. Mathew (2008)
Laparoscopic versus open cholecystectomy for patients with symptomatic cholecystolithiasis.
F. Keus (2006)
The Efficacy of 5-HT3 Receptor Antagonists for the Prevention of Postoperative Nausea and Vomiting After Craniotomy: A Meta-Analysis
S. Neufeld (2007)
Telephone follow-up for type 2 diabetes mellitus
J. Wu (2007)
Pegylated interferon for acute hepatitis C
M. Šimin (2007)
Recombinant growth hormone for children and adolescents with Turner syndrome.
L. Baxter (2007)
The harmful health effects of recreational ecstasy: a systematic review of observational evidence.
G. Rogers (2009)
Association of ACE I/D Gene Polymorphism With Vascular Dementia: A Meta-Analysis
Hua Liu (2009)
Sex differences in the use of intravenous rt-PA thrombolysis treatment for acute ischemic stroke: a meta-analysis.
M. Reeves (2009)
See more
Semantic Scholar Logo Some data provided by SemanticScholar