Online citations, reference lists, and bibliographies.

Quantifying Heterogeneity In A Meta-analysis.

J. Higgins, S. Thompson
Published 2002 · Medicine, Mathematics

Cite This
Download PDF
Analyze on Scholarcy
Share
The extent of heterogeneity in a meta-analysis partly determines the difficulty in drawing overall conclusions. This extent may be measured by estimating a between-study variance, but interpretation is then specific to a particular treatment effect metric. A test for the existence of heterogeneity exists, but depends on the number of studies in the meta-analysis. We develop measures of the impact of heterogeneity on a meta-analysis, from mathematical criteria, that are independent of the number of studies and the treatment effect metric. We derive and propose three suitable statistics: H is the square root of the chi2 heterogeneity statistic divided by its degrees of freedom; R is the ratio of the standard error of the underlying mean from a random effects meta-analysis to the standard error of a fixed effect meta-analytic estimate, and I2 is a transformation of (H) that describes the proportion of total variation in study estimates that is due to heterogeneity. We discuss interpretation, interval estimates and other properties of these measures and examine them in five example data sets showing different amounts of heterogeneity. We conclude that H and I2, which can usually be calculated for published meta-analyses, are particularly useful summaries of the impact of heterogeneity. One or both should be presented in published meta-analyses in preference to the test for heterogeneity.
This paper references
The combination of estimates from di erent experiments
WG Cochran (1954)
10.1016/S0197-2456(97)91051-5
Explaining heterogeneity in meta-analysis: a comparison of methods.
S. Thompson (1999)
BUGS: Bayesian Inference Using Gibbs Sampling
D. Spiegelhalter (1993)
BUGS - Bayesian inference Using Gibbs Sampling Version 0.50
D. Spiegelhalter (1995)
10.1177/096228029300200205
Controversies in meta-analysis: the case of the trials of serum cholesterol reduction
S. Thompson (1993)
10.1002/sim.4780070807
A note on graphical presentation of estimated odds ratios from several clinical trials.
R. Galbraith (1988)
How study design aaects outcomes in comparisons of therapy
Ga Colditz (1989)
The Cochrane Collaboration. Cochrane Database of Systematic Reviews
(2001)
10.1002/sim.4780101105
A general parametric approach to the meta-analysis of randomized clinical trials.
A. Whitehead (1991)
10.1002/(SICI)1097-0258(19970415)16:7<753::AID-SIM494>3.0.CO;2-G
Incorporating variability in estimates of heterogeneity in the random effects model in meta-analysis.
B. Biggerstaff (1997)
10.1136/bmj.317.7153.235
Human albumin administration in critically ill patients: systematic review of randomised controlled trials.
Cochrane Injuries (1998)
How to review the evidence: systematic identification and review of the scientific literature
P. Glasziou (2000)
10.1002/sim.4780142408
Bayesian approaches to random-effects meta-analysis: a comparative study.
T. C. Smith (1995)
The combination of estimates from diierent experiments
Wg Cochran (1954)
10.1093/OXFORDJOURNALS.AJE.A009981
Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis.
B. Takkouche (1999)
Adjuvant chemotherapy for localised resectable soft-tissue sarcoma of adults: meta-analysis of individual data
J. Tierney (1997)
10.1002/(SICI)1097-0258(19960330)15:6<619::AID-SIM188>3.0.CO;2-A
A likelihood approach to meta-analysis with random effects.
R. Hardy (1996)
Gamma and other cephalocondylic intramedullary nails versus extramedullary implants for extracapsular hip fractures.
M. Parker (2002)
10.1002/1097-0258(20000715)19:13<1707::AID-SIM491>3.0.CO;2-P
Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses.
E. Engels (2000)
Human albumin administration in critically ill patients. Analysis is superficial and conclusions exaggerated.
R. J. Beale (1998)
10.1080/01621459.1994.10476864
Some Applications of Radial Plots
R. Galbraith (1994)
10.1016/S0140-6736(97)08165-8
Adjuvant chemotherapy for localised resectable soft-tissue sarcoma of adults: meta-analysis of individual data. Sarcoma Meta-analysis Collaboration.
D. Crowther (1997)
10.1016/S0140-6736(97)08165-8
Adjuvant chemotherapy for localised resectable soft-tissue sarcoma of adults: meta-analysis of individual data
Sarcoma Meta-analysis Collaboration (1997)
10.1136/BMJ.317.7153.235
Cochrane Injuries Group Albumin ReviewersWhy albumin may not work
A. Berger (1998)
Heterogeneity and statistical signi cance in meta-analysis: an empirical study of 125 meta-analyses. Statistics in Medicine 2000; 19:1707–1728
EA Engels (2002)
10.1016/0197-2456(86)90046-2
Meta-analysis in clinical trials.
R. Dersimonian (1986)
10.1002/sim.4780080408
How study design affects outcomes in comparisons of therapy. I: Medical.
G. Colditz (1989)
How study design a ects outcomes in comparisons of therapy. 1: Medical
GA Colditz (1989)
10.2307/3001666
The combination of estimates from different experiments.
W. Cochran (1954)
10.2307/2004114
Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables
M. Abramowitz (1964)
Bayesian approaches to random-e ects meta-analysis: a comparative study. Statistics in Medicine 1995; 14:2685–2699
TC Smith (2002)
10.1093/oxfordjournals.aje.a112220
Estimability and estimation in case-referent studies.
O. Miettinen (1976)
10.7326/0003-4819-117-1-59
Prevention of first bleeding in cirrhosis. A meta-analysis of randomized trials of nonsurgical treatment.
L. Pagliaro (1992)
Cochrane Injuries Group Albumin Reviewers Human albumin administration in critically ill patients: systematic review of randomised controlled trials
(1998)
10.1002/(SICI)1097-0258(19980430)17:8<841::AID-SIM781>3.0.CO;2-D
Detecting and describing heterogeneity in meta-analysis.
R. Hardy (1998)
10.1002/14651858.cd000269.pub2
Cytidinediphosphocholine (CDP choline) for cognitive and behavioural disturbances associated with chronic cerebral disorders in the elderly.
M. Fioravanti (2000)
10.1016/S0033-0620(85)80003-7
Beta blockade during and after myocardial infarction: an overview of the randomized trials.
S. Yusuf (1985)



This paper is referenced by
10.1159/000447859
B7-H3 Overexpression Predicts Poor Survival of Cancer Patients: A Meta-Analysis
Z. Ye (2016)
10.1016/j.jcrc.2013.10.020
Persistent organ dysfunction after severe sepsis: a systematic review.
F. Guirgis (2014)
10.1007/s12013-014-0348-z
Effects of Traditional Chinese Medicine in Treatment of Breast Cancer Patients After Mastectomy: A Meta-Analysis
W. Wang (2014)
10.1136/oemed-2012-100932
Occupational trichloroethylene exposure and kidney cancer risk: a meta-analysis
S. Karami (2012)
10.3389/fenvs.2020.00131
Micro- and Nanoplastic Exposure Effects in Microalgae: A Meta-Analysis of Standard Growth Inhibition Tests
Sophia Reichelt (2020)
10.1002/14651858.CD007867
Prescribed hypocaloric nutrition support for critically‐ill adults
M. Perman (2009)
10.1002/14651858.CD004805.PUB2
Combined calcium, magnesium and potassium supplementation for the management of primary hypertension in adults.
F. Beyer (2006)
10.1177/0361684317743019
Sexualizing Media Use and Self-Objectification
Kathrin Karsay (2018)
10.1016/j.cgh.2013.09.023
Outcomes of liver transplantation for nonalcoholic steatohepatitis: a systematic review and meta-analysis.
X. Wang (2014)
10.1016/j.jcv.2019.05.009
Case fatality rate and risk factors for Nipah virus encephalitis: A systematic review and meta-analysis.
S. Kenmoe (2019)
10.1186/1471-2431-7-15
Effect of maternal calcium intake during pregnancy on children's blood pressure: A systematic review of the literature
E. Bergel (2007)
10.2337/dc06-1842
Physical Activity of Moderate Intensity and Risk of Type 2 Diabetes
C. Jeon (2007)
10.1002/SIM.2704
Evidence-based sample size calculations based upon updated meta-analysis.
A. Sutton (2007)
10.3389/fimmu.2020.01343
Evaluation of Serum and Plasma Interleukin-6 Levels in Obstructive Sleep Apnea Syndrome: A Meta-Analysis and Meta-Regression
M. Imani (2020)
10.1007/s00415-020-09913-1
A systematic review and meta-analyses of pregnancy and fetal outcomes in women with multiple sclerosis: a contribution from the IMI2 ConcePTION project
S. Lopez-Leon (2020)
10.1016/j.heliyon.2020.e03787
Epidemiology of low birth weight in Iran: A systematic review and meta-analysis
M. Shokri (2020)
10.1007/s40264-017-0586-2
Cardiac Harms of Sofosbuvir: Systematic Review and Meta-Analysis
D. Caldeira (2017)
10.1038/sj.bjc.6603932
Overweight, obesity and risk of liver cancer: a meta-analysis of cohort studies
S. Larsson (2007)
10.1002/SIM.2889
Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity.
J. Peters (2007)
10.1097/MAT.0b013e3181618e9b
Systemic Leukofiltration Does Not Attenuate Pulmonary Injury after Cardiopulmonary Bypass
O. Warren (2008)
10.1002/14651858.CD007420
Control interventions for preventing spread of vancomycin-resistant enterococci (VRE) in hospitals
E. Tacconelli (2008)
10.1016/j.ygyno.2007.12.003
Hormone replacement therapy and ovarian cancer risk: a meta-analysis.
B. Zhou (2008)
10.1002/14651858.CD007055
Techniques of biliary reconstruction for liver transplantation
K. Gurusamy (2008)
10.1038/ki.2008.29
Chronic kidney disease and postoperative mortality: a systematic review and meta-analysis.
A. Mathew (2008)
10.1002/14651858.CD006231
Laparoscopic versus open cholecystectomy for patients with symptomatic cholecystolithiasis.
F. Keus (2006)
10.1097/01.ana.0000211025.41797.fc
The Efficacy of 5-HT3 Receptor Antagonists for the Prevention of Postoperative Nausea and Vomiting After Craniotomy: A Meta-Analysis
S. Neufeld (2007)
10.1002/14651858.CD006694
Telephone follow-up for type 2 diabetes mellitus
J. Wu (2007)
10.1002/14651858.CD006392
Pegylated interferon for acute hepatitis C
M. Šimin (2007)
10.1002/14651858.CD003887.PUB2
Recombinant growth hormone for children and adolescents with Turner syndrome.
L. Baxter (2007)
10.3310/hta13050
The harmful health effects of recreational ecstasy: a systematic review of observational evidence.
G. Rogers (2009)
10.1177/0891988708328221
Association of ACE I/D Gene Polymorphism With Vascular Dementia: A Meta-Analysis
Hua Liu (2009)
10.1161/STROKEAHA.108.543181
Sex differences in the use of intravenous rt-PA thrombolysis treatment for acute ischemic stroke: a meta-analysis.
M. Reeves (2009)
See more
Semantic Scholar Logo Some data provided by SemanticScholar