Online citations, reference lists, and bibliographies.
← Back to Search

Conceptual And Technical Challenges In Network Meta-analysis

A. Cipriani, J. Higgins, J. Geddes, G. Salanti
Published 2013 · Medicine

Cite This
Download PDF
Analyze on Scholarcy
Share
The increase in treatment options creates an urgent need for comparative effectiveness research. Randomized, controlled trials comparing several treatments are usually not feasible, so other methodological approaches are needed. Meta-analyses provide summary estimates of treatment effects by combining data from many studies. However, an important drawback is that standard meta-analyses can compare only 2 interventions at a time. A new meta-analytic technique, called network meta-analysis (or multiple treatments meta-analysis or mixed-treatment comparison), allows assessment of the relative effectiveness of several interventions, synthesizing evidence across a network of randomized trials. Despite the growing prevalence and influence of network meta-analysis in many fields of medicine, several issues need to be addressed when constructing one to avoid conclusions that are inaccurate, invalid, or not clearly justified. This article explores the scope and limitations of network meta-analysis and offers advice on dealing with heterogeneity, inconsistency, and potential sources of bias in the available evidence to increase awareness among physicians about some of the challenges in interpretation.
This paper references
10.1016/S0140-6736(09)60046-5
Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis
A. Cipriani (2009)
10.1136/bmj.b1147
Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews
F. Song (2009)
10.1111/j.1467-985X.2008.00552.x
A re-evaluation of random-effects meta-analysis
J. Higgins (2009)
10.1001/JAMA.298.4.430
Data extraction errors in meta-analyses that use standardized mean differences.
P. Gøtzsche (2007)
July 2013 Annals of Internal Medicine Volume 159 @BULLET Number 2 www.annals.org
10.1177/0962280207080643
Evaluation of networks of randomized trials
G. Salanti (2008)
10.1002/sim.3767
Checking consistency in mixed treatment comparison meta-analysis.
S. Dias (2010)
10.1002/sim.3594
Addressing between-study heterogeneity and inconsistency in mixed treatment comparisons: Application to stroke prevention treatments in individuals with non-rheumatic atrial fibrillation.
N. Cooper (2009)
Research and Reporting Methods Challenges in Network Meta-analysis
10.1136/bmj.315.7121.1533
Meta-analysis: Principles and procedures
M. Egger (1997)
10.1111/J.1467-985X.2010.00639.X
Estimation and adjustment of bias in randomized evidence by using mixed treatment comparison meta-analysis
S. Dias (2010)
10.1111/j.1524-4733.2009.00541.x
No study left behind: a network meta-analysis in non-small-cell lung cancer demonstrating the importance of considering all relevant data.
N. Hawkins (2009)
10.1186/2046-4053-1-2
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
A. Booth (2012)
10.1186/1471-2288-2-13
The transitive fallacy for randomized trials: If A bests B and B bests C in separate trials, is A better than C?
S. Baker (2002)
10.1371/journal.pone.0011054
Indirect Comparisons: A Review of Reporting and Methodological Quality
S. Donegan (2010)
10.1371/journal.pone.0016237
Estimating the Power of Indirect Comparisons: A Simulation Study
E. Mills (2011)
10.1016/j.jclinepi.2010.03.016
Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial.
G. Salanti (2011)
10.1023/A:1020206907668
Bayesian Analysis of Population PK/PD Models: General Concepts and Software
D. Lunn (2004)
10.1016/j.jval.2011.04.002
Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1.
J. Jansen (2011)
10.1016/j.jclinepi.2012.01.002
Directed acyclic graphs can help understand bias in indirect and mixed treatment comparisons.
J. Jansen (2012)
10.1002/SIM.1187
How should meta-regression analyses be undertaken and interpreted?
S. Thompson (2002)
10.1002/(SICI)1097-0258(19961230)15:24<2733::AID-SIM562>3.0.CO;2-0
Borrowing strength from external trials in a meta-analysis.
J. Higgins (1996)
10.1002/SIM.1201
Network meta-analysis for indirect treatment comparisons.
T. Lumley (2002)
10.1186/1471-2288-12-138
Simulation evaluation of statistical properties of methods for indirect and mixed treatment comparisons
F. Song (2012)
10.1002/jrsm.1045
Consistency and inconsistency in network meta-analysis: model estimation using multivariate meta-regression‡
I. White (2012)
10.1002/sim.4001
Evaluating novel agent effects in multiple-treatments meta-regression.
G. Salanti (2010)
Indirect Evidence: Indirect Treatment Comparisons in Meta-Analysis
GA Wells (2009)
10.7326/0003-4819-156-5-201203060-00009
What Comparative Effectiveness Research Is Needed? A Framework for Using Guidelines and Systematic Reviews to Identify Evidence Gaps and Research Priorities
Tianjing Li (2012)
10.1001/jama.2010.1663
US government kicks off program for comparative effectiveness research.
M. Mitka (2010)
Comparative efficacy and acceptability of antimanic drugs in acute mania: a multiple-treatments meta-analysis Indirect Evidence: Indirect Treatment Comparisons in Meta-Analysis
A Cipriani (2009)
10.1186/2046-4053-1-3
Prospective systematic review registration: perspective from the Guidelines International Network (G-I-N)
P. J. van der Wees (2012)
10.1002/SIM.1752
Controlling the risk of spurious findings from meta-regression.
J. Higgins (2004)
10.1016/0197-2456(86)90046-2
Meta-analysis in clinical trials.
R. Dersimonian (1986)
10.1136/bmj.331.7521.897
Simultaneous comparison of multiple treatments: combining direct and indirect evidence
D. Caldwell (2005)
J Clin Epidemiol
(1997)
10.1016/j.jclinepi.2010.01.005
Study designs to detect sponsorship and other biases in systematic reviews.
S. Dias (2010)
10.1016/j.jclinepi.2007.06.006
Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions.
F. Song (2008)
10.1002/jrsm.1037
Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool.
G. Salanti (2012)
Prospec - tive systematic review registration : perspective from the Guidelines International Network ( GI - N )
P VanderWees (2012)
10.1016/S0895-4356(97)00049-8
The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials.
H. Bucher (1997)
Indirect Evidence: Indirect Treatment Comparisons in Meta-Analysis. Ottawa: Canadian Agency for Drugs and Technologies in Health
G A Wells (2009)
A re-evaluation of randomeffects meta-analysis
JP Higgins (2009)
10.1002/SIM.1188
Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes.
J. Deeks (2002)
10.1016/j.jclinepi.2010.09.016
Ratio of means for analyzing continuous outcomes in meta-analysis performed as well as mean difference methods.
J. Friedrich (2011)
10.1136/bmj.327.7414.557
Measuring inconsistency in meta-analyses
J. Higgins (2003)
10.1002/jrsm.57
Using network meta-analysis to evaluate the existence of small-study effects in a network of interventions.
A. Chaimani (2012)
10.1186/1741-7015-9-79
Network meta-analysis-highly attractive but more methodological research is needed
Tianjing Li (2011)
10.1001/2012.JAMA.11228
How to use an article reporting a multiple treatment comparison meta-analysis.
E. Mills (2012)
10.1016/S0140-6736(11)60873-8
Comparative efficacy and acceptability of antimanic drugs in acute mania: a multiple-treatments meta-analysis
A. Cipriani (2011)
10.1093/ije/dys222
Evaluation of inconsistency in networks of interventions.
A. Veroniki (2013)
10.1016/S0140-6736(06)69615-3
Indirect comparisons: the mesh and mess of clinical trials
J. Ioannidis (2006)
10.1016/j.jclinepi.2008.10.001
A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered.
G. Salanti (2009)
Ad Hoc Network Meta-analysis Methods Meeting Working Group. Network meta-analysishighly attractive but more methodological research is needed
T Li (2011)
10.1198/016214505000001302
Assessing Evidence Inconsistency in Mixed Treatment Comparisons
G. Lu (2006)
10.1016/j.jclinepi.2009.04.007
Systematic review data extraction: cross-sectional study showed that experience did not increase accuracy.
J. Horton (2010)



This paper is referenced by
10.4161/hv.28284
Bayesian network meta-analysis suggests a similar effectiveness between a monovalent and a pentavalent rotavirus vaccine
M. Takeuchi (2014)
Chapter 11 : Undertaking network meta-analyses
A. Chaimani (2018)
10.25011/cim.v42i1.32393
Safety and efficacy of active and passive immunotherapy in mild-to-moderate Alzheimer's disease: A systematic review and network meta-analysis.
Naghmeh Foroutan (2019)
10.1094/PHYTO-12-15-0342-RVW
Statistical Models and Methods for Network Meta-Analysis.
L. Madden (2016)
10.1016/j.ctrv.2017.01.006
Immune checkpoint inhibitors and targeted therapies for metastatic melanoma: A network meta-analysis.
S. Pasquali (2017)
10.20381/ruor-5759
Knowledge Translation of Economic Evaluations and Network Meta-Analyses
Shannon Sullivan (2015)
10.1002/pds.4767
A tool for empirical equipoise assessment in multigroup comparative effectiveness research
K. Yoshida (2019)
10.1136/bmjopen-2017-019110
History and publication trends in the diffusion and early uptake of indirect comparison meta-analytic methods to study drugs: animated coauthorship networks over time
Joann K. Ban (2018)
10.1016/j.maturitas.2018.09.005
Therapeutic options for aromatase inhibitor-associated arthralgia in breast cancer survivors: A systematic review of systematic reviews, evidence mapping, and network meta-analysis.
T. Kim (2018)
10.1016/S2215-0366(18)30269-4
Comparative efficacy and tolerability of medications for attention-deficit hyperactivity disorder in children, adolescents, and adults: a systematic review and network meta-analysis
S. Cortese (2018)
10.1097/MCG.0000000000000878
Efficacy of Pharmacologic Therapy for Eosinophilic Esophagitis: A Systematic Review and Network Meta-Analysis
Y. Tomizawa (2018)
10.1016/j.carrev.2019.10.022
A meta-analysis comparing aspirin alone versus dual antiplatelet therapy for the prevention of venous graft failure following coronary artery bypass surgery.
Kirstin G. Hesterberg (2019)
10.1080/03007995.2019.1649378
Efficacy of emicizumab prophylaxis versus factor VIII prophylaxis for treatment of hemophilia A without inhibitors: network meta-analysis and sub-group analyses of the intra-patient comparison of the HAVEN 3 trial
Adriana Reyes (2019)
10.1002/14651858.CD012859
Drugs for preventing postoperative nausea and vomiting in adults after general anaesthesia: a network meta‐analysis
S. Weibel (2017)
10.1002/14651858.CD012729
Antidepressants, benzodiazepines and azapirones for panic disorder in adults: a network meta-analysis
G. Guaiana (2017)
10.1161/CIRCINTERVENTIONS.116.004383
Preventive Strategies for Contrast-Induced Acute Kidney Injury in Patients Undergoing Percutaneous Coronary Procedures: Evidence From a Hierarchical Bayesian Network Meta-Analysis of 124 Trials and 28 240 Patients
D. Giacoppo (2017)
10.1007/s11606-017-4000-7
A Network Meta-Analysis of Clinical Management Strategies for Treatment-Resistant Hypertension: Making Optimal Use of the Evidence
P. Makai (2017)
10.1002/14651858.CD012583.pub2
Dressings and topical agents for treating venous leg ulcers.
G. Norman (2018)
10.1007/s11739-016-1583-7
Network meta-analysis: an introduction for clinicians
Benjamin Rouse (2016)
10.1136/bmjopen-2019-031374
Effect of different types of exercise on health-related quality of life during and after cancer treatment: a protocol for a systematic review and network meta-analysis
Esther Ubago-Guisado (2019)
10.1111/apt.14449
Systematic review with network meta‐analysis: comparative assessment of tofacitinib and biological therapies for moderate‐to‐severe ulcerative colitis
S. Bonovas (2018)
10.1097/SLA.0000000000001905
Survival After Neoadjuvant and Adjuvant Treatments Compared to Surgery Alone for Resectable Esophageal Carcinoma: A Network Meta-analysis
S. Pasquali (2017)
10.1016/j.fertnstert.2019.03.028
Medications for pain relief in outpatient endometrial sampling or biopsy: a systematic review and network meta-analysis.
A. Abbas (2019)
10.1136/bmjopen-2017-018175
Comparing the diagnostic accuracy of five common tumour biomarkers and CA19-9 for pancreatic cancer: a protocol for a network meta-analysis of diagnostic test accuracy
L. Ge (2017)
10.2147/TCRM.S175080
Fluid resuscitation in critically ill patients: a systematic review and network meta-analysis
Chao Liu (2018)
10.2147/CIA.S184968
Identification of the optimal cognitive drugs among Alzheimer’s disease: a Bayesian meta-analytic review
J. Liang (2018)
10.1002/14651858.cd013620
Alternating pressure (active) air surfaces for preventing pressure ulcers
Chunhu Shi (2020)
A protocol for systematic review
Tingwei Xia (2013)
10.1371/journal.pone.0115065
Network Meta-Analysis Using R: A Review of Currently Available Automated Packages
B. Neupane (2014)
10.1093/jac/dkx430
Comparative efficacy of drugs for treating giardiasis: a systematic update of the literature and network meta-analysis of randomized clinical trials
J. Ordóñez-Mena (2018)
10.1371/journal.pone.0076654
Graphical Tools for Network Meta-Analysis in STATA
A. Chaimani (2013)
10.1201/9781315159409-12
11. NetworkMeta-Analysis
Orestis Efthimiou (2017)
See more
Semantic Scholar Logo Some data provided by SemanticScholar