← Back to Search
Conceptual And Technical Challenges In Network Meta-analysis
A. Cipriani, J. Higgins, J. Geddes, G. Salanti
Published 2013 · Medicine
Download PDFAnalyze on Scholarcy
The increase in treatment options creates an urgent need for comparative effectiveness research. Randomized, controlled trials comparing several treatments are usually not feasible, so other methodological approaches are needed. Meta-analyses provide summary estimates of treatment effects by combining data from many studies. However, an important drawback is that standard meta-analyses can compare only 2 interventions at a time. A new meta-analytic technique, called network meta-analysis (or multiple treatments meta-analysis or mixed-treatment comparison), allows assessment of the relative effectiveness of several interventions, synthesizing evidence across a network of randomized trials. Despite the growing prevalence and influence of network meta-analysis in many fields of medicine, several issues need to be addressed when constructing one to avoid conclusions that are inaccurate, invalid, or not clearly justified. This article explores the scope and limitations of network meta-analysis and offers advice on dealing with heterogeneity, inconsistency, and potential sources of bias in the available evidence to increase awareness among physicians about some of the challenges in interpretation.
This paper references
Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis
A. Cipriani (2009)
Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews
F. Song (2009)
A re-evaluation of random-effects meta-analysis
J. Higgins (2009)
Data extraction errors in meta-analyses that use standardized mean differences.
P. Gøtzsche (2007)
July 2013 Annals of Internal Medicine Volume 159 @BULLET Number 2 www.annals.org
Evaluation of networks of randomized trials
G. Salanti (2008)
Checking consistency in mixed treatment comparison meta-analysis.
S. Dias (2010)
Addressing between-study heterogeneity and inconsistency in mixed treatment comparisons: Application to stroke prevention treatments in individuals with non-rheumatic atrial fibrillation.
N. Cooper (2009)
Research and Reporting Methods Challenges in Network Meta-analysis
Meta-analysis: Principles and procedures
M. Egger (1997)
Estimation and adjustment of bias in randomized evidence by using mixed treatment comparison meta-analysis
S. Dias (2010)
No study left behind: a network meta-analysis in non-small-cell lung cancer demonstrating the importance of considering all relevant data.
N. Hawkins (2009)
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
A. Booth (2012)
The transitive fallacy for randomized trials: If A bests B and B bests C in separate trials, is A better than C?
S. Baker (2002)
Indirect Comparisons: A Review of Reporting and Methodological Quality
S. Donegan (2010)
Estimating the Power of Indirect Comparisons: A Simulation Study
E. Mills (2011)
Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial.
G. Salanti (2011)
Bayesian Analysis of Population PK/PD Models: General Concepts and Software
D. Lunn (2004)
Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1.
J. Jansen (2011)
Directed acyclic graphs can help understand bias in indirect and mixed treatment comparisons.
J. Jansen (2012)
How should meta-regression analyses be undertaken and interpreted?
S. Thompson (2002)
Borrowing strength from external trials in a meta-analysis.
J. Higgins (1996)
Network meta-analysis for indirect treatment comparisons.
T. Lumley (2002)
Simulation evaluation of statistical properties of methods for indirect and mixed treatment comparisons
F. Song (2012)
Consistency and inconsistency in network meta-analysis: model estimation using multivariate meta-regression‡
I. White (2012)
Evaluating novel agent effects in multiple-treatments meta-regression.
G. Salanti (2010)
Indirect Evidence: Indirect Treatment Comparisons in Meta-Analysis
GA Wells (2009)
What Comparative Effectiveness Research Is Needed? A Framework for Using Guidelines and Systematic Reviews to Identify Evidence Gaps and Research Priorities
Tianjing Li (2012)
US government kicks off program for comparative effectiveness research.
M. Mitka (2010)
Comparative efficacy and acceptability of antimanic drugs in acute mania: a multiple-treatments meta-analysis Indirect Evidence: Indirect Treatment Comparisons in Meta-Analysis
A Cipriani (2009)
Prospective systematic review registration: perspective from the Guidelines International Network (G-I-N)
P. J. van der Wees (2012)
Controlling the risk of spurious findings from meta-regression.
J. Higgins (2004)
Meta-analysis in clinical trials.
R. Dersimonian (1986)
Simultaneous comparison of multiple treatments: combining direct and indirect evidence
D. Caldwell (2005)
J Clin Epidemiol
Study designs to detect sponsorship and other biases in systematic reviews.
S. Dias (2010)
Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions.
F. Song (2008)
Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool.
G. Salanti (2012)
Prospec - tive systematic review registration : perspective from the Guidelines International Network ( GI - N )
P VanderWees (2012)
The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials.
H. Bucher (1997)
Indirect Evidence: Indirect Treatment Comparisons in Meta-Analysis. Ottawa: Canadian Agency for Drugs and Technologies in Health
G A Wells (2009)
A re-evaluation of randomeffects meta-analysis
JP Higgins (2009)
Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes.
J. Deeks (2002)
Ratio of means for analyzing continuous outcomes in meta-analysis performed as well as mean difference methods.
J. Friedrich (2011)
Measuring inconsistency in meta-analyses
J. Higgins (2003)
Using network meta-analysis to evaluate the existence of small-study effects in a network of interventions.
A. Chaimani (2012)
Network meta-analysis-highly attractive but more methodological research is needed
Tianjing Li (2011)
How to use an article reporting a multiple treatment comparison meta-analysis.
E. Mills (2012)
Comparative efficacy and acceptability of antimanic drugs in acute mania: a multiple-treatments meta-analysis
A. Cipriani (2011)
Evaluation of inconsistency in networks of interventions.
A. Veroniki (2013)
Indirect comparisons: the mesh and mess of clinical trials
J. Ioannidis (2006)
A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered.
G. Salanti (2009)
Ad Hoc Network Meta-analysis Methods Meeting Working Group. Network meta-analysishighly attractive but more methodological research is needed
T Li (2011)
Assessing Evidence Inconsistency in Mixed Treatment Comparisons
G. Lu (2006)
Systematic review data extraction: cross-sectional study showed that experience did not increase accuracy.
J. Horton (2010)
This paper is referenced by
Bayesian network meta-analysis suggests a similar effectiveness between a monovalent and a pentavalent rotavirus vaccine
M. Takeuchi (2014)
Chapter 11 : Undertaking network meta-analyses
A. Chaimani (2018)
Safety and efficacy of active and passive immunotherapy in mild-to-moderate Alzheimer's disease: A systematic review and network meta-analysis.
Naghmeh Foroutan (2019)
Statistical Models and Methods for Network Meta-Analysis.
L. Madden (2016)
Immune checkpoint inhibitors and targeted therapies for metastatic melanoma: A network meta-analysis.
S. Pasquali (2017)
Knowledge Translation of Economic Evaluations and Network Meta-Analyses
Shannon Sullivan (2015)
A tool for empirical equipoise assessment in multigroup comparative effectiveness research
K. Yoshida (2019)
History and publication trends in the diffusion and early uptake of indirect comparison meta-analytic methods to study drugs: animated coauthorship networks over time
Joann K. Ban (2018)
Therapeutic options for aromatase inhibitor-associated arthralgia in breast cancer survivors: A systematic review of systematic reviews, evidence mapping, and network meta-analysis.
T. Kim (2018)
Comparative efficacy and tolerability of medications for attention-deficit hyperactivity disorder in children, adolescents, and adults: a systematic review and network meta-analysis
S. Cortese (2018)
Efficacy of Pharmacologic Therapy for Eosinophilic Esophagitis: A Systematic Review and Network Meta-Analysis
Y. Tomizawa (2018)
A meta-analysis comparing aspirin alone versus dual antiplatelet therapy for the prevention of venous graft failure following coronary artery bypass surgery.
Kirstin G. Hesterberg (2019)
Efficacy of emicizumab prophylaxis versus factor VIII prophylaxis for treatment of hemophilia A without inhibitors: network meta-analysis and sub-group analyses of the intra-patient comparison of the HAVEN 3 trial
Adriana Reyes (2019)
Drugs for preventing postoperative nausea and vomiting in adults after general anaesthesia: a network meta‐analysis
S. Weibel (2017)
Antidepressants, benzodiazepines and azapirones for panic disorder in adults: a network meta-analysis
G. Guaiana (2017)
Preventive Strategies for Contrast-Induced Acute Kidney Injury in Patients Undergoing Percutaneous Coronary Procedures: Evidence From a Hierarchical Bayesian Network Meta-Analysis of 124 Trials and 28 240 Patients
D. Giacoppo (2017)
A Network Meta-Analysis of Clinical Management Strategies for Treatment-Resistant Hypertension: Making Optimal Use of the Evidence
P. Makai (2017)
Dressings and topical agents for treating venous leg ulcers.
G. Norman (2018)
Network meta-analysis: an introduction for clinicians
Benjamin Rouse (2016)
Effect of different types of exercise on health-related quality of life during and after cancer treatment: a protocol for a systematic review and network meta-analysis
Esther Ubago-Guisado (2019)
Systematic review with network meta‐analysis: comparative assessment of tofacitinib and biological therapies for moderate‐to‐severe ulcerative colitis
S. Bonovas (2018)
Survival After Neoadjuvant and Adjuvant Treatments Compared to Surgery Alone for Resectable Esophageal Carcinoma: A Network Meta-analysis
S. Pasquali (2017)
Medications for pain relief in outpatient endometrial sampling or biopsy: a systematic review and network meta-analysis.
A. Abbas (2019)
Comparing the diagnostic accuracy of five common tumour biomarkers and CA19-9 for pancreatic cancer: a protocol for a network meta-analysis of diagnostic test accuracy
L. Ge (2017)
Fluid resuscitation in critically ill patients: a systematic review and network meta-analysis
Chao Liu (2018)
Identification of the optimal cognitive drugs among Alzheimer’s disease: a Bayesian meta-analytic review
J. Liang (2018)
Alternating pressure (active) air surfaces for preventing pressure ulcers
Chunhu Shi (2020)
A protocol for systematic review
Tingwei Xia (2013)
Network Meta-Analysis Using R: A Review of Currently Available Automated Packages
B. Neupane (2014)
Comparative efficacy of drugs for treating giardiasis: a systematic update of the literature and network meta-analysis of randomized clinical trials
J. Ordóñez-Mena (2018)
Graphical Tools for Network Meta-Analysis in STATA
A. Chaimani (2013)
Orestis Efthimiou (2017)See more