Online citations, reference lists, and bibliographies.
← Back to Search

Network Meta-analysis Incorporating Randomized Controlled Trials And Non-randomized Comparative Cohort Studies For Assessing The Safety And Effectiveness Of Medical Treatments: Challenges And Opportunities

C. Cameron, B. Fireman, B. Hutton, T. Clifford, D. Coyle, G. Wells, C. Dormuth, R. Platt, S. Toh
Published 2015 · Medicine

Save to my Library
Download PDF
Analyze on Scholarcy Visualize in Litmaps
Share
Reduce the time it takes to create your bibliography by a factor of 10 by using the world’s favourite reference manager
Time to take this seriously.
Get Citationsy
Network meta-analysis is increasingly used to allow comparison of multiple treatment alternatives simultaneously, some of which may not have been compared directly in primary research studies. The majority of network meta-analyses published to date have incorporated data from randomized controlled trials (RCTs) only; however, inclusion of non-randomized studies may sometimes be considered. Non-randomized studies can complement RCTs or address some of their limitations, such as short follow-up time, small sample size, highly selected population, high cost, and ethical restrictions. In this paper, we discuss the challenges and opportunities of incorporating both RCTs and non-randomized comparative cohort studies into network meta-analysis for assessing the safety and effectiveness of medical treatments. Non-randomized studies with inadequate control of biases such as confounding may threaten the validity of the entire network meta-analysis. Therefore, identification and inclusion of non-randomized studies must balance their strengths with their limitations. Inclusion of both RCTs and non-randomized studies in network meta-analysis will likely increase in the future due to the growing need to assess multiple treatments simultaneously, the availability of higher quality non-randomized data and more valid methods, and the increased use of progressive licensing and product listing agreements requiring collection of data over the life cycle of medical products. Inappropriate inclusion of non-randomized studies could perpetuate the biases that are unknown, unmeasured, or uncontrolled. However, thoughtful integration of randomized and non-randomized studies may offer opportunities to provide more timely, comprehensive, and generalizable evidence about the comparative safety and effectiveness of medical treatments.
This paper references
10.1093/BIOMET/70.1.41
The central role of the propensity score in observational studies for causal effects
P. Rosenbaum (1983)
Confounding by indication?
S. Shapiro (1997)
10.1056/NEJM200006223422507
Randomized, controlled trials, observational studies, and the hierarchy of research designs.
J. Concato (2000)
10.1001/JAMA.286.7.821
Comparison of evidence of treatment effects in randomized and nonrandomized studies.
J. Ioannidis (2001)
10.1191/096228001678227794
Bayesian methods in meta-analysis and evidence synthesis.
A. Sutton (2001)
10.1016/S0140-6736(02)07451-2
Bias and causal associations in observational research
D. Grimes (2002)
10.3310/HTA7270
Evaluating non-randomised intervention studies.
J. Deeks (2003)
10.1136/bmj.331.7521.897
Simultaneous comparison of multiple treatments: combining direct and indirect evidence
D. Caldwell (2005)
10.1093/AJE/KWJ047
Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect.
T. Kurth (2006)
10.1002/hep.21404
Beyond randomized controlled trials: A critical comparison of trials with nonrandomized studies
H. Sørensen (2006)
10.2471/BLT.07.045120
The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.
E. von Elm (2007)
10.1136/bmj.39335.541782.AD
Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies
E. Elm (2007)
10.1002/PDS.1471
Guidelines for good pharmacoepidemiology practices (GPP)
Ispe (2008)
10.1097/EDE.0b013e3181875e61
Observational Studies Analyzed Like Randomized Experiments: An Application to Postmenopausal Hormone Therapy and Coronary Heart Disease
M. Hernán (2008)
10.1001/jama.2008.723
Benefits and risks of drug treatments: how to combine the best evidence on benefits with the best data about adverse effects.
J. Vandenbroucke (2008)
10.1503/cmaj.081086
Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses
J. Ioannidis (2009)
10.1186/1471-2288-10-64
The importance of adjusting for potential confounders in Bayesian hierarchical models synthesising evidence from randomised and non-randomised studies: an application comparing treatments for abdominal aortic aneurysms
C. E. McCarron (2010)
10.1097/MLR.0b013e3181bd49ca
Coordinating Cancer Care: Patient and Practice Management Processes Among Surgeons Who Treat Breast Cancer
S. Katz (2010)
10.1097/MLR.0b013e3181d9919f
Distributed Health Data Networks: A Practical and Preferred Approach to Multi-Institutional Evaluations of Comparative Effectiveness, Safety, and Quality of Care
Jeffrey S. Brown (2010)
10.1016/j.jacc.2011.03.046
Culprit vessel only versus multivessel and staged percutaneous coronary intervention for multivessel disease in patients presenting with ST-segment elevation myocardial infarction: a pairwise and network meta-analysis.
P. Vlaar (2011)
10.1056/NEJMp1014427
Developing the Sentinel System--a national resource for evidence development.
R. Behrman (2011)
10.1371/journal.pone.0025635
Bayesian Hierarchical Models Combining Different Study Types and Adjusting for Covariate Imbalances: A Simulation Study to Assess Model Performance
C. E. McCarron (2011)
10.1002/pds.2053
Combining electronic healthcare databases in Europe to allow for large‐scale drug safety monitoring: the EU‐ADR Project
P. Coloma (2011)
10.1136/bmj.e5798
Risks of harms using antifibrinolytics in cardiac surgery: systematic review and network meta-analysis of randomised and observational studies
B. Hutton (2012)
10.1002/pds.2337
A protocol for active surveillance of acute myocardial infarction in association with the use of a new antidiabetic pharmaceutical agent
B. Fireman (2012)
CNODES: the Canadian Network for Observational Drug Effect Studies
S. Suissa (2012)
10.1038/clpt.2011.345
Adaptive Licensing: Taking the Next Step in the Evolution of Drug Approval
H. Eichler (2012)
10.1177/1740774511420743
Beyond the intention-to-treat in comparative effectiveness research
M. Hernán (2012)
10.1001/2013.jamainternmed.34
Comparative risk for angioedema associated with the use of drugs that target the renin-angiotensin-aldosterone system.
S. Toh (2012)
10.1136/bmj.f6409
Making inferences on treatment effects from real world data: propensity scores, confounding by indication, and other perils for the unwary in observational research
N. Freemantle (2013)
10.1186/1472-6963-13-34
Inter-jurisdictional cooperation on pharmaceutical product listing agreements: views from Canadian provinces
S. Morgan (2013)
10.1186/1741-7015-11-159
Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers
J. Jansen (2013)
10.1136/bmj.f5298
Different combined oral contraceptives and the risk of venous thrombosis: systematic review and network meta-analysis
B. H. Stegeman (2013)
10.1002/sim.5764
Incorporating data from various trial designs into a mixed treatment comparison model.
S. Schmitz (2013)
10.1136/gutjnl-2013-304738
Proton pump inhibitors and the risk of hospitalisation for community-acquired pneumonia: replicated cohort studies with meta-analysis
K. Filion (2013)
10.1111/bju.12247
Relative effectiveness of robot‐assisted and standard laparoscopic prostatectomy as alternatives to open radical prostatectomy for treatment of localised prostate cancer: a systematic review and mixed treatment comparison meta‐analysis
C. Robertson (2013)
10.1136/bmj.f880
Use of high potency statins and rates of admission for acute kidney injury: multicenter, retrospective observational analysis of administrative databases
C. Dormuth (2013)
10.1002/pds.3439
The Asian Pharmacoepidemiology Network (AsPEN): promoting multi‐national collaboration for pharmacoepidemiologic research in Asia
M. Andersen (2013)
10.1007/s12561-012-9073-6
An Analytic Framework for Aligning Observational and Randomized Trial Data: Application to Postmenopausal Hormone Therapy and Coronary Heart Disease
S. Toh (2013)
10.1177/0272989X12458724
Evidence Synthesis for Decision Making 2
S. Dias (2013)
10.1016/j.dss.2012.10.005
ADDIS: A decision support system for evidence-based medicine
G. V. Valkenhoef (2013)
Evidence Synthesis for Decision Making 4: Inconsistency in Networks of Evidence Based on Randomized Controlled Trials
S. Dias (2013)
10.1371/journal.pone.0086754
Characteristics of Networks of Interventions: A Description of a Database of 186 Published Networks
A. Nikolakopoulou (2014)
10.1016/j.ijsu.2014.07.014
Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration.
J. Vandenbroucke (2014)
10.1136/bmj.g5630
A GRADE Working Group approach for rating the quality of treatment effect estimates from network meta-analysis
M. Puhan (2014)
10.1136/bmj.g3244
Higher potency statins and the risk of new diabetes: multicentre, observational study of administrative databases
C. Dormuth (2014)
Mini-Sentinel Distributed Database Summary Report-Year 4
Mini-Sentinel Data Core (2014)
10.7326/M14-2385
The PRISMA Extension Statement for Reporting of Systematic Reviews Incorporating Network Meta-analyses of Health Care Interventions: Checklist and Explanations
B. Hutton (2015)
10.1002/jrsm.1122
Combining randomized and non-randomized evidence in clinical research: a review of methods and applications.
P. Verde (2015)



This paper is referenced by
10.1016/j.cct.2021.106492
Estimation of causal effect in integrating randomized clinical trial and observational data - An example application to cardiovascular outcome trial.
Yafei Zhang (2021)
10.1111/jcpt.13379
Interpretation of network meta-analyses of the efficacy of rheumatoid arthritis drugs.
Y. Urata (2021)
10.1007/s10143-021-01546-w
Basic assumptions of a network meta-analysis — A neurosurgeon’s perspective
K. Garg (2021)
10.1186/s12936-021-03768-1
Methodological approaches for analysing data from therapeutic efficacy studies
Solange Whegang Youdom (2021)
10.1007/s11121-021-01289-6
Network Meta-Analysis Techniques for Synthesizing Prevention Science Evidence
G. Seitidis (2021)
10.1016/J.JCHIRV.2020.12.005
L’omentoplastie diminue l’infection du site opératoire profond comparée au drainage externe après chirurgie conservatrice de l’échinococcose kystique du foie : méta-analyse avec méta-régression
C. Dziri (2021)
10.1186/s12885-021-08446-8
Network meta-analysis of eribulin versus other chemotherapies used as second- or later-line treatment in locally advanced or metastatic breast cancer
Qi Zhao (2021)
10.1016/j.jviscsurg.2021.03.009
Omentoplasty decreases deep organ space surgical site infection compared with external tube drainage after conservative surgery for hepatic cystic echinococcosis: Meta-analysis with a meta-regression.
C. Dziri (2021)
10.1186/s12911-021-01470-5
A bibliometric analysis of global research output on network meta-analysis
Jiyuan Shi (2021)
10.1186/s12913-020-05312-4
The effect of delegation of therapy to allied health assistants on patient and organisational outcomes: a systematic review and meta-analysis
D. Snowdon (2020)
10.1007/s00432-020-03315-6
Systematic review and network meta-analyses of third-line treatments for metastatic colorectal cancer
T. Walter (2020)
10.1371/journal.pone.0234957
Venous thromboembolism prevention in intracerebral hemorrhage: A systematic review and network meta-analysis
V. Yogendrakumar (2020)
10.1007/s10557-020-07097-4
Network Meta-Analysis of Drug Therapies for Lowering Uric Acid and Mortality Risk in Patients with Heart Failure
S. Kodama (2020)
10.1080/03007995.2020.1747998
The importance of considering differences in study and patient characteristics before undertaking indirect treatment comparisons: a case study of siponimod for secondary progressive multiple sclerosis
I. Samjoo (2020)
10.1016/j.clinthera.2020.08.017
Comparative Efficacy of Acalabrutinib in Frontline Treatment of Chronic Lymphocytic Leukemia: a Systematic Review and Network Meta-analysis.
M. Davids (2020)
10.1136/bmjopen-2019-033917
Anticoagulation regimens during pregnancy in patients with mechanical heart valves: a protocol for a systematic review and network meta-analysis
Shiwei He (2020)
10.1101/2020.06.15.20132407
Comparative efficacy and safety of pharmacological interventions for the treatment of COVID-19: A systematic review and network meta-analysis of confounder-adjusted 20212 hospitalized patients
M. Kim (2020)
10.1097/MD.0000000000023562
Effectiveness of different types of ultrasonography screening for developmental dysplasia of the hip
Hae Ra Jung (2020)
10.1007/s40273-020-00981-9
Common Problems, Common Data Model Solutions: Evidence Generation for Health Technology Assessment
S. Kent (2020)
10.1182/ject-2000020
When Evidence Goes "Missing in Action": Implications for Patient Management in Cardiac Surgery.
P. Reynolds (2020)
10.2217/cer-2019-0165
Comparative effectiveness of catheter ablation devices in the treatment of atrial fibrillation: a network meta-analysis.
D. Gupta (2020)
10.1371/journal.pmed.1003501
Comparative efficacy and safety of pharmacological interventions for the treatment of COVID-19: A systematic review and network meta-analysis.
Min Seo Kim (2020)
10.1093/europace/euz210
'Real-world' observational studies in arrhythmia research: data sources, methodology, and interpretation. A position document from European Heart Rhythm Association (EHRA), endorsed by Heart Rhythm Society (HRS), Asia-Pacific HRS (APHRS), and Latin America HRS (LAHRS).
C. Torp-Pedersen (2019)
10.1007/s11065-019-09405-8
Corticosteroids and Cognition: A Meta-Analysis
C. E. Prado (2019)
10.1016/j.phrs.2019.104418
Efficacy and safety of pharmacological treatments for Patent Ductus Arteriosus closure: a systematic review and network meta-analysis of clinical trials and observational studies.
Ettore Marconi (2019)
10.3389/fneur.2019.00089
Extracranial Trigger Site Surgery for Migraine: A Systematic Review With Meta-Analysis on Elimination of Headache Symptoms
A. J. Vincent (2019)
10.1016/j.jclinepi.2019.04.023
Characteristics and methods of incorporating randomized and nonrandomized evidence in network meta-analyses: a scoping review.
Kathryn Zhang (2019)
10.1038/s41598-019-55561-5
Effectiveness of Renin-Angiotensin-Aldosterone System Blockade on Residual Kidney Function and Peritoneal Membrane Function in Peritoneal Dialysis Patients: A Network Meta-Analysis
Sirayut Phatthanasobhon (2019)
10.1007/s00198-019-04947-2
Abaloparatide for risk reduction of nonvertebral and vertebral fractures in postmenopausal women with osteoporosis: a network meta-analysis
J. Reginster (2019)
10.1002/sim.8139
Incorporating single-arm evidence into a network meta-analysis using aggregate level matching: Assessing the impact.
J. Leahy (2019)
The Impact of Performing a Network Meta-Analysis with Imperfect Evidence
J. Leahy (2019)
10.1016/j.ejca.2019.08.032
A systematic literature review and network meta-analysis of effectiveness and safety outcomes in advanced melanoma.
M. Franken (2019)
See more
Semantic Scholar Logo Some data provided by SemanticScholar