Online citations, reference lists, and bibliographies.
← Back to Search

The Society Of Thoracic Surgeons 2008 Cardiac Surgery Risk Models: Part 1--coronary Artery Bypass Grafting Surgery.

D. Shahian, S. O'Brien, G. Filardo, V. Ferraris, C. Haan, J. Rich, S. Normand, E. DeLong, C. Shewan, Rachel S. Dokholyan, E. Peterson, F. Edwards, R. Anderson
Published 2009 · Medicine

Save to my Library
Download PDF
Analyze on Scholarcy
Share
BACKGROUND The first version of The Society of Thoracic Surgeons National Adult Cardiac Surgery Database (STS NCD) was developed nearly 2 decades ago. Since its inception, the number of participants has grown dramatically, patient acuity has increased, and overall outcomes have consistently improved. To adjust for these and other changes, all STS risk models have undergone periodic revisions. This report provides a detailed description of the 2008 STS risk model for coronary artery bypass grafting surgery (CABG). METHODS The study population consisted of 774,881 isolated CABG procedures performed on adult patients aged 20 to 100 years between January 1, 2002, and December 31, 2006, at 819 STS NCD participating centers. This cohort was randomly divided into a 60% training (development) sample and a 40% test (validation) sample. The development sample was used to identify predictor variables and estimate model coefficients. The validation sample was used to assess model calibration and discrimination. Model outcomes included operative mortality, renal failure, stroke, reoperation for any cause, prolonged ventilation, deep sternal wound infection, composite major morbidity or mortality, prolonged length of stay (> 14 days), and short length of stay (< 6 days and alive). Candidate predictor variables were selected based on their availability in versions 2.35, 2.41, and 2.52.1 of the STS NCD and their presence in (or ability to be mapped to) version 2.61. Potential predictor variables were screened for overall prevalence in the study population, missing data frequency, coding concerns, bivariate relationships with outcomes, and their presence in previous STS or other CABG risk models. Supervised backwards selection was then performed with input from an expert panel of cardiac surgeons and biostatisticians. After successfully validating the fit of the models, the development and validation samples were subsequently combined, and the final regression coefficients were estimated using the overall combined (development plus validation) sample. RESULTS The c-index for the mortality model was 0.812, and the c-indices for other endpoints ranged from 0.653 for reoperation to 0.793 for renal failure in the validation sample. Plots of observed versus predicted event rates revealed acceptable calibration in the overall population and in numerous subgroups. When patients were grouped into categories of predicted risk, the absolute difference between the observed and expected event rates was less than 1.5% for each endpoint. The final model intercept and coefficients are provided. CONCLUSIONS New STS risk models have been developed for CABG mortality and eight other endpoints. Detailed descriptions of model development and testing are provided, together with the final algorithm. Overall model performance is excellent.
This paper references
10.1145/187436.187458
Medical information systems: characterization and challenges
J. Ramirez (1994)
10.1161/CIRCULATIONAHA.104.515049
Generic, Simple Risk Stratification Model for Heart Valve Surgery
G. Ambler (2005)
Statistical modeling: The two cultures
L. Breiman (2001)
10.1016/S0003-4975(98)00261-6
Updates to the Data Quality Review Program: the Society of Thoracic Surgeons Adult Cardiac National Database.
A. Shroyer (1998)
10.1016/j.athoracsur.2007.11.074
Do we need separate risk stratification models for hospital mortality after heart valve surgery?
M. van Gameren (2008)
10.1016/S0003-4975(01)03333-1
Cardiac surgery report cards: making the grade.
G. Grunkemeier (2001)
10.1016/j.jamcollsurg.2008.02.009
Transparency: a mandatory requirement for risk models.
D. Shahian (2008)
10.1093/BIOMET/78.3.691
A note on a general definition of the coefficient of determination
N. Nagelkerke (1991)
10.1016/J.ATHORACSUR.2006.09.051
Risk index for predicting in-hospital mortality for cardiac valve surgery.
E. Hannan (2007)
10.1016/J.ATHORACSUR.2003.07.030
Validity of the Society of Thoracic Surgeons National Adult Cardiac Surgery Database.
K. Welke (2004)
10.1001/JAMA.1990.03450210068035
Adult open heart surgery in New York State. An analysis of risk factors and hospital mortality rates.
E. Hannan (1990)
10.1016/S0003-4975(00)02168-8
Similarity between the STS and New York State databases for valvular heart disease.
F. Grover (2000)
10.1161/CIRCULATIONAHA.106.672402
Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction
N. Cook (2007)
10.1016/0003-4975(96)00821-1
Calculating risk and outcome: the Veterans Affairs database.
F. Grover (1996)
10.1016/S0003-4975(01)03222-2
Cardiac surgery report cards: comprehensive review and statistical critique.
D. Shahian (2001)
10.1016/S0003-4975(00)01968-8
Predictors of mortality for patients undergoing cardiac valve replacements in New York State.
E. Hannan (2000)
10.1001/JAMA.1991.03460220094040
'Black box' medical information systems. A technology needing assessment.
L. Iezzoni (1991)
10.1016/0003-4975(93)90670-D
Factors predictive of operative mortality among coronary artery bypass subsets.
F. Grover (1993)
10.1016/J.ATHORACSUR.2007.06.022
Comparison of cardiac surgery volumes and mortality rates between the Society of Thoracic Surgeons and Medicare databases from 1993 through 2001.
K. Welke (2007)
10.1002/SIM.2929
Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond.
M. J. Pencina (2008)
10.1093/BIOMET/73.1.13
Longitudinal data analysis using generalized linear models
K. Liang (1986)
10.1016/S0022-5223(94)70434-1
Do different investigators sometimes produce different multivariable equations from the same data?
D. Naftel (1994)
10.1016/S0003-4975(10)62482-4
Report of the Ad Hoc Committee on Risk Factors for Coronary Artery Bypass Surgery.
N. Kouchoukos (1988)
10.1161/CIRCULATIONAHA.105.580084
Impact of Renal Dysfunction on Outcomes of Coronary Artery Bypass Surgery: Results From the Society of Thoracic Surgeons National Adult Cardiac Database
W. Cooper (2006)
10.1016/S0003-4975(03)00179-6
The Society of Thoracic Surgeons: 30-day operative mortality and morbidity risk models.
A. Shroyer (2003)
10.1016/J.ATHORACSUR.2005.05.044
What is the future of mortality prediction models in heart valve surgery?
E. Nowicki (2005)
10.1016/J.ATHORACSUR.2003.12.035
Multivariable prediction of in-hospital mortality associated with aortic and mitral valve surgery in Northern New England.
E. Nowicki (2004)
10.1016/0003-4975(89)90665-6
It is time for a national cardiothoracic surgical data base.
R. Clark (1989)
10.1016/0003-4975(94)90358-1
Coronary artery bypass grafting: the Society of Thoracic Surgeons National Database experience.
F. Edwards (1994)
10.1016/S0003-4975(99)00175-7
Risk stratification for cardiac valve replacement. National Cardiac Surgery Database. Database Committee of The Society of Thoracic Surgeons.
W. Jamieson (1999)
10.1016/S1010-7940(99)00134-7
European system for cardiac operative risk evaluation (EuroSCORE).
S. Nashef (1999)
Eurp-pean system for cardiac operative risk evaluation (Euro SCORE)
Sa Nashef (1999)
10.1016/0003-4975(96)00589-9
Data quality review program: the Society of Thoracic Surgeons Adult Cardiac National Database.
F. Grover (1996)
10.2307/3172915
Statistical Analysis with Missing Data
R. Little (1987)
10.1097/01.CCM.0000281522.70992.EF
Size matters to a model's fit.
J. Marcin (2007)
10.1016/J.ATHORACSUR.2003.12.018
Are unaudited records from an outcomes registry database accurate?
M. Herbert (2004)
10.1016/S0735-1097(97)00295-7
Assessing the outcomes of coronary artery bypass graft surgery: how many risk factors are enough? Steering Committee of the Cardiac Care Network of Ontario.
J. Tu (1997)
Risk factors for early mortality after valve surgery in Europe in the 1990s: lessons from the EuroSCORE pilot program.
F. Roques (2001)
10.1016/S0735-1097(96)00359-2
Identification of preoperative variables needed for risk adjustment of short-term mortality after coronary artery bypass graft surgery. The Working Group Panel on the Cooperative CABG Database Project.
R. Jones (1996)
10.1001/JAMA.1991.03470060065028
A regional prospective study of in-hospital mortality associated with coronary artery bypass grafting. The Northern New England Cardiovascular Disease Study Group.
G. O'connor (1991)
10.1016/J.JTCVS.2005.10.041
Determinants of operative mortality in valvular heart surgery.
J. Rankin (2006)
Regression Modeling Strategies with Applications to Linear Models
F. Harrell (2001)
Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models
E. Vittinghoff (2005)
10.1002/SIM.2770
A comparison of regression trees, logistic regression, generalized additive models, and multivariate adaptive regression splines for predicting AMI mortality.
P. Austin (2007)
10.1016/S0735-1097(00)01202-X
Prediction of operative mortality after valve replacement surgery.
F. Edwards (2001)
Evolution of the Society of Thoracic Surgeons National Cardiac Surgery Database.
Edwards Fh (1998)
10.1161/01.CIR.85.6.2110
Multivariate Prediction of In‐Hospital Mortality Associated With Coronary Artery Bypass Graft Surgery
G. O'connor (1992)
10.1016/J.ATHORACSUR.2004.05.054
Cardiac surgery risk models: a position article.
D. Shahian (2004)
10.1214/SS/1009213726
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
L. Breiman (2001)
10.1001/JAMA.266.6.803
A regional prospective study of in-hospital mortality associated with coronary artery bypass grafting. The Northern New England Cardiovascular Disease Study Group.
G. T. O'connor (1991)
O'Brien's
Frank E. Miss Collector Buttolph (1959)
10.1016/S0003-4975(03)01585-6
Comparison of short-term mortality risk factors for valve replacement versus coronary artery bypass graft surgery.
S. Gardner (2004)
10.1097/00000658-200110000-00006
A Decade’s Experience With Quality Improvement in Cardiac Surgery Using the Veterans Affairs and Society of Thoracic Surgeons National Databases
F. Grover (2001)
10.1214/088342307000000096
Statistical and Clinical Aspects of Hospital Outcomes Profiling
S. Normand (2007)
10.1016/J.ATHORACSUR.2005.02.066
Validation and refinement of mortality risk models for heart valve surgery.
R. Jin (2005)



This paper is referenced by
Blood Pressure Variability: Can Nonlinear Dynamics Enhance Risk Assessment During Cardiovascular Surgery? A Feasibility Study
Balachundhar Subramaniam (2014)
10.4172/2324-8602.1000220
Development and Validation of a Prognostic Index for Early Mortality after Aortic Valve Replacement
Emiliano Angeloni (2016)
10.5072/PRISM/27477
Psychosocial Variables and Recovery from Coronary Artery Bypass Graft Surgery in Men and Women
Sandra N. Young (2014)
10.7793/JCORON.20.021
Coronary artery bypass grafting for patients with pulmonary dysfunction
Mitsuru Yuzaki (2014)
10.1016/j.athoracsur.2016.09.035
The Society of Thoracic Surgeons Mitral Valve Repair/Replacement Plus Coronary Artery Bypass Grafting Composite Score: A Report of The Society of Thoracic Surgeons Quality Measurement Task Force.
J. Rankin (2017)
10.1016/j.athoracsur.2013.06.030
Preoperative hematocrit is a powerful predictor of adverse outcomes in coronary artery bypass graft surgery: a report from the Society of Thoracic Surgeons Adult Cardiac Surgery Database.
M. Williams (2013)
10.1161/CIR.0b013e31823c074e
2011 ACCF/AHA Guideline for Coronary Artery Bypass Graft Surgery: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines.
L. Hillis (2011)
10.1001/jama.2012.8363
Association between endoscopic vs open vein-graft harvesting and mortality, wound complications, and cardiovascular events in patients undergoing CABG surgery.
J. Williams (2012)
10.4244/EIJV8I2A40
The SURTAVI model: proposal for a pragmatic risk stratification for patients with severe aortic stenosis.
N. V. Van Mieghem (2012)
10.1093/ejcts/ezx058
The flaws in the detail of an observational study on transcatheter aortic valve implantation versus surgical aortic valve replacement in intermediate-risks patients
F. Barili (2017)
10.1016/j.ahj.2016.04.021
Development and validation of a risk model for in-hospital worsening heart failure from the Acute Decompensated Heart Failure National Registry (ADHERE).
Adam D DeVore (2016)
10.1016/j.cger.2016.01.004
Assessing Risks and Benefits of Invasive Cardiac Procedures in Patients with Advanced Multimorbidity.
A. Orkaby (2016)
10.1093/ejcts/ezs406
Validation of EuroSCORE II in a modern cohort of patients undergoing cardiac surgery.
J. Chalmers (2013)
10.1016/j.jtcvs.2017.09.149
Differential effects of operative complications on survival after surgery for primary lung cancer
F. Fernandez (2018)
10.15275/KREATKARD.2016.01.03
Myocardial revascularization in patients with stable coronary artery disease: the stratification of perioperative and long-term risks
N. Sokolova (2016)
10.1016/j.athoracsur.2018.04.053
The Impact of Mitral Disease Etiology on Operative Mortality After Mitral Valve Operations.
J. Rankin (2018)
10.4172/2324-8602.1000271
Long Term Efficacy of Prasugrel versus Clopidogrel in Patients undergoing Percutaneous Coronary Intervention and Anticoagulated with Bivalirudin
Mina M Benjamin (2016)
10.1016/J.JCIN.2015.11.003
Cerebral Embolic Protection in Catheter-Based Mitral Interventions: Research or Clinical Tool?
N. M. Mieghem (2016)
10.1097/SLA.0000000000000282
Reply to letter: "Surgical statistics: let's act fast and grasp the opportunity".
D. Shahian (2014)
10.1016/j.jtcvs.2013.12.063
Long-term outcomes of coronary artery bypass grafting patients supported preoperatively with an intra-aortic balloon pump.
Eli Hemo (2014)
10.1016/S1443-9506(17)31424-5
Timing of Surgery for ST-Elevation Myocardial Infarction.
A. Cochrane (2017)
10.1093/ICVTS/IVW224
Performance of EuroSCORE II and SinoSCORE in Chinese patients undergoing coronary artery bypass grafting.
Y. Bai (2016)
10.1186/1749-8090-8-177
Development of a predictive model for major adverse cardiac events in a coronary artery bypass and valve population
C. Herman (2013)
10.1016/j.jtcvs.2020.01.077
Anticoagulation and amiodarone for new atrial fibrillation after coronary artery bypass grafting: Prescription patterns and 30-day outcomes in the United States and Canada.
J. Matos (2020)
10.1016/j.jtcvs.2020.07.105
Machine learning improves mortality risk prediction after cardiac surgery: Systematic review and meta-analysis.
U. Benedetto (2020)
10.1016/j.bja.2019.10.023
Cost-effectiveness of routine transoesophageal echocardiography during cardiac surgery: a discrete-event simulation study.
J. Dieleman (2019)
10.1016/j.semnephrol.2020.01.008
Perioperative Clinical Trials in AKI.
D. McIlroy (2020)
10.7249/PE170
A Methodological Critique of the ProPublica Surgeon Scorecard.
M. Friedberg (2016)
10.1016/B978-0-323-42880-4.00024-8
24 – Managing Chronic Coronary Artery Disease in Patients with Diabetes
Nikolaus Marx (2018)
10.4091/IKEN.21.435
A Review of Propriety of Clinical Database for Quality Improvement Initiative
Suguru Okubo (2012)
10.1007/s00398-015-0006-9
Gefäßerkrankungen und -komplikationen im Rahmen von Herzoperationen
Florian Lüders (2015)
10.5772/INTECHOPEN.75881
Long-Term Outcome of High-Risk Percutaneous Coronary Interventions with Extracorporeal Membrane Oxygenation Support for Patients Without Cardiogenic Shock
V. Ganyukov (2018)
See more
Semantic Scholar Logo Some data provided by SemanticScholar