Online citations, reference lists, and bibliographies.

Real-time Prediction Of Inpatient Length Of Stay For Discharge Prioritization

Sean L. Barnes, Eric Hamrock, Matthew F. Toerper, Sauleh Siddiqui, Scott R. Levin
Published 2016 · Computer Science, Medicine
Cite This
Download PDF
Analyze on Scholarcy
Share
OBJECTIVE Hospitals are challenged to provide timely patient care while maintaining high resource utilization. This has prompted hospital initiatives to increase patient flow and minimize nonvalue added care time. Real-time demand capacity management (RTDC) is one such initiative whereby clinicians convene each morning to predict patients able to leave the same day and prioritize their remaining tasks for early discharge. Our objective is to automate and improve these discharge predictions by applying supervised machine learning methods to readily available health information. MATERIALS AND METHODS The authors use supervised machine learning methods to predict patients' likelihood of discharge by 2 p.m. and by midnight each day for an inpatient medical unit. Using data collected over 8000 patient stays and 20 000 patient days, the predictive performance of the model is compared to clinicians using sensitivity, specificity, Youden's Index (i.e., sensitivity + specificity - 1), and aggregate accuracy measures. RESULTS The model compared to clinician predictions demonstrated significantly higher sensitivity (P < .01), lower specificity (P < .01), and a comparable Youden Index (P > .10). Early discharges were less predictable than midnight discharges. The model was more accurate than clinicians in predicting the total number of daily discharges and capable of ranking patients closest to future discharge. CONCLUSIONS There is potential to use readily available health information to predict daily patient discharges with accuracies comparable to clinician predictions. This approach may be used to automate and support daily RTDC predictions aimed at improving patient flow.
This paper references
10.2165/00002018-200730070-00010
Principles of Data Mining
D. Hand (2001)
10.1177/0037549709360912
A Systematic Review of Simulation Studies Investigating Emergency Department Overcrowding
Sharoda A. Paul (2010)
10.4065/82.3.388-c
Patient Flow: Reducing Delay in Healthcare Delivery
Mark A. Nyman (2007)
10.2106/00004623-200307000-00014
Predicting Range of Motion After Total Knee Arthroplasty: Clustering, Log-Linear Regression, and Regression Tree Analysis
Merrill A. Ritter (2003)
10.1007/BF02985802
The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition
Trevor J. Hastie (2009)
10.1111/j.1553-2712.2011.01125.x
Predicting hospital admissions at emergency department triage using routine administrative data.
Yan Sun (2011)
Memorandum Report: Hospitals’ Use of Observation Status and Short Inpatient Stays for Medicare Beneficiaries, OEI-02-12-00040
S. Wright (2013)
10.1097/00115514-201303000-00007
Discrete Event Simulation for Healthcare Organizations: A Tool for Decision Making
Eric Hamrock (2013)
10.1016/j.jamcollsurg.2011.02.009
Use of lean and six sigma methodology to improve operating room efficiency in a high-volume tertiary-care academic medical center.
R. Cima (2011)
10.1016/j.annemergmed.2007.12.011
Forecasting Emergency Department Crowding by Discrete Event Simulation
Nathan R. Hoot (2008)
10.1007/s00423-008-0352-0
Impact of clinical pathways in surgery
M. Müller (2008)
10.1136/bmj.323.7322.1192
Crossing the Quality Chasm: A New Health System for the 21st Century
A. Baker (2001)
10.1023/A:1020390425029
Forecasting Demand of Emergency Care
Simon Jones (2002)
10.1111/acem.12244
Generalizability of a simple approach for predicting hospital admission from an emergency department.
J. Peck (2013)
10.1016/0003-9993(94)90182-1
Predicting stroke inpatient rehabilitation outcome using a classification tree approach.
Judith A. Falconer (1994)
10.1111/j.1553-2712.2000.tb00492.x
Critical care in the emergency department: A physiologic assessment and outcome evaluation.
H B Nguyen (2000)
10.1016/S1553-7250(11)37029-8
Using real-time demand capacity management to improve hospitalwide patient flow.
Roger K. Resar (2011)
The relationship between inpatient length of stay and HCAHPS Scores
R Carden (2013)
10.1136/jech.44.4.307
Models for forecasting hospital bed requirements in the acute sector.
Richard D.T. Farmer (1990)
10.1111/J.1937-5956.2011.01226.X
Reducing Surgical Ward Congestion Through Improved Surgical Scheduling and Uncapacitated Simulation
Vincent S. Chow (2011)
10.1109/WSC.1994.717446
Using simulation to reduce length of stay in emergency departments
Frank McGuire (1994)
10.1055/s-0038-1634530
Differentiation of benign and malignant breast tumors by logistic regression and a classification tree using Doppler flow signals.
Willi Sauerbrei (1998)
10.1016/S1553-7250(09)35073-4
Redesigning intensive care unit flow using variability management to improve access and safety.
Frederick C. Ryckman (2009)
10.1197/jamia.M2772
Research Paper: Forecasting Emergency Department Crowding: A Prospective, Real-time Evaluation
Nathan R. Hoot (2009)
10.1111/j.1553-2712.2009.00397.x
Emergency department patient flow: the influence of hospital census variables on emergency department length of stay.
Ray A. Lucas (2009)
10.1093/ije/dyq191
The proof and measurement of association between two things.
Courtney Spearman (2010)
10.1097/00004010-200504000-00002
Managing Hospital Length of Stay Reduction: A Multihospital Approach
Ronald J. Lagoe (2005)
10.1016/0169-2070(89)90087-3
Modeling and forecasting hospital patient movements: Univariate and multiple time series approaches
Winston T. Lin (1989)
10.1016/j.jclinepi.2012.11.008
Using methods from the data-mining and machine-learning literature for disease classification and prediction: a case study examining classification of heart failure subtypes.
Peter C. Austin (2013)
10.1007/BF00116037
The strength of weak learnability
Robert E. Schapire (1990)
10.1111/j.1553-2712.2012.01435.x
Predicting emergency department inpatient admissions to improve same-day patient flow.
Jordan Peck (2012)
10.1186/1472-6947-13-3
Decision support for hospital bed management using adaptable individual length of stay estimations and shared resources
Robert Schmidt (2013)
10.1111/j.1553-2712.2007.00032.x
Forecasting daily patient volumes in the emergency department.
Spencer S. Jones (2008)
10.1007/BF02295996
Note on the sampling error of the difference between correlated proportions or percentages
Q. Mcnemar (1947)
10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3
Index for rating diagnostic tests.
W. J. Youden (1950)
10.1287/opre.1120.1105
Optimizing Intensive Care Unit Discharge Decisions with Patient Readmissions
Carri W. Chan (2012)
10.1016/j.ejor.2009.07.036
A hybrid model of integer programming and variable neighbourhood search for highly-constrained nurse rostering problems
Edmund K. Burke (2010)
10.1097/QMH.0b013e3181eece6e
Applying Lean Six Sigma Methodologies to Improve Efficiency, Timeliness of Care, and Quality of Care in an Internal Medicine Residency Clinic
Daniel Fischman (2010)
10.1002/bimj.200410135
Estimation of the Youden Index and its associated cutoff point.
R. Fluss (2005)
10.1287/opre.1110.0943
Identifying Good Nursing Levels: A Queuing Approach
Natalia Yankovic (2011)
Building a Better Delivery System: A New Engineering/Health Care Partnership
Proctor P. Reid (2005)
10.1007/978-1-4614-9512-3_1
Modeling Patient Flows Through the Health care System
Randolph W. Hall (2013)
10.3109/03091902.2011.595528
Impact of different discharge patterns on bed occupancy rate and bed waiting time: a simulation approach
Zhecheng Zhu (2011)
10.1016/S0168-8227(96)90004-2
Population screening for glucose intolerant subjects using decision tree analyses.
Katherine J. Barriga (1996)
10.1073/pnas.28.3.94
On Contingency Tables.
E. B. Wilson (1942)
10.1057/palgrave.jors.2600669
Application of discrete-event simulation in health care clinics: A survey
J. B. Jun. (1999)
10.1097/01.ede.0000147512.81966.ba
Optimal Cut-point and Its Corresponding Youden Index to Discriminate Individuals Using Pooled Blood Samples
Enrique F. Schisterman (2005)
10.1111/j.1553-2712.2008.00083.x
The challenge of predicting demand for emergency department services.
Melissa Lee McCarthy (2008)
10.1016/j.aorn.2007.06.011
Using Six Sigma and Lean methodologies to improve OR throughput.
Catharine B Fairbanks (2007)
10.1016/S0305-0548(03)00249-1
A 0-1 goal programming model for nurse scheduling
M. N. Azaiez (2005)
10.1186/1472-6947-13-1
Impact of unlinked deaths and coding changes on mortality trends in the Swiss National Cohort
Kurt Schmidlin (2013)
10.1001/archinte.164.19.2135
Health services use and health care costs of obese and nonobese individuals.
Marsha A. Raebel (2004)
10.1056/NEJM199606063342303
Prediction of the need for intensive care in patients who come to emergency departments with acute chest pain.
L. Elizabeth Goldman (1996)
10.1023/A:1010933404324
Random Forests
Leo Breiman (2004)
10.1287/mnsc.42.6.891
Medical resident work schedules: design and evaluation by simulation modeling
R. Dittus (1996)
10.1016/j.annemergmed.2007.01.017
Measuring and forecasting emergency department crowding in real time.
Nathan R. Hoot (2007)
10.1111/1475-6773.00041
Concurrent prediction of hospital mortality and length of stay from risk factors on admission.
David E. Clark (2002)
10.1007/BF00058655
Bagging predictors
L. Breiman (1996)
10.3171/jns.1995.82.5.0764
Classification and regression trees (CART) for prediction of function at 1 year following head trauma.
N. Temkin (1995)
10.1097/01.CCM.0000266585.74905.5A
Impact of delayed transfer of critically ill patients from the emergency department to the intensive care unit*
Donald B. Chalfin (2007)
10.1007/s10729-006-9000-9
Short term hospital occupancy prediction
Steven J. Littig (2007)
10.1093/intqhc/mzr010
Regression models for analyzing costs and their determinants in health care: an introductory review.
Dario Gregori (2011)
10.1007/s10729-006-9006-3
The application of forecasting techniques to modeling emergency medical system calls in Calgary, Alberta
Nabil Channouf (2007)
10.1016/j.annemergmed.2009.05.021
Optimizing emergency department front-end operations.
J. Wiler (2010)
10.1007/s00423-008-0303-9
Clinical Pathways in surgery—should we introduce them into clinical routine? A review article
Ulrich Ronellenfitsch (2008)
10.1111/j.1553-2712.2008.00295.x
The effect of emergency department crowding on clinically oriented outcomes.
Steven L Bernstein (2009)
10.3171/jns.1995.83.5.0941
CART for prediction of function after head trauma.
T. Germanson (1995)
10.1503/cmaj.091977
Nutritional parameters associated with prolonged hospital stay among ambulatory adult patients
Riccardo Caccialanza (2010)
10.1097/CCM.0b013e31825bc399
Real-time forecasting of pediatric intensive care unit length of stay using computerized provider orders
S. Levin (2012)
10.1136/bmj.319.7203.155
Dynamics of bed use in accommodating emergency admissions: stochastic simulation model
A. Bagust (1999)
10.1007/s10389-009-0266-5
Optimization of hospital stay through length-of-stay-oriented case management: an empirical study
Florian Kainzinger (2009)
10.1016/S0168-8510(97)00062-6
Predictors of health care utilization in the chronically ill: a review of the literature.
Angela Gem de Boer (1997)
10.2307/2530946
Classification and Regression Trees
Leo Breiman (1983)
Index for rating diagnostic tests. Cancer. 1950;3:32–35
Youden (1950)
Memorandum Report: Hospitals’ Use of Observation Status and Short Inpatient Stays for Medicare Beneficiaries, OEI-02-12-00040
S. Wright (2013)
The impact of nurse staffing on hospital costs and patient length of stay: a systematic review.
P. Thungjaroenkul (2007)
10.1111/j.1475-6773.2007.00761.x
Regression tree boosting to adjust health care cost predictions for diagnostic mix.
John W. Robinson (2008)
10.1002/sim.6432
Efficient statistical tests to compare Youden index: accounting for contingency correlation.
Fangyao Chen (2015)
10.1162/153244304322972694
Tree Induction Vs Logistic Regression: A Learning Curve Analysis
Claudia Perlich (2003)
10.1136/bmjqs.2008.030007
Evaluating the effects of increasing surgical volume on emergency department patient access
Scott R. Levin (2011)
10.1111/j.1572-0241.2002.07059.x
Screening for colorectal cancer: the cost to find an advanced adenoma
Jerry S McGrath (2002)
10.1016/0022-1759(95)00121-P
A modified ROC analysis for the selection of cut-off values and the definition of intermediate results of serodiagnostic tests.
M. Greiner (1995)



This paper is referenced by
10.1016/j.ejim.2018.06.014
Living alone as an independent predictor of prolonged length of hospital stay and non-home discharge in older patients.
Pasquale Agosti (2018)
10.1007/s10916-018-0988-4
An Electronic Dashboard to Monitor Patient Flow at the Johns Hopkins Hospital: Communication of Key Performance Indicators Using the Donabedian Model
Diego A. Martinez (2018)
10.1097/QMH.0000000000000224
Forecasting Patient Discharge Before Noon: A Comparison Between Holt's and Box-Jenkins' Models
Rolando A Berríos (2019)
10.1287/educ.2019.0202
Health System Innovation: Analytics in Action
Martin S. Copenhaver (2019)
Predicting surgical inpatients' discharges at Massachusetts General Hospital
Jonathan Zanger (2018)
10.12788/jhm.2802
The TEND (Tomorrow’s Expected Number of Discharges) Model Accurately Predicted the Number of Patients Who Were Discharged from the Hospital the Next Day
C. van Walraven (2018)
10.14400/JDC.2018.16.1.231
Development of Predictive Model for Length of Stay(LOS) in Acute Stroke Patients using Artificial Intelligence
Byung Kwon Choi (2018)
Machine learning in healthcare : an investigation into model stability
S. Gopakumar (2017)
10.22037/AAEM.V7I1.410
Applications of Machine Learning Approaches in Emergency Medicine; a Review Article
Negin Shafaf (2019)
10.1155/2019/4571636
Predicting Intracerebral Hemorrhage Patients' Length-of-Stay Probability Distribution Based on Demographic, Clinical, Admission Diagnosis, and Surgery Information
Li Luo (2019)
Predicting Inpatient Discharge Prioritization With Electronic Health Records
Anand Avati (2018)
10.12788/jhm.3094
Barriers to Earlier Hospital Discharge: What Matters Most?
D. Jensen Peter (2018)
Length-of-stay and mortality prediction for a major hospital through interpretable machine learning
Dimitris Bertsimas (2019)
10.1016/j.arth.2019.05.048
Predicting Inpatient Payments Prior to Lower Extremity Arthroplasty Using Deep Learning: Which Model Architecture Is Best?
Jaret M. Karnuta (2019)
10.1016/j.im.2020.103282
Data analytics for the sustainable use of resources in hospitals: Predicting the length of stay for patients with chronic diseases
Hamed Majidi Zolbanin (2020)
TIME SERIES MODELS IN FORECASTING
Anthony Truff (2017)
10.1080/24725579.2017.1346729
Evaluating nurse staffing levels in perianesthesia care units using discrete event simulation
Sauleh Siddiqui (2017)
10.18420/ihc2017_009
A Methodology to Assess Changes in Healthcare Infrastructure in Stockholm
Vinutha Magal Shreenath (2017)
Tree Based Modeling Techniques Applied to Hospital Length of Stay
Rupansh Goantiya (2018)
10.1155/2018/7174803
An Evolutionary Computation Approach for Optimizing Multilevel Data to Predict Patient Outcomes
Sean L. Barnes (2018)
10.1016/j.ijcard.2019.01.046
Predictors of in-hospital length of stay among cardiac patients: A machine learning approach.
Tahani Daghistani (2019)
10.1001/jamanetworkopen.2019.17221
Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care
Kyan Cyrus Safavi (2019)
Predicting the Discharge Date of Patients using Classification Techniques
Vinil Paul (2018)
10.1016/j.procs.2017.08.343
Classification of Asthma Severity and Medication Using TensorFlow and Multilevel Databases
Quan T. Do (2017)
Learning Representations of Missing Data for Predicting Patient Outcomes
Brandon M. Malone (2018)
10.1101/2020.05.12.20098848
Predicting inpatient flow at a major hospital using interpretable analytics
Dimitris Bertsimas (2020)
10.1111/risa.13393
Modeling Pathology Workload and Complexity to Manage Risks and Improve Patient Quality and Safety.
David M Vanlandingham (2019)
10.1136/bmjopen-2018-026599
Multicentre, prospective observational study of the correlation between the Glasgow Admission Prediction Score and adverse outcomes
Dominic Jones (2019)
10.1136/emermed-2017-207246
Comparison of Glasgow Admission Prediction Score and Amb Score in predicting need for inpatient care
Allan Cameron (2018)
10.1109/BIBM47256.2019.8983281
Inpatient2Vec: Medical Representation Learning for Inpatients
Ying Wang (2019)
Predicting Short-term Hospital Inpatient Bed Needs for Up to Four Days in Advance
Salem Jabr (2017)
10.18745/TH.21813
Demand and Capacity Modelling of Acute Services Using Simulation and Optimization Techniques
Muhammed Ordu (2019)
See more
Semantic Scholar Logo Some data provided by SemanticScholar