Validation of Open-Heart Intraoperative Risk score to predict a prolonged intensive care unit stay for adult patients undergoing cardiac surgery with cardiopulmonary bypass
Authors Tribuddharat S, Sathitkarnmanee T, Ngamsaengsirisup K, Wongbuddha C
Received 29 August 2017
Accepted for publication 1 December 2017
Published 3 January 2018 Volume 2018:14 Pages 53—57
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 2
Editor who approved publication: Professor Garry Walsh
Sirirat Tribuddharat,1 Thepakorn Sathitkarnmanee,1 Kriangsak Ngamsaengsirisup,1 Chawalit Wongbuddha2
1Department of Anesthesiology, 2Division of Cardiothoracic Surgery, Department of Surgery, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand
Background: A prolonged stay in an intensive care unit (ICU) after cardiac surgery with cardiopulmonary bypass (CPB) increases the cost of care as well as morbidity and mortality. Several predictive models aim at identifying patients at risk of prolonged ICU stay after cardiac surgery with CPB, but almost all of them involve a preoperative assessment for proper resource management, while one – the Open-Heart Intraoperative Risk (OHIR) score – focuses on intraoperative manipulatable risk factors for improving anesthetic care and patient outcome.
Objective: We aimed to revalidate the OHIR score in a different context.
Materials and methods: The ability of the OHIR score to predict a prolonged ICU stay was assessed in 123 adults undergoing cardiac surgery (both coronary bypass graft and valvular surgery) with CPB at two tertiary university hospitals between January 2013 and December 2014. The criteria for a prolonged ICU stay matched a previous study (ie, a stay longer than the median).
Results: The area under the receiver operating characteristic curve of the OHIR score to predict a prolonged ICU stay was 0.95 (95% confidence interval 0.90–1.00). The respective sensitivity, specificity, positive predictive value, and accuracy of an OHIR score of ≥3 to discriminate a prolonged ICU stay was 93.10%, 98.46%, 98.18%, and 95.9%.
Conclusion: The OHIR score is highly predictive of a prolonged ICU stay among intraoperative patients undergoing cardiac surgery with CPB. The OHIR comprises of six risk factors, five of which are manipulatable intraoperatively. The OHIR can be used to identify patients at risk as well as to improve the outcome of those patients.
Keywords: predictive models, validation studies, cardiac surgical procedures, cardiopulmonary bypass, intensive care units, OHIR score
A prolonged stay in an intensive care unit (ICU) after cardiac surgery with cardiopulmonary bypass (CPB) increases not only the overall cost of care but also patient morbidity and mortality.1 Being able to predict which patients might have a tendency for a prolonged ICU stay would help with patient and resource management.2
There are several predictive models for identifying patients at risk of prolonged ICU stay after cardiac surgery with CPB,3–6 but almost all of them involve a preoperative assessment for proper resource management. One model – the Open-Heart Intraoperative Risk (OHIR) score – considers intraoperative, manipulatable risk factors for improving anesthetic care and patient outcome.7 The OHIR model comprises six risk factors: age (≥60 years), PaO2/FiO2 (P/F) ratio (≤200 mmHg), platelet count (≤120,000/mm3), inotrope/vasopressor requirement (≥2 drugs), serum potassium (≤3.2 mEq/L), and atrial fibrillation (grading ≥2; Table 1). Five factors in the model can be managed intraoperatively. OHIR has a score of 7; a score of ≥3 indicates a prolonged ICU stay is likely. This scoring model has not been reassessed among different patients with the same type of surgery, hence our objective.
Materials and methods
This was a retrospective, observational, and analytical study. The protocol was approved by the Khon Kaen University Ethics Committee in Human Research (HE581287), with a waiver for requiring informed consent from the patient since confidentiality protection was warranted. The data extracting sheets did not include the name of the patient, and so a unique, masked study number was used instead. This study was registered with ClinicalTrial.gov (NCT02945358).
The inclusion criteria were patients between 18 and 75 years of age undergoing cardiac surgery – ie, both coronary bypass graft and valvular that included the use of CPB. The exclusion criteria were patients undergoing emergency surgery or patients receiving special devices such as intra-aortic balloon pump or extracorporeal membrane oxygenation.
Standard anesthetic and surgical techniques for open-heart surgery with CPB were used. Transfusion criteria included the following: hemoglobin level <8 g/dL, platelet number <50,000/mm3, or clinical coagulopathy. Crystalloid and colloid were used to maintain a central venous pressure of between 8 and 12 mmHg or a pulmonary arterial pressure of between 12 and 15 mmHg. Catecholamine infusions were used to support hemodynamic stability (dobutamine then epinephrine or norepinephrine).
Postsurgery, the patients were transferred to ICU where they received ventilator support. Patients were weaned off the ventilator and extubated when and if they were awake; had satisfactory ventilation and oxygenation (ie, on FiO2 ≤40% with PaO2 >60 mmHg, PaCO2 >30 and <50 mmHg, and pH >7.30, or SpO2 >92%); and had hemodynamic stability. The criteria for discharging patients from the ICU to the cardiovascular ward were as follows: alert and cooperative, respiratory rate <25/min without assistance from mechanical ventilation, PaO2 >80 mmHg and PaCO2 <45 mmHg, hemodynamically stable, and adequate analgesia.
We reviewed all eligible medical records at Srinagarind Hospital and Queen Sirikit Heart Center of the Northeast, Khon Kaen University, between January 2013 and December 2014. The extracted data comprised patient clinical data and all risk factors in the OHIR score at 3 hours after CPB. We applied the OHIR scoring (Table 1) to our data to assess its performance. We used the same criteria for a prolonged ICU stay as our previous study (namely, a stay longer than the median).7
The discrimination ability of the OHIR score to predict a prolonged ICU stay was assessed by evaluating the area under the receiver operating characteristic curve (AUC for ROC). We also determined the sensitivity and specificity, positive and negative predictive values, accuracy, and positive likelihood ratio. Statistical analyses were performed using SPSS for Windows version 16.0 (SPSS Inc., Chicago, IL, USA).
A total of 123 cases were recruited. The median ICU stay was 42 (interquartile range 40–62) hours. Fifty-eight cases were classified as being a prolonged ICU stay. The group having a prolonged ICU stay had a higher age, New York Heart Association class, American Society of Anesthesiologists classification, and more comorbidities. The demographic and clinical data of the patients are listed in Table 2.
Patients with an OHIR score between 0 and 2 had a shorter ICU stay than those with a score between 3 and 6. Table 3 lists the mean ICU stay for each OHIR score.
Table 3 Number of patients and mean ICU stay for each OHIR score
The AUC for ROC of the OHIR score for segregating prolonged ICU stay among our patients yielded a nearly perfect classification of 0.95 (95% confidence interval 0.90–1.00; Figure 1). A cutoff of ≥3 of the OHIR score yielded the maximum sensitivity and specificity (Figure 2).
Figure 1 AUC for ROC of the OHIR score to discriminate a prolonged ICU stay.
Figure 2 Cutoff point for the OHIR score.
The OHIR score had a very high sensitivity, specificity, positive predictive value, and accuracy. Table 4 lists the sensitivity, specificity, positive predictive value, negative predictive value, accuracy, positive likelihood ratio, and AUC for ROC of OHIR score ≥3 for discriminating a prolonged ICU stay.
To identify patients at risk of a prolonged ICU stay, several predictive models have been proposed and used. The EuroSCORE was initially constructed for the prediction of early mortality among cardiac patients in Europe,8,9 but was later validated as a predictive tool for estimating patient risk in terms of ICU stay.10 The reported common risk factors for prolonged ICU stay include the following: 1) advanced age (>65 years), 2) mean pulmonary artery pressure (>21 mmHg), and 3) decreased P/F ratio (<300 mmHg) on admission to ICU.3 Another study included the following: 1) body mass index, 2) type of surgery, 3) CPB machine use, 4) use of packed red cells, 5) nonelective surgery, and 6) number of complications.5
A 2016 systematic review of 29 articles categorized the predictors of ICU length of stay into 11 patient factors, 19 comorbidity factors, 10 surgical factors, and 6 complication factors.6 Most of these risk factors were assessed preoperatively for the purpose of resource management. An OHIR score model, published in 2014, comprised six risk factors: age (≥60 years), P/F ratio (≤200 mmHg), platelet count (≤120,000/mm3), inotrope/vasopressor requirement (≥2 drugs), serum potassium (≤3.2 mEq/L), and atrial fibrillation (grading ≥2).7 All except one risk factor (ie, age ≥60 years) are manageable. The model has a total score of 7, with a score ≥3 suggesting a potentially prolonged ICU stay. The authors claimed that the OHIR score could be used as a guide for managing patients intraoperatively, thereby reducing the score to below 3 so that they would have a lower probability of a prolonged ICU stay.
The median ICU stay in this study was 42 hours, which is the same as our previous study,7 suggesting the appropriateness of the statistical criteria for inferential purposes.
Our study confirms that the OHIR score has a very good discriminatory ability for predicting prolonged ICU stay among adult patients undergoing cardiac surgery with CPB. The overall performance of the OHIR score in the current context is better than our original study. This model may be used as a guide for managing patients intraoperatively so as to reduce their OHIR score to below 3, thereby shortening their ICU stay.
Even though the group of patients in this study was different from our previous study, they were from the same setting. Further study to validate this score in different environments is recommended.
The OHIR score is highly predictive at the intraoperative stage of a prolonged ICU stay among patients undergoing cardiac surgery with CPB. The OHIR comprises six risk factors, with five that are manipulatable intraoperatively. The OHIR can be used to identify patients at risk as well as to improve patient outcomes.
The authors thank Mr Bryan Roderick Hamman for his assistance with the English language presentation of the manuscript under the support of the Publication Clinic, Khon Kaen University, Thailand.
The authors report no conflicts of interest in this work.
Williams TA, Ho KM, Dobb GJ, Finn JC, Knuiman M, Webb SA. Effect of length of stay in intensive care unit on hospital and long-term mortality of critically ill adult patients. Br J Anaesth. 2010;104(4):459–464.
Hein OV, Birnbaum J, Wernecke K, England M, Konertz W, Spies C. Prolonged intensive care unit stay in cardiac surgery: risk factors and long-term-survival. Ann Thorac Surg. 2006;81(3):880–885.
Nakasuji M, Matsushita M, Asada A. Risk factors for prolonged ICU stay in patients following coronary artery bypass grafting with a long duration of cardiopulmonary bypass. J Anesth. 2005;19(2):118–123.
Gruenberg DA, Shelton W, Rose SL, Rutter AE, Socaris S, McGee G. Factors influencing length of stay in the intensive care unit. Am J Crit Care. 2006;15(5):502–509.
Almashrafi A, Alsabti H, Mukaddirov M, Balan B, Aylin P. Factors associated with prolonged length of stay following cardiac surgery in a major referral hospital in Oman: a retrospective observational study. BMJ Open. 2016;6(6):e010764.
Almashrafi A, Elmontsri M, Aylin P. Systematic review of factors influencing length of stay in ICU after adult cardiac surgery. BMC Health Serv Res. 2016;16:318.
Tribuddharat S, Sathitkarnmanee T, Ngamsangsirisup K, et al. Development of an open-heart intraoperative risk scoring model for predicting a prolonged intensive care unit stay. Biomed Res Int. 2014;2014:158051.
Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. 1999;16(1):9–13.
Roques F, Nashef SA, Michel P, et al. Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. Eur J Cardiothorac Surg. 1999;15(6):816–822; discussion 822–823.
Messaoudi N, De Cocker J, Stockman BA, Bossaert LL, Rodrigus IE. Is EuroSCORE useful in the prediction of extended intensive care unit stay after cardiac surgery? Eur J Cardiothorac Surg. 2009;36(1):35–39.
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.Download Article [PDF]