Back to Journals » Therapeutics and Clinical Risk Management » Volume 18

A Nomogram for Predicting In-Hospital Major Adverse Cardio- and Cerebro-Vascular Events in Patients Undergoing Major Noncardiac Surgery: A Large-Scale Nested Case-Control Study

Authors Wu X, Zhang J, Hu M , Gu L, Li K , Yang X 

Received 27 January 2022

Accepted for publication 15 April 2022

Published 22 April 2022 Volume 2022:18 Pages 457—465

DOI https://doi.org/10.2147/TCRM.S359950

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Deyun Wang



Xuejiao Wu,1 Jianjun Zhang,1 Mei Hu,1 Le Gu,1 Kuibao Li,2 Xinchun Yang2

1Heart Center, Beijing Chaoyang Hospital Jingxi Branch, Capital Medical University, Beijing, People’s Republic of China; 2Heart Center, Beijing Chaoyang Hospital, Capital Medical University, Beijing, People’s Republic of China

Correspondence: Xinchun Yang, Heart Center, Beijing Chaoyang Hospital, Capital Medical University, 8 Gongren Tiyuchang Nanlu, Beijing, 100020, People’s Republic of China, Tel +86 15810147680, Email [email protected]

Purpose: Few evidence-based predictive tools are available to evaluate major adverse cardio- and cerebro-vascular events (MACCEs) before major noncardiac surgery. We sought to develop a new simple but effective tool for estimating surgical risk.
Patients and Methods: Using a nested case-control study design, we recruited 105 patients who experienced MACCEs and 481 patients without MACCEs during hospitalization from 10,507 patients undergoing major noncardiac surgery in Beijing Chaoyang hospital. Least absolute shrinkage and selection operator (LASSO) regression and likelihood ratio were applied to screen 401 potential features for logistic regression. A nomogram was constructed using the selected variables.
Results: Chronic heart failure, valvular heart disease, preoperative serum creatinine > 2.0 mg/dL, ASA class, neutrophil count and age were most associated with in-hospital MACCEs among all the factors. A new prediction model established based on these showed a good discriminatory ability (AUC, 0.758 [95% confidence interval (CI), 0.708– 0.808] and a well-performed calibration curve (Hosmer–Lemeshow χ2 = 7.549, p = 0.479), which upheld in the 10-fold cross-validation (AUC, 0.742 [95% CI, 0.718– 0.767]. This model also demonstrated an improved performance in comparison to the modified Revised Cardiac Risk Index (RCRI) score (increase in AUC by 0.119 [95% CI, 0.056– 0.180]; NRI, 0.445 [95% CI, 0.237– 0.653]; IDI, 0.133 [95% CI, 0.087– 0.178]. The decision curve analysis showed a positive net benefit of our new model.
Conclusion: Our nomogram, which relies upon simple clinical characteristics and laboratory tests, is able to predict MACCEs in patients undergoing major noncardiac surgery. This prediction shows better discrimination than the standardized modified RCRI score, laying a promising foundation for further large-scale validation.

Keywords: major adverse cardiovascular events, cerebrovascular events, perioperative period, risk assessment, cardiac risk indexes

Introduction

With the aging of population and the advancement of medical technology, the need for major noncardiac surgery in patients with heart diseases is also increasing in recent years.1 Within the over 200 million patients undergoing major noncardiac surgery in the world each year,2,3 more than 10 million of them suffer from major cardiac complications,4,5 which leads to increased morbidity and mortality.6 Therefore, it is of great importance to evaluate the risk of major adverse cardiovascular events (MACEs) before major noncardiac surgery.

There are three preoperative cardiac risk indexes that are commonly used and endorsed in guidelines: the modified Revised Cardiac Risk Index (RCRI),7 the National Surgical Quality Improvement Program (NSQIP) Myocardial Infarction and Cardiac Arrest (MICA) calculator,8 and the American College of Surgeons NSQIP (ACS NSQIP) Surgical Risk Calculator.9 These indexes are routinely used in clinical practice for predicting the risk of MACEs in patients undergoing noncardiac surgery. However, there are several potential imperfections worth noting as well. First of all, the endpoints evaluated by these indexes do not include cerebrovascular diseases whose incidence has largely increased in recent years.6 Second, previous studies have shown the potential utility of including biomarkers and clinical lab indexes into preoperative risk indices as an approach to identify patients at higher risk of MACEs.10–15 But none of these existing calculators included biomarkers or clinical lab indexes except for serum creatinine. Third, these risk models were developed more than a decade ago, during which the surgical methods as well as medical care has improved by leaps and bounds, along with the characteristics of the disease itself. For example, the modified RCRI score underestimated 50% of the adverse events in recent cohort studies,16,17 which raised concern that these models might no longer be applicable to current patients. Lastly, the ACS NSQIP surgical risk calculator includes 21 patient-specific variables. It is difficult for surgeons to be familiar with each of these variables and to apply them proficiently.

For these reasons mentioned above, there is an increasing need for estimating patient-specific not only MACEs but major adverse cardio- and cerebro-vascular events (MACCEs) in a user-friendly format. In this study, we undertook a retrospective investigation into the characteristics of patients undergoing major noncardiac surgery. We then developed a novel nomogram using selected features and compared this new prediction model to the standardized modified RCRI score to identify patients at risk of MACCEs before major noncardiac surgery.

Materials and Methods

Participants and Variables

We performed a single-center nested case-control study on patients aged ≥ 18 years who underwent major noncardiac procedures at Beijing Chaoyang Hospital from January 1st, 2017 to June 30th, 2021. The study was carried out in compliance with the principles specified for research on patients in the Declaration of Helsinki and the research protocol was approved by the ethics committee of Beijing Chaoyang Hospital (2021-S-476). The need for informed consent was waived due to the retrospective study design and all the data were anonymous.

Exclusion criteria included the followings: 1) patients who underwent emergency surgery, transplant, trauma or low-risk procedures (including breast surgery, dental surgery, endoscopic procedures, ophthalmic surgery, gynecological surgery and plastic surgery based on the American College of Cardiology/American Heart Association guidelines),18 2) patients with American Society of Anesthesiologists classification (ASA class) of V or VI, 3) patients with advanced malignant tumor undergoing palliative surgery, 4) patients with congenital heart disease or cardiomyopathy, 5) patients with a history of other surgeries within 4 months, 6) patients who were submitted to reoperation or reintervention, and 7) patients with incomplete data that were necessary to extrapolate the modified RCRI score.

The endpoint of this study was defined as the occurrence of MACCEs, including all-cause death, acute myocardial infarction, cardiac arrest, heart failure, ventricular fibrillation, complete heart block and ischemic stroke after surgery during hospitalization. The definition of acute myocardial infarction referred to the guideline of the Fourth Universal Definition of Myocardial Infarction.19 Heart failure was defined as acute heart failure or acute exacerbation of chronic heart failure.20 Ischemic stroke was defined as an episode of neurological dysfunction caused by focal cerebral, spinal, or retinal infarction.21 The diagnosis of MACCEs were consulted and confirmed by a cardiologist or neurologist at the time of hospitalization and were further cross-checked by two independent doctors during data examination.

Based on previous studies, potential relevant preoperative and intraoperative variables including demographic information, medical history and laboratory examination were extracted from the database and analyzed.

Statistical Analysis

Continuous variables are presented as median (interquartile range). Categorical variables are expressed as absolute values and percentages. To compare differences between the two groups, we used Mann–Whitney U-test for continuous variables and chi-square test for categorical data.

The adaptive least absolute shrinkage and selection operator (LASSO) was used to identify risk factors of MACCEs in patients undergoing major noncardiac surgery, and the optimal value of λ was determined via 10-fold cross-validation. The area under the receiver operating characteristic (ROC) curve (AUC) was used to assess the performance of the model. Calibration was calculated with the Hosmer–Lemeshow χ2 test and visualized by calibration plot. To favor the clinical implementation and workability of the risk model, we formulated a coefficient-based nomogram. Clinical usefulness and net benefit were estimated by decision curve analysis (DCA). Internal validation was performed using 5 repetitions of 10-fold cross-validation. Using the AUC, the unclassified net reclassification improvement (NRI) and integrated discrimination improvement (IDI), we compared the performance of our model to the modified RCRI score. The difference in the AUC between ROC curves were tested using the DeLong test. Due to lack of ischemic stroke and non-cardiac death in the endpoint events of the modified RCRI score, we also performed a sensitivity analysis after excluding patients who experienced ischemic stroke or non-cardiac death during hospitalization. The p values were 2-sided, and α level of 0.05 was considered statistically significant. All analyses were performed by R software (4.0.2 version).

Results

Patient Characteristics

Of all 23,765 cases with aged ≥ 18 years who underwent major noncardiac surgery from January 1st 2017 to June 30th 2021 in Beijing Chaoyang Hospital Jingxi branch, 13,258 cases fell to the exclusion criteria: 13,215 cases underwent emergency surgery, transplant, trauma or low-risk procedures, 2 cases with congenital heart disease or cardiomyopathy, 18 cases with a history of other surgeries within 4 months, 4 cases were submitted to reoperation or reintervention, and 19 cases with incomplete data that were necessary to extrapolate the modified RCRI score. Of the remaining 10,507 cases, 118 cases experienced in-hospital MACCEs. Thereinto, 13 cases were excluded due to the following reasons: 5 cases with ASA grade V, 7 cases with advanced palliative surgery for malignant tumor, and 1 case died unexpectedly due to irrelevant accident. Thus 105 patients with MACCEs were included in the final analyses. As for the control group, we used stratified randomization to avoid extreme imbalance with the MACCEs group. The remaining 10,389 patients without MACCEs during hospitalization were first divided into five groups (intraperitoneal surgery, thoracic surgery, peripheral arterioplasty, major orthopedic surgery and major urological surgery) according to the operation type of the MACCEs group. Then, at a ratio of 1 to 5, we randomly sampled 525 cases stratified by these five groups as the control group. Among these, 44 cases were excluded due to the following reasons: 27 cases with ASA grade V and 17 cases with advanced palliative surgery for malignant tumors. Finally, 481 patients without MACCEs were included as controls (Figure S1). Table 1 shows the comparison of characteristics between controls and MACCEs group. Patients with MACCEs were older, had higher ASA class, more ST-T changes on ECG and more medical history of chronic heart failure (CHF), atrial fibrillation(AF), ischemic heart disease, dialysis, hypertension, chronic respiratory disease and valvular heart disease (VHD). Regarding laboratory examination, patients with MACCEs had lower lymphocyte count, higher neutrophil count, N/L% and creatinine. Table 2 shows the end-point events of recruited cases. Among the 105 cases of MACCEs group, AMI occurred in 19 cases (18%), HF in 56 cases (53%), stroke in 18 cases (17%) and 26 cases (25%) died.

Table 1 The Characteristics of Recruited Cases

Table 2 The End-Point Events of Recruited Cases

Variable Selection and Nomogram Construction

Using LASSO logistic regression, we screened 20 predictors from 401 potential variables. Then, we calculated the likelihood ratios and selected six strongest predictors: CHF, VHD, Cr > 2.0 mg/dL, ASA class, neutrophil count and age. Among these, CHF referred to patients with insufficient cardiac function at New York Heart Association (NYHA) class III to IV. Valvular heart disease was defined as moderate to severe cardiac valve incompetence or stenosis. The importance of each variable is shown in Figure 1A. Integrating the six variables, we were able to build a nomogram for predicting in-hospital MACCEs in patients underwent major noncardiac surgery (Figure 1B).

Figure 1 Selected variables and the constructed nomogram. (A) Importance of each variable as measured by partial Wald χ2 minus the predictor degrees of freedom. (B) Nomogram for the prediction model. CHF, chronic heart failure; VHD, valvular heart disease; Cr 2.0 > mg/dL, preoperative serum creatinine > 2.0 mg/dL.

Performance of the New Prediction Nomogram

The ROC curve of the new prediction nomogram is shown in Figure 2A with an AUC of 0.758 [95% CI, 0.708–0.808]. The calibration plot of the model showed an overall good agreement between the predicted and observed risks, which was further supported by Hosmer–Lemeshow test (Figure 2B, χ2 = 7.549, p = 0.479). The internal-validated AUC of the model was 0.742 [95% CI, 0.718–0.767] based on 5 repetitions of 10-fold cross-validation.

Figure 2 Comparison between the new prediction nomogram and the modified RCRI score. (A) AUC of the new prediction nomogram (0.758) and the modified RCRI score (0.639). (B) Calibration plot of the new prediction nomogram. (C) Decision curve analysis evaluation of the two models. (D)The ROC curves of the new prediction nomogram in comparison with modified RCRI score in subgroup patients excluded cerebrovascular diseases or non-cardiac death.

In comparison with the modified RCRI score, the prediction model we established demonstrated an increase in AUC of 0.119 [95% CI, 0.056–0.180] (Figure 2A). We also calculated the unclassified NRI and IDI between these two risk models. Compared with the modified RCRI score, the new prediction had significant improvement in reclassification as assessed by the NRI (0.445 [95% CI, 0.237–0.653]) and IDI (0.133 [95% CI, 0.087–0.178]). The decision curve graphically showed a larger net benefit across the range of MACCEs risk of the new prediction nomogram compared with the modified RCRI score (Figure 2C).

Sensitivity Analysis

Since the modified RCRI score did not take ischemic stroke and non-cardiac death into consideration, we performed a sensitivity analysis after excluding 36 patients who experienced ischemic stroke or died due to non-cardiac cause during hospitalization. Compared with the modified RCRI score, our risk model remained a better discrimination with an increase in AUC of 0.159 (Figure 2D, p < 0.0001) and an improvement in reclassification as assessed by the NRI (0.631 [95% CI, 0.385–0.878]) and IDI (0.171 [95% CI, 0.110–0.232]) in these subgroup patients.

Discussion

This study developed a novel nomogram for the prediction of MACCEs in patients undergoing major noncardiac surgery. The nomogram showed good discriminative ability and performed well on calibration plot, with a higher accuracy and better discrimination than the modified RCRI score.

In comparison with previous risk models that predicted adverse events,7,9,22 the new prediction model added the following new factors: history of valvular heart disease and the neutrophil count. Valvular heart disease is common among patients undergoing noncardiac surgery and has been associated with increased perioperative cardiac morbidity and mortality.23 Another reason for including valvular disease in our model is the increasing number of patients with valvular disease brought by aging population and advancing of treatments in recent years. Neutrophils are major and direct effectors of the inflammatory response which contributes to the whole atherosclerotic process, from its initiation, progression, plaque destabilization and ultimately to cardiovascular events.24–26 Therefore, the neutrophil count, as a simple and inexpensive tool, seems to be a factor worth taking into account for prediction of MACCEs in patients undergoing major non-cardiac surgery.

Compared with the modified RCRI score, the final variables of our new prediction nomogram did not include the variable of stroke/TIA, ischemic heart disease (IHD) and insulin therapy for diabetes. However, these factors were already included in the ASA class which was a feature of the new prediction nomogram. High-risk procedures (intraperitoneal, intrathoracic or suprainguinal vascular procedures) in the modified RCRI score were also not a significant influencer in the new prediction nomogram, which might contribute from the significantly reduced perioperative complications of these procedures because of the rapid development of laparoscopic, thoracoscopic and vascular interventional techniques. On the other hand, the inclusion of laboratory tests in the new prediction nomogram attenuated the prognostic importance of many clinical variables.

In contrast to the NSQIP MICA and the ACS NSQIP surgical risk calculator, details of the operation were not part of the new prediction nomogram. From one side, the details and type of operation could change during the operation and sometimes more than two combined operations were performed. On the other side, surgical types and techniques are improving with each passing day. There is no risk estimation tool currently available that covers nearly all operations across multiple subspecialties. Thus, the details of operation may not be reliable representatives of patient characteristics for estimating the risk of MACCEs.

The new prediction model we established was able to evaluate not only MACEs but also cerebrovascular events which were included in any of the previous models. More laboratory tests were incorporated into our model to personalize the evaluation and to meet the standards of precision medicine. In order to derive an index that might be able to facilitate routine practice, the variables we included were easily obtained and well generalized.

There are also limitations to our study. First of all, the prediction model was established based on single-center data. External validation was not performed, which limited the generalization and the evidence level of the results. Secondly, as a retrospective study, we were unable to systematically monitor all biomarkers that might have predictive ability, hence also unable to include them in the predictive model. Thirdly, as a retrospective controlled study, our project did not include all cases without MACCEs, which might increase the risk for selection bias. Therefore, we randomized the enrollment of the cases without MACCEs to minimize this bias as much as possible.

Conclusion

In conclusion, we developed a new and easy-to-implement risk model for the prediction of MACCEs in patients undergoing major noncardiac surgery. This risk model showed better discrimination than the standardized modified RCRI score. It may be a promising decision-aid tool for both surgical patients and surgeons.

Abbreviations

ACS NSQIP, American College of Surgeons NSQIP;ASA class, American Society of Anesthesiologists classification; AUC, area under the ROC curve; CI, confidence interval; DCA, decision curve analysis; IDI, integrated discrimination improvement; Lasso, least absolute shrinkage and selection operator; MACCEs, major adverse cardiovascular and cerebrovascular events; MACEs, major adverse cardiovascular events; MICA, myocardial infarction and cardiac arrest; NRI, net reclassification improvement; NSQIP, National Surgical Quality Improvement Program; RCRI, Modified Revised Cardiac Risk Index; ROC, receiver operating characteristic.

Data Sharing Statement

The data that support the findings of this study are available on request from the corresponding author [Xinchun Yang]. The data are not publicly available due to them containing information that could compromise research participant privacy/consent.

Ethics Approval and Consent to Participate

The study was approved by the ethics committee of Beijing Chaoyang Hospital (2021-S-476). The need for informed consent was waived due to the retrospective study design and all the data were anonymous.

Acknowledgments

We would like to thank Dr. Jia-Chen Hu from GE Healthcare for revision of the article.

Funding

There is no funding to report.

Disclosure

The authors report no conflicts of interest in this work.

References

1. Devereaux PJ, Sessler DI. Cardiac Complications in Patients Undergoing Major Noncardiac Surgery. N Engl J Med. 2015;373(23):2258–2269.

2. Weiser TG, Regenbogen SE, Thompson KD, et al. An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet. 2008;372(9633):139–144.

3. Bickler SW, Spiegel DA. Global surgery–defining a research agenda. Lancet. 2008;372(9633):90–92.

4. Kristensen SD, Knuuti J, Saraste A, et al. 2014 ESC/ESA Guidelines on non-cardiac surgery: cardiovascular assessment and management: the Joint Task Force on non-cardiac surgery: cardiovascular assessment and management of the European Society of Cardiology (ESC) and the European Society of Anaesthesiology (ESA). Eur Heart J. 2014;35(35):2383–2431.

5. Botto F, Alonso-Coello P, Chan MT, et al. Myocardial injury after noncardiac surgery: a large, international, prospective cohort study establishing diagnostic criteria, characteristics, predictors, and 30-day outcomes. Anesthesiology. 2014;120(3):564–578.

6. Smilowitz NR, Gupta N, Ramakrishna H, Guo Y, Berger JS, Bangalore S. Perioperative Major Adverse Cardiovascular and Cerebrovascular Events Associated With Noncardiac Surgery. JAMA Cardiology. 2017;2(2):181–187.

7. Lee TH, Marcantonio ER, Mangione CM, et al. Derivation and prospective validation of a simple index for prediction of cardiac risk of major noncardiac surgery. Circulation. 1999;100(10):1043–1049.

8. Davenport DL, Bowe EA, Henderson WG, Khuri SF, Mentzer RM. National Surgical Quality Improvement Program (NSQIP) risk factors can be used to validate American Society of Anesthesiologists Physical Status Classification (ASA PS) levels. Ann Surg. 2006;243(5):636–641.

9. Bilimoria KY, Liu Y, Paruch JL, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013;217(5):833–842.e831-833.

10. Leppo J, Plaja J, Gionet M, Tumolo J, Paraskos JA, Cutler BS. Noninvasive evaluation of cardiac risk before elective vascular surgery. J Am Coll Cardiol. 1987;9(2):269–276.

11. Kim HL, Park KW, Kwak JJ, et al. Stent-related cardiac events after non-cardiac surgery: drug-eluting stent vs. Int j Cardiol. 2008;123(3):353–354.

12. Schouten O, van Domburg RT, Bax JJ, et al. Noncardiac surgery after coronary stenting: early surgery and interruption of antiplatelet therapy are associated with an increase in major adverse cardiac events. J Am Coll Cardiol. 2007;49(1):122–124.

13. van Kuijk JP, Flu WJ, Schouten O, et al. Timing of noncardiac surgery after coronary artery stenting with bare metal or drug-eluting stents. Am J Cardiol. 2009;104(9):1229–1234.

14. Cruden NL, Harding SA, Flapan AD, et al. Previous coronary stent implantation and cardiac events in patients undergoing noncardiac surgery. Circ Cardiovasc Interv. 2010;3(3):236–242.

15. Albaladejo P, Marret E, Samama CM, et al. Non-cardiac surgery in patients with coronary stents: the RECO study. Heart. 2011;97(19):1566–1572.

16. Davis C, Tait G, Carroll J, Wijeysundera DN, Beattie WS. The Revised Cardiac Risk Index in the new millennium: a single-centre prospective cohort re-evaluation of the original variables in 9519 consecutive elective surgical patients. Can J Anaesth. 2013;60(9):855–863.

17. Devereaux PJ, Bradley D, Chan MT, et al. An international prospective cohort study evaluating major vascular complications among patients undergoing noncardiac surgery: the VISION Pilot Study. Open Med. 2011;5(4):e193–200.

18. Fleisher LA, Fleischmann KE, Auerbach AD, et al. 2014 ACC/AHA guideline on perioperative cardiovascular evaluation and management of patients undergoing noncardiac surgery: executive summary: a report of the American College of Cardiology/American Heart Association Task Force on practice guidelines. Developed in collaboration with the American College of Surgeons, American Society of Anesthesiologists, American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Rhythm Society, Society for Cardiovascular Angiography and Interventions, Society of Cardiovascular Anesthesiologists, and Society of Vascular Medicine Endorsed by the Society of Hospital Medicine. J Nucl Cardiol. 2015;22(1):162–215.

19. Thygesen K, Alpert JS, Jaffe AS, et al. Fourth Universal Definition of Myocardial Infarction (2018). J Am Coll Cardiol. 2018;72(18):2231–2264.

20. Tsutsui H, Ide T, Ito H, et al. JCS/JHFS 2021 Guideline Focused Update on Diagnosis and Treatment of Acute and Chronic Heart Failure. J Card Fail. 2021;27(12):1404–1444.

21. Sacco RL, Kasner SE, Broderick JP, et al. An updated definition of stroke for the 21st century: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2013;44(7):2064–2089.

22. Gupta PK, Gupta H, Sundaram A, et al. Development and validation of a risk calculator for prediction of cardiac risk after surgery. Circulation. 2011;124(4):381–387.

23. Bach DS, Eagle KA. Perioperative assessment and management of patients with valvular heart disease undergoing noncardiac surgery. Minerva Cardioangiol. 2004;52(4):255–261.

24. Bodi V, Sanchis J, Nunez J, et al. Uncontrolled immune response in acute myocardial infarction: unraveling the thread. Am Heart J. 2008;156(6):1065–1073.

25. Seizer P, Gawaz M, May AE. Platelet-monocyte interactions–a dangerous liaison linking thrombosis, inflammation and atherosclerosis. Curr Med Chem. 2008;15(20):1976–1980.

26. Núñez J, Núñez E, Sanchis J, Bodí V, Llàcer A. Prognostic value of leukocytosis in acute coronary syndromes: the cinderella of the inflammatory markers. Curr Med Chem. 2006;13(18):2113–2118.

Creative Commons License © 2022 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.