Development and validation of a nomogram to predict liver metastasis in patients with pancreatic ductal adenocarcinoma: a large cohort study
Authors He C, Zhong L, Zhang Y, Cai Z, Lin X
Received 7 January 2019
Accepted for publication 29 March 2019
Published 2 May 2019 Volume 2019:11 Pages 3981—3991
Checked for plagiarism Yes
Review by Single-blind
Peer reviewer comments 4
Editor who approved publication: Dr Ahmet Emre Eskazan
Chaobin He,1.* Lixin Zhong,2,* Yu Zhang,3,* Zhiyuan Cai,1 Xiaojun Lin1
1Department of Hepatobiliary and Pancreatic Surgery, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou 510060, People’s Republic of China; 2Department of Occupational and Environmental Health, School of Public Health, Sun Yat-sen University, Guangzhou, Guangdong 510080, People’s Republic of China; 3State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, Guangdong 510060, People’s Republic of China
*These authors contributed equally to this work
Background: Few studies have explored the relationship between clinicopathological factors of patients with pancreatic ductal adenocarcinoma (PDAC) and liver metastasis. The aim of this study was to develop and validate a nomogram to predict liver metastasis in patients with PDAC.
Patients and methods: Patients diagnosed with PDAC between 2004 and 2015 from the Surveillance, Epidemiology, and End Results (SEER) database were retrospectively collected. The nomogram was established based on a logistic regression model. The precision of the nomogram was evaluated and compared using concordance index (C-index), and the area under receiver operating characteristic curve (AUC). The clinical use of nomogram was evaluated by making use of a decision curve analysis (DCA).
Results: A total of 12,644 eligible patients, which were randomly divided into training (n=9,483) and validation cohorts (n=3,161), were included in this study. The nomograms, which were established on the basis of independent predictors, were well calibrated, and demonstrated good discriminative ability, with C-indexes of 0.784 for the training cohort and 0.790 for validation cohort. The values of AUC for training and validation cohort were 0.792 and 0.800, respectively. When other sites of distant metastases were included into this predictive system, the new predictive model demonstrated a better discriminative ability and greater net benefit in predicting liver metastasis in patients with PDAC in both the training and validation cohorts.
Conclusion: Nomograms were constructed to predict liver metastasis in patients with PDAC. Validation revealed excellent discrimination and calibration of the nomograms, suggesting that the nomograms were well calibrated and could serve to improve the prediction of the risks of liver metastasis which can be used to guide the management of patients with PDAC.
Keywords: pancreatic ductal adenocarcinoma, liver metastasis, predictor, nomogram, SEER
Pancreatic ductal adenocarcinoma (PDAC) is a lethal disease, ranking 7th and 6th as the leading cause of cancer-related death, in both worldwide and China, respectively.1,2 Mostly because of the absence of specific clinical manifestation, most patients are diagnosed at advanced stages, and as such only 15–20% of the PDAC patients become eligible for potential curative surgical resection at diagnosis.3 Distant metastasis is a major indicator of poor prognosis.4,5 PDAC predisposes the liver to secondary tumors and liver metastasis is the most common form of distant metastasis in these patients.6 Also, it was shown that patients with liver metastasis had worse prognoses than those with lung metastasis or other distant metastases.7 The treatment strategies and prognoses of PDAC are largely determined by the presence or absence of liver metastasis. Moreover, the early detection of liver metastasis signifies an earlier chance to receive more aggressive treatment approaches, which may lead to better survival, compared with the standard chemotherapeutic treatment alone.4,8 In fact, all patients with PDAC are at risk of liver metastasis, therefore it is essential for clinicians to accurately judge the risk of liver metastasis for selection of an optimal therapeutic.
Previous studies have shown some correlation between the clinical and pathological factors for the predisposition of liver metastasis in patients with PDAC.9,10 However, those reports were mainly based on small cohorts of patients and only evaluated fragmentary factors. It would be interesting to study the association between clinicopathological factors and liver metastasis, and to construct effective models to predict the risk of liver metastasis for patients with PDAC. In this study, we aimed to identify the independent factors promoting liver metastasis in PDAC patients and to establish a nomogram to predict the risk of these liver metastases. With this scoring system, we expect clinicians to be able to promptly identify high-risk patients for providing them with an optimal individualized therapeutic regimen.
Patients and methods
The Surveillance, Epidemiology, and End Results (SEER) database of the National Cancer Institution, which covers approximately 30% of the US population, was used in this study. Data of patients with PDAC diagnosed between 2004 and 2015 were extracted from the SEER database, using the SEER*Stat software version 8.3.5. The study cohort consisted of patients with the following: the International Classification of Diseases for Oncology, Third Edition (ICD-O-3), histology code: 8,140; and the ICD-O-3 site code C25.0, C25.1 and C25.2. The exclusion criteria were as follows: (1) patients with second primary cancer; (2) age at diagnosis younger than 18 years; (3) patients not pathologically diagnosed; (4) patients with missing or incomplete information about clinicopathological features. Three-fourths of the patients were randomly selected to form the training cohort and to develop the nomograms, and the rest of the patients were selected to serve as an internal validation cohort. Institutional review board approval and informed consent are not required for this current study because the SEER research data is publicly available and all patient data are de-identified. All authors have signed the authorization form and received permission from SEER organization to access and use the dataset.
The following clinicopathological features used for this study are as follows: age at diagnosis, gender, tumor site, tumor grade, tumor size, tumor-node-metastasis (TNM) stage, lymph node (LN) metastasis, liver metastasis, lung metastasis, bone metastasis and brain metastasis. The 8th edition of the TNM stage was used as the stage system.
Statistical analysis was performed using SPSS software version 22 (SPSS Inc., Chicago, IL, USA) and the R version 3.4.2 software (The R Foundation for Statistical Computing, Vienna, Austria.
A nomogram for predicting the probability of liver metastasis was developed based on the independent risk factors identified in the multivariate analysis. The discrimination and calibration power were two important aspects of the performance of the established nomograms, and they were evaluated by using concordance index (C-index) and calibration curves,11,12 respectively, accompanied by the Hosmer-Lemeshow test.13 Bootstraps with 1,000 resamples were used for the validation of the nomograms and the calibration curves to reduce the overfit bias. In addition, the precision of the prediction for liver metastasis was evaluated using the area under receiver operating characteristic (ROC) curve (AUC). The clinical use of nomogram was evaluated by decision curve analysis (DCA).14 A two-tailed P-value <0.05 was considered as statistically significant.
We identified 12,644 eligible patients with PDAC diagnosed from 2004 to 2015 in the SEER database. There were 9,483 patients allocated to the training cohort and 3,161 patients to the validation cohort. The median age of the entire study cohort was 67 years old and 50.8% of the patients were male. The demographic and clinicopathological features of the training and validation cohort are summarized in Table 1. In the present study, the mean and the median follow-up time were 13.8 months and 8 months (range, 1–143 months), respectively. During the whole period of follow-up, 10,689 (84.5%) patients had died and only 1,955 (15.5%) patients were alive. Liver metastasis was present in 1,207 of the 9,483 (12.7%) patients and 440 of 3,161 (13.9%) patients in the training and validation cohorts, respectively. There was no significant difference in liver metastasis rates between these two cohorts (p=0.087). Moreover, the presence of liver metastasis was significantly associated with male gender, carcinoma located at the pancreatic tail, low differentiation histology, larger tumors, more advanced T stage, LN metastasis and distant metastases at other sites.
Table 1 The comparison of demographic and clinicopathological factors between training cohort and validation cohort
Univariate analyses were performed to filter risk factors. All these factors were entered into the multivariate logistic regression analyses. After a stepwise removal of variables, age, gender, tumor site, tumor grade, tumor size and LN metastasis remained significant predictors for liver metastasis (Table 2). All of the independent predictors in the training cohort were included for the nomogram construction (model 1, Figure 1). The nomogram demonstrated good accuracy, with C-indexes of 0.764 (95% CI=0.748–0.780) for the training cohort and 0.769 (95% CI=0.737–0.801) for the validation cohort. A patient’s probability of liver metastasis could be easily calculated by adding up the scores of each variable.
Table 2 Univariate and multivariate logistic analyses of liver metastasis in patients PDAC
The calibration curves demonstrated good agreement between the prediction and validation of the probability of liver metastasis in both the training and validation cohort (Figure 2A and B). The Hosmer-Lemeshow test yielded a non-significant P-value of 0.460. Furthermore, the ROC models of liver metastasis regarding the predictive ability were constructed (Figure 2C and D) and the resulting AUC values for the training and validation cohorts were 0.777 and 0.775, respectively.
Incremental predictive value of distant metastases at other sites
Results for the predictive model after the addition of other sites of distant metastasis (model 2) are shown in Table 2. The nomogram (Figure 1B) of model 2 also showed good accuracy with C-indexes of 0.784 (95% CI =0.768–0.800) and 0.790 (95% CI =0.760–0.820) for the training and validation cohort, respectively. The Hosmer-Lemeshow test yielded a non-significant P-value of 0.579. Moreover, the calibration plots for estimating the probabilities of liver metastasis showed fair agreement between the nomogram-predicted probability and the actual observed metastatic status. The values of the AUC of the nomogram for predicting liver metastasis were 0.792 and 0.800, respectively (Figure 3).
The discrimination and calibration power of the two models were compared. It was observed that slightly higher C-indexes were obtained for model 2 in both the training and validation cohort as compared with model 1, although there were no significant differences. Moreover, the comparison of the likelihood ratio test indicated that compared with model 1, model 2 had superior discriminatory ability in predicting liver metastasis in both the training and validation cohort (Table 3).
Table 3 Comparison of the C-index values and likelihood ratio tests between two models
Clinical performance of two models
The decision curve analysis (DCA) is a novel method that evaluates predictive models from the perspective of clinical consequences. When the score is within the range 0–0.6, using the nomogram to predict liver metastasis adds greater net benefit than the treat-all or treat-none strategies. Moreover, compared with model 1, the increased net benefit of model 2 indicated that model 2 was more accurate in predicting liver metastasis in patients with PDAC in both the training and validation cohorts (Figure 4).
Distant metastasis is a common sign of advanced stages and indicates poor prognosis for patients with PDAC. Liver metastasis is the most common site of metastases,15,16 which also indicates worse outcomes than patients with other sites of distant metastases.7 At present, the standard treatment for metastatic PDAC is chemotherapy, which can only provide limited benefit to increase the patient’s survival. However, it was reported that surgical approaches including liver resection might allow an improved survival in selective groups of PDAC patients with liver metastasis, especially in patients with oligometastasis.4,8 Thus, timely diagnosis of liver metastasis is extremely important, which may support the theoretical estimations and provide evidential recommendations to clinicians when making appropriate treatment decision. Unfortunately, the routine imaging examination, such as computed tomography (CT) or magnetic resonance imaging (MRI), does not show relatively high sensitivities and specificities in diagnosis of liver metastasis, especially minor metastasis in patients with PDAC.17,18 Liver biopsy was also reported to increase the risks for distant metastasis and reduce survival.19 Thus, a noninvasive method which can predict the probability of liver metastasis of patients with PDAC is needed. In this study, we have developed and validated the predictive nomograms using the SEER dataset, which demonstrated significant discrimination and calibration to provide evidence-based and individualized estimation for the probabilities of liver metastasis in patients with PDAC.
This study primarily focused on the clinical features of patients with liver metastasis, illustrated that patients with younger ages were more likely to have liver metastasis than those with older ages. This result was consistent with similar studies.20,21 In this study, it was shown that the probability of liver metastasis was higher in younger patients. Larger proportions of patients with younger ages (38%) had larger tumors than those with older ages (34.5%). Moreover, LN metastasis was more frequently observed in younger patients (55.0%), compared with older patients (47.0%). Compared with patients with older ages, patients with younger ages usually had tumors with higher malignancy or more aggressive histological features, which might ultimately lead to a higher tendency to liver metastasis or other forms of distant metastases.22,23 Consistent with studies of other kinds of tumors, Chang et al reported that early onset patients were much more vulnerable to positive circumferential margins, venous invasion and perineural invasion in colorectal adenocarcinoma.24 Multiple genetic alterations in younger patients also supported the hypothesis that tumor cells in the young were more susceptible to promoting DNA damage than in the old. As a result, young patients could be more likely to develop metastasis.25,26 Gender was associated with liver metastasis and female patients were less likely to have liver metastasis, which was similar to one study conducted by Lin et al.20 The significant association between clinical features and liver metastasis suggested that more focus should be made upon different clinical features of patients when liver metastasis was evaluated.
Apart from the clinical variables, the multivariate logistic analysis also revealed that tumor site, tumor grade, tumor size and LN metastasis were all independent predictors of liver metastasis in patients with PDAC. Recently, Dong et al reported a retrospective study that included 1,787 advanced PDAC patients.10 They demonstrated that both primary tumor location and diameter were significantly associated with the risk of synchronous liver metastasis. Tumor size, a powerful and reliable predictor of both distant metastasis and prognosis,5,27 was found to have an intimate association with the infiltration of the pancreatic cancer cells into the liver. Larger size tumors were more invasive and infiltrated to the peripheral organs or vessels; which may also signify greater tumor burden for patients with PDAC. Consistent with many previous reports,28,29 it was shown that the primary tumor at the body and tail of the pancreas was more prone to have liver metastasis as compared with those occurring at the head of the pancreas. In contrast with tumors located at the head of the pancreas, PDAC of the body and tail were larger or were more frequently diagnosed at advanced stages; possibly due to the lack of obstructive jaundice, which may result in higher risk of liver metastases among these patients. Meanwhile, our nomogram indicated that the magnitude of liver metastasis as tumor grade changed from well to poorly differentiated. Similar with studies which have shown that poor tumor grade was associated with worse prognosis,5,30 tumor grade, an inherent characteristic of tumor, which reflects the tumor biological behavior, was also found to be an independent predictor for liver metastasis in patients with PDAC. Moreover, LN metastasis was shown to weigh more than other pathological factors in predicting liver metastasis. LN metastasis was proved as a common sign before distant metastases,31,32 suggesting that greater attention concerning distant metastases should be paid in PDAC patients with LN metastasis. Regarding the common prognostic biomarkers, such as carbohydrate antigen 19-9 (CA19-9) and CA125, they were shown to be associated with tumor burden and advanced stages in patients with PDAC.27,33,34 In the study of Dong et al,10 it was likely to show that elevated level of CA19-9 was related to synchronous liver metastasis in stage IV PDAC patients. However, CA19-9 level was found not to be a risk factor of metachronous liver metastasis for stage III PDAC patients. Due to the unavailability of CA19-9 and CA125 in SEER database, the predictive value of these two biomarkers in predicting liver metastasis could not be evaluated while we believed that the evaluating of these two factors would increase the predictive power of the established nomograms in the further studies.
Apart from liver metastasis, there were also other sites of distant metastases, even though these patients consisted of only a small proportion of the whole cohort. In this study, over 60.0% of the patients with bone metastases had liver metastasis and 58.3% of the patients with lung metastases were diagnosed with simultaneous liver metastasis. This indicates that there is a high likelihood of multiple metastases being already developed by the time that distant metastases have been detected. This finding in our study was consistent with results from other studies,7,21 which revealed that patients with lung or bone metastases had a significantly higher number of metastatic sites. When other sites of distant metastases were included into this predictive system, lung metastasis was the greatest contributor to the risk of liver metastasis, followed by LN metastasis and bone metastasis. In addition, the new predictive model demonstrated a better discriminative ability to predict liver metastasis.
It is well known that patient counseling and decision are based on the prognosis estimated from the individual risk profiles.35 Nomogram is an important component of modern medical decision-making.27,36 In this study, the nomogram for predicting liver metastasis in patients with PDAC was established and demonstrated clinical reliable discriminatory data with relatively high C-indexes and values of AUC in the training and validation cohort. The calibration plots also demonstrated that the predicted probability of the nomograms corresponded well with the observed rates of liver metastasis. However, a higher value of C-index and perfect calibration does not guarantee that the established nomogram will be clinically useful. Therefore, we performed DCA and showed that the nomogram could be used to derive the net benefit within the derived probabilities.35 In addition, analysis on the basis of data from a population-based cohort made our results more generable than studies from a single center. This nomogram can, therefore, be used to estimate the individualized probabilities of liver metastasis and to guide personalized treatment for patients with PDAC.
There are several limitations in this study that should be noted. The major limitation of the present study is that the variables used to construct the nomograms, only represented some of the clinicopathological features. Some important tumor biomarkers were unavailable in SEER database. Also, we acknowledge that certain additional variables (eg, other pathological factors or molecular biomarkers) might provide potential predictive information. This is the major part of improvement in our future research. Another limitation is that although the established nomogram showed good discrimination and validation, further validation based on large-scale external cohort is needed.
In conclusion, we established a nomogram for predicting the risk of liver metastasis in patients with PDAC in this study. Physicians assess a diverse range of parameters of patients with more objectives and precision for predicting liver metastasis using this nomogram, resulting in reduced health care costs, less radiation exposure and fewer unnecessary diagnostic investigations.
This work was supported by the Sun Yat-sen University Grant for Medical Humanities Practice and Teaching (No. 23000-18008023). We thank the National Cancer Institute’s SEER Program for collection of the SEER data.
The authors report no conflicts of interest in this work.
1. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68(6):394–424. doi:10.3322/caac.21492
2. Chen W, Zheng R, Baade PD, et al. Cancer statistics in China, 2015. CA Cancer J Clin. 2016;66(2):115–132. doi:10.3322/caac.21338
3. Bockhorn M, Uzunoglu FG, Adham M, et al. Borderline resectable pancreatic cancer: a consensus statement by the International Study Group of Pancreatic Surgery (ISGPS). Surgery. 2014;155(6):977–988. doi:10.1016/j.surg.2014.02.001
4. Shi S, Yu XJ. Time to think: selecting patients who may benefit from synchronous resection of primary pancreatic cancer and liver metastases. World J Gastroenterol. 2018;24(33):3677–3680. doi:10.3748/wjg.v24.i33.3677
5. He C, Zhang Y, Cai Z, Lin X, Li S. Overall survival and cancer-specific survival in patients with surgically resected pancreatic head adenocarcinoma: a competing risk nomogram analysis. J Cancer. 2018;9(17):3156–3167. doi:10.7150/jca.25494
6. Spadi R, Brusa F, Ponzetti A, et al. Current therapeutic strategies for advanced pancreatic cancer: a review for clinicians. World J Clin Oncol. 2016;7(1):27–43. doi:10.5306/wjco.v7.i1.27
7. Oweira H, Petrausch U, Helbling D, et al. Prognostic value of site-specific metastases in pancreatic adenocarcinoma: a Surveillance Epidemiology and End Results database analysis. World J Gastroenterol. 2017;23(10):1872–1880. doi:10.3748/wjg.v23.i10.1872
8. Schneitler S, Kropil P, Riemer J, et al. Metastasized pancreatic carcinoma with neoadjuvant FOLFIRINOX therapy and R0 resection. World J Gastroenterol. 2015;21(20):6384–6390. doi:10.3748/wjg.v21.i20.6384
9. Torphy RJ, Tignanelli CJ, Kamande JW, et al. Circulating tumor cells as a biomarker of response to treatment in patient-derived xenograft mouse models of pancreatic adenocarcinoma. PLoS One. 2014;9(2):e89474. doi:10.1371/journal.pone.0089474
10. Dong S, Wang L, Guo YB, et al. Risk factors of liver metastasis from advanced pancreatic adenocarcinoma: a large multicenter cohort study. World J Surg Oncol. 2017;15(1):120. doi:10.1186/s12957-017-1175-7
11. Harrell FE
12. Pencina MJ, D’Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med. 2004;23(13):2109–2123. doi:10.1002/sim.1802
13. Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med. 2007;35(9):2052–2056. doi:10.1097/01.CCM.0000275267.64078.B0
14. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006;26(6):565–574. doi:10.1177/0272989X06295361
15. Lemke J, Scheele J, Kapapa T, Wirtz CR, Henne-Bruns D, Kornmann M. Brain metastasis in pancreatic cancer. Int J Mol Sci. 2013;14(2):4163–4173. doi:10.3390/ijms14024163
16. Deeb A, Haque SU, Olowokure O. Pulmonary metastases in pancreatic cancer, is there a survival influence? J Gastrointest Oncol. 2015;6(3):E48–51. doi:10.3978/j.issn.2078-6891.2014.114
17. Croome KP, Jayaraman S, Schlachta CM. Preoperative staging of cancer of the pancreatic head: is there room for improvement? Can J Surg. 2010;53(3):171–174.
18. Zamboni GA, Kruskal JB, Vollmer CM, Baptista J, Callery MP, Raptopoulos VD. Pancreatic adenocarcinoma: value of multidetector CT angiography in preoperative evaluation. Radiology. 2007;245(3):770–778. doi:10.1148/radiol.2453061795
19. Zhang L, Xiang ZL, Zeng ZC, Fan J, Tang ZY, Zhao XM. A microRNA-based prediction model for lymph node metastasis in hepatocellular carcinoma. Oncotarget. 2016;7(3):3587–3598. doi:10.18632/oncotarget.6534
20. Lin Z, Yan S, Zhang J, Pan Q. A nomogram for distinction and potential prediction of liver metastasis in breast cancer patients. J Cancer. 2018;9(12):2098–2106. doi:10.7150/jca.24445
21. Shiroyama T, Suzuki H, Tamiya M, et al. Clinical characteristics of liver metastasis in nivolumab-treated patients with non-small cell lung cancer. Anticancer Res. 2018;38(8):4723–4729. doi:10.21873/anticanres.12779
22. Wang J, Liu J, Pan H, et al. Young age increases the risk of lymph node positivity in papillary thyroid cancer patients: a SEER data-based study. Cancer Manag Res. 2018;10:3867–3873. doi:10.2147/CMAR.S167774
23. Mete O, Asa SL. Pathological definition and clinical significance of vascular invasion in thyroid carcinomas of follicular epithelial derivation. Mod Pathol. 2011;24(12):1545–1552. doi:10.1038/modpathol.2011.119
24. Chang DT, Pai RK, Rybicki LA, et al. Clinicopathologic and molecular features of sporadic early-onset colorectal adenocarcinoma: an adenocarcinoma with frequent signet ring cell differentiation, rectal and sigmoid involvement, and adverse morphologic features. Mod Pathol. 2012;25(8):1128–1139. doi:10.1038/modpathol.2012.61
25. Moses W, Weng J, Khanafshar E, Duh QY, Clark OH, Kebebew E. Multiple genetic alterations in papillary thyroid cancer are associated with younger age at presentation. J Surg Res. 2010;160(2):179–183. doi:10.1016/j.jss.2009.05.031
26. Romei C, Ciampi R, Elisei R. A comprehensive overview of the role of the RET proto-oncogene in thyroid carcinoma. Nat Rev Endocrinol. 2016;12(4):192–202. doi:10.1038/nrendo.2016.11
27. He C, Mao Y, Wang J, Duan F, Lin X, Li S. Nomograms predict long-term survival for patients with periampullary adenocarcinoma after pancreatoduodenectomy. BMC Cancer. 2018;18(1):327. doi:10.1186/s12885-018-4242-8
28. Wagner M, Redaelli C, Lietz M, Seiler CA, Friess H, Buchler MW. Curative resection is the single most important factor determining outcome in patients with pancreatic adenocarcinoma. Br J Surg. 2004;91(5):586–594. doi:10.1002/bjs.4484
29. Paye F, Micelli Lupinacci R, Bachellier P, Boher JM, Delpero JR. Distal pancreatectomy for pancreatic carcinoma in the era of multimodal treatment. Br J Surg. 2015;102(3):229–236. doi:10.7150/jca.25494
30. Li HB, Zhou J, Zhao FQ. A prognostic nomogram for disease-specific survival in patients with pancreatic ductal adenocarcinoma of the head of the pancreas following pancreaticoduodenectomy. Med Sci Monitor. 2018;24:6313–6321. doi:10.12659/MSM.909649
31. Wu SG, Zhang WW, Sun JY, Li FY, Lin Q, He ZY. Patterns of distant metastasis between histological types in esophageal cancer. Front Oncol. 2018;8:302. doi:10.3389/fonc.2018.00302
32. Gaitanidis A, Alevizakos M, Tsaroucha A, Tsalikidis C, Pitiakoudis M. Predictive nomograms for synchronous distant metastasis in rectal cancer. J Gastrointest Surg. 2018;22(7):1268–1276. doi:10.1007/s11605-018-3767-0
33. Hang J, Wu L, Zhu L, et al. Prediction of overall survival for metastatic pancreatic cancer: development and validation of a prognostic nomogram with data from open clinical trial and real-world study. Cancer Med. 2018;7:2974–2984. doi:10.1002/cam4.2018.7.issue-7
34. Liu L, Xu HX, Wang WQ, et al. Serum CA125 is a novel predictive marker for pancreatic cancer metastasis and correlates with the metastasis-associated burden. Oncotarget. 2016;7(5):5943–5956. doi:10.18632/oncotarget.6819
35. Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16(4):e173–e180. doi:10.1016/S1470-2045(14)71116-7
36. He CB, Lao XM, Lin XJ. Transarterial chemoembolization combined with recombinant human adenovirus type 5 H101 prolongs overall survival of patients with intermediate to advanced hepatocellular carcinoma: a prognostic nomogram study. Chin J Cancer. 2017;36(1):59. doi:10.1186/s40880-017-0227-2
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.Download Article [PDF]