Back to Journals » Cancer Management and Research » Volume 12

Establishment of Simple Nomograms for Predicting Axillary Lymph Node Involvement in Early Breast Cancer

Authors Zong Q, Deng J, Ge W, Chen J , Xu D

Received 9 December 2019

Accepted for publication 26 February 2020

Published 18 March 2020 Volume 2020:12 Pages 2025—2035

DOI https://doi.org/10.2147/CMAR.S241641

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Chien-Feng Li



Qingqing Zong,1,* Jing Deng,1,* Wanli Ge,2,* Jie Chen,1 Di Xu3

1Department of Ultrasonography, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, People’s Republic of China; 2Department of General Surgery, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, People’s Republic of China; 3Department of Geriatric Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, People’s Republic of China

*These authors contributed equally to this work

Correspondence: Di Xu
Department of Geriatric Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, People’s Republic of China
Tel/Fax +86 25 8371 4511
Email [email protected]

Purpose: Axillary lymph node (ALN) involvement is an important prognostic factor of early invasive breast cancer. The objective of this study was to establish simple nomograms for predicting ALN involvement based on ultrasound (US) characteristics and evaluate the predictive value of US in the detection of ALN involvement.
Patients and Methods: A total of 1328 patients with cT1-2N0 breast cancer by physical exam were retrospectively analyzed. Univariate analysis was used for the comparison of variables, and multivariate analysis was performed by binary logistic regression analysis. The R software was used to establish simple nomograms based on the US characteristics alone. The receiver operating characteristic (ROC) curves of the prediction model and the verification group were drawn, and the area under the curve (AUC) was calculated to evaluate the discrimination of the prediction model. A calibration curve was plotted to assess the nomogram predictions vs the actual observations of the ALN metastasis rate and axillary tumor burden rate.
Results: The ALN metastasis rates of the training group and the validation group were 35.1% and 34.1%, respectively. Multivariate analysis showed that molecular subtype, lymphovascular invasion, mass descriptors (size, margin, microcalcification and blood flow signal) and LN descriptors (shape, cortical thickness and long-to-short ratio) were independent impact factors in early breast cancer. The AUC of ALN metastasis rate of prediction model based on US features was 0.802, the AUC of high tumor burden rate was 0.873, and the AUC of external validation group was 0.731 and 0.802, respectively. The calibration curve of the nomogram showed that the nomogram predictions are consistent with the actual metastasis rate and the high tumor burden rate. The results showed that preoperative US had a sensitivity of 59.4% and a specificity of 88.9% for predicting the ALN metastasis rate.
Conclusion: The successfully established nomograms based on US characteristics to predict ALN metastasis rate and high axillary tumor burden rate in early breast cancer can achieve individual prediction. Compared with other nomogram predictions, it is more intuitive, and can help clinical decision-making; thus, it should be promoted. However, at this time US features alone are insufficient to replace sentinel lymph node biopsy.

Keywords: axillary lymph node involvement, early breast cancer, ultrasound, nomogram

Introduction

Axillary lymph node (ALN) involvement is associated with an increased risk of local recurrence and poor prognosis in early breast cancer. Accurate nodal (N) staging is an important basis for the prognosis and adjuvant treatment of breast cancer. The main methods of N staging are sentinel lymph node biopsy (SLNB) and axillary lymph node dissection (ALND). Although ALND can clearly reveal the pathological N staging, it may also lead to serious complications such as edema and functional limitations of the affected upper limb, which seriously affect patients’ quality of life. The 10-year follow-up results of the American College of Surgeons Oncology Group (ACOSOG) Z0011 trial showed that there was no statistically significant difference in the local recurrence rate and 10-year overall survival between the ALND group and the non-ALND group in early breast cancer with 1 or 2 SLNs containing metastases.1 With the emergence of systemic therapy and more accurate preoperative imaging diagnosis, individualized therapy has become an ideal choice for breast cancer treatment.2 The preoperative individualized noninvasive assessment of ALN involvement has received much attention from clinicians.

The Memorial Sloan-Kettering Cancer Center (MSKCC) model based on clinical and pathological features has been verified by large samples,35 but the nomogram for predicting axillary tumor burden based on ultrasound (US) features alone for early breast cancer has not been reported in the Chinese population. The establishment of a scoring system of axillary tumor burden for early breast cancer based on US characteristics alone will help predict individual axillary involvement and facilitate clinical decision-making. The purpose of this study was to establish a simple prediction model of ALN involvement in early breast cancer patients based on US characteristics and to evaluate its accuracy and the predictive value of US in the detection of ALN involvement.

Patients and Methods

Patients

In this study, 847 early breast cancer patients (cT1-2 and no enlarged ALNs by physical examination) who were diagnosed at the First Affiliated Hospital of Nanjing Medical University from 2017 to 2018 were included in a primary cohort, and 481 patients diagnosed in 2019 were included in a validation cohort. Patients were excluded from the study if they had a history of malignancy, immune system and hematological diseases or had received neoadjuvant chemotherapy or underwent surgery in the ipsilateral axillae. This retrospective study was conducted in accordance with the ethical standards of Declaration of Helsinki and was approved by the ethics committee of the First Affiliated Hospital of Nanjing Medical University. The requirement for informed consent was waived because this study does not adversely affect the rights and health of the participants, and the risk to the participants is not greater than the minimal risk. Patients’ privacy and personally identifiable information are protected.

US Examination

All enrolled patients underwent preoperative US to assess the morphological features of LN using the MyLab twice (Esaote, Italian) and ACUSON S3000 (SIEMENS, Germany) systems, with a high-frequency transducer (10 to 18 MHz). The sonography was performed in accordance with the breast examination specification, and the instrument’s frequency, focus, gain, and depth were adjusted appropriately to obtain the best image. The patient was in the supine position or lateral position, and the axillary was fully exposed by upper limb abduction. The bilateral axillae were comprehensively examined in multiple aspects, with a focus on ALNs in the I region (lateral to the pectoralis minor muscle). If suspicious ALNs were found on US, the inner mammary region and supraclavicular region were examined simultaneously. All enrolled patients were examined by a physician with at least 5 years of experience in breast US. The clinical and pathological data of enrolled patients were obtained from the medical records.

US Evaluation

The US features of the masses were evaluated and recorded according to the 5th edition of the Breast Imaging Reporting and Data System (BI-RADS) sonographic guidance, and the blood flow signals of the lesions were semiquantitatively graded by Adler and divided into 0, I, II, and III levels.6 In this study, level 0-I was defined as poor blood flow, and level II–III was defined as abundant blood flow. The US characteristics of the ALNs were recorded in detail, including the shape, long-to-short ratio (LSR), maximum cortical thickness and blood flow. If there were suspicious ALNs on US, the number (0, 1, 2 or >2) was recorded in detail. The parameters of suspicious ALNs indicated on US were as follows: cortical thickening ≥3 mm was taken as the main criterion, and asymmetric cortex, LSR <2, disappearance of hilum or abundant blood flow was taken as the second criterion.7,8 ALNs on US that met any of these criteria were characterized as suspicious for metastases.

Pathological Evaluation

After the size of all the surgical specimens of early breast cancer was recorded, routine HE staining and immunohistochemical (IHC) examination were performed. The IHC tests included estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor-2 (Her2) amplification, and Ki67 proliferation index. The histological grade was divided into grade I, grade II and grade III. IHC diagnosis was referred to the breast cancer hormone receptor IHC testing guidelines and Her2 testing guidelines jointly issued by the American Society of Clinical Oncology/College Of American Pathologists guideline recommendations.9,10 There is no unified standard for the expression level of the Ki67 index. In this study, Ki67<20% was regarded as low expression, and Ki67≥20% was regarded as high expression. The molecular subtype was divided into luminal A-like, luminal B-like, Her2 positive, and triple-negative breast cancer (TNBC). Axillary tumor burden was divided into low tumor burden (0 or 1–2 ALNs involving metastasis) and high tumor burden (>2 ALNs involving metastasis).

Statistical Analysis

SPSS 22.0 software (IBM, Ehningen, Germany) was used for analysis. In univariate analysis, the chi-square test was used for the comparison of categorical variables, and t test was used for the comparison of continuous variables. Binary logistic regression analysis was used for the multivariate analysis to determine related independent factors of clinicopathological and US characteristics. The rms package for R software (Windows version 3.6.1, https://www.r-project.org) was used to establish a simple nomogram based on the US characteristics alone. Then, a validation group was used for external verification. The receiver operating characteristic (ROC) curves of the prediction model and the verification group were drawn, and the area under the curve (AUC) was calculated to evaluate the discrimination of the prediction model. A calibration curve was plotted to assess the nomogram predictions vs the actual observations of the ALN metastasis rate and axillary tumor burden rate. P < 0.05 was considered statistically significant.

Results

Clinicopathological Characteristics

The mean age of the 1328 enrolled patients was 53.36 ±11.67 years, while the mean ages of the training group and the validation group were 55.53 ±11.82 and 53.08 ±11.41 years, respectively. Of all patients, there were 1192 (89.8%) with invasive ductal carcinoma (IDC), 36 (2.7%) with invasive lobular carcinoma (ILC) and 100 (7.5%) with other types. The ALN metastasis rates of the training group and the validation group were 35.1% and 34.1%, respectively, with no significant difference in the distribution between the two groups. The distribution of variables in the validation group was basically the same as that in the training group, with slight differences among the eight variables, including histological grade, Her2 status, Ki67 index, axillary surgery, mass aspect ratio, mass microcalcification, LN shape and blood flow (Table 1).

Table 1 Clinicopathological and US Features of the Training Group and Validation Group in Early Breast Cancer

Predictors of ALN Involvement

Univariate analysis showed that histological grade, ER status, Ki67 index, molecular subtype, lymphovascular invasion (LVI), mass descriptors (size, margin, microcalcification and blood flow signal) and LN descriptors (shape, cortical thickness, LSR and blood flow signal) had statistical significance for ALN involvement in early breast cancer. However, age, histological type, PR status, Her2 status and mass aspect ratio were not statistically significant (P>0. 05) (Table 2).

Table 2 Univariate Analysis of ALN Involvement in the Training Group

Binary logistic regression analysis was performed for the axillary metastasis of early breast cancer based on clinicopathological combined with US features and based on US features alone. The results showed that molecular subtype, LVI, mass descriptors (size, margin, microcalcification and blood flow signal) and LN descriptors (shape, cortical thickness and LSR) are independent impact factors of ALN metastasis in early breast cancer; LVI, mass descriptors (size and microcalcification) and LN descriptors (shape, cortical thickness and LSR) were independent influence factors of axillary tumor burden in early breast cancer (Table 3). Cortical thickness of LN had a higher risk of ALN metastasis (OR 4.363; 95% CI, 2.629–7.242) and axillary tumor burden (OR 5.865; 95% CI, 3.035–11.336) in the training group.

Table 3 Logistic Regression Analysis of ALN Involvement in the Training Group

Establishment and Evaluation of Nomograms

The ROC curves of the training group and the validation group were drawn based on the clinicopathological features combined with the US features and based on the US features alone. The AUC of the ALN metastasis rate based on the US features alone in the training group was 0.802 (95% CI, 0.770–0.834), and the AUC in the validation group was 0.731 (95% CI, 0.680–0.781). The AUC of high axillary tumor burden rate based on the US features alone in the training group was 0.873 (95% CI, 0.836–0.910), and the AUC in the validation group was 0.802 (95% CI, 0.740–0.865) (Figure 1).

Figure 1 ROC curve of predictive model in early breast cancer. Notes: (A) ROC curve of predicting LN− and LN+(1–2) vs LN+(>2) in the training group; (B) ROC curve of predicting LN− and LN+(1–2) vs LN+(>2) in the validation group; (C) ROC curve of predicting LN− vs LN+ in the training group; (D) ROC curve of predicting LN− vs LN+ in the validation group. Abbreviations: LN−, disease-free axillae; LN+, any nodal metastasis; LN+(1–2), 1 or 2 nodal metastasis; LN+(>2), more than 2 nodal metastasis.

The prediction model of ALN metastasis rate based on US characteristics had a predictive accuracy of 76.9%, negative predictive value (NPV) of 78.3%, positive predictive value (PPV) of 72.9%, and a test value of 75.9% in the validation cohort. The prediction model of axillary tumor burden rate based on US characteristics had a predictive accuracy of 89.4%, NPV of 90.4%, PPV of 67.6%, and a test value of 87.7% in the validation cohort. Based on the results of regression analysis, the independent predictors of the training group were integrated. Compared with the AUC values based on the clinicopathological features combined with the US features, the AUC value of the ROC curve did not decrease significantly in the prediction model with only US features.

R software was used to establish the nomograms for the prediction of the ALN metastasis rate and high axillary tumor burden rate in early breast cancer (Figure 2). The calibration curve of the nomogram showed that the nomogram predictions are consistent with the actual metastasis rate and the high tumor burden rate, indicating that the prediction accuracy of the nomogram of the prediction model is high (Figure 3).

Figure 2 The nomograms of predictive model in early breast cancer. Notes: (A) the predictive model of Risk1 (LN− vs LN+); (B) the predictive model of Risk2 (LN− and LN+(1–2) vs LN+(>2)). Abbreviations: LN−, disease-free axillae; LN+, any nodal metastasis; LN+(1–2), 1 or 2 nodal metastasis; LN+(>2), more than 2 nodal metastasis; LN, lymph node; LSR, long-to-short ratio.

Figure 3 Calibration curve of the nomograms. Notes: (A) the predictive model of Risk1 (LN− vs LN+); (B) the predictive model of Risk2 (LN− and LN+[1–2] vs LN+[>2]). Abbreviations: LN−, disease-free axillae; LN+, any nodal metastasis; LN+(1–2), 1 or 2 nodal metastasis; LN+(>2), more than 2 nodal metastasis.

Distribution of Patients with Abnormal ALNs on US

Preoperative US had a sensitivity of 59.4% and a specificity of 88.9% for predicting the ALN metastasis rate. Among women with >2 abnormal ALNs identified on preoperative US, 69.4% had >2 positive ALNs on final pathology. Among women without abnormal ALNs on preoperative US, 80.2% had negative ALNs on final pathology. Among patients with 1–2 abnormal ALNs on preoperative US, 94.2% had 1–2 positive ALNs on final pathology (Figure 4).

Figure 4 Distribution of patients with abnormal ALNs on US. Abbreviations: LN−, disease-free axillae; LN+(1–2), 1 or 2 nodal metastasis; LN+(>2), more than 2 nodal metastasis.

Discussion

The choice of axillary surgery for early breast cancer has become increasingly controversial. With the improvement of imaging equipment and the diagnostic level, the traditional invasive method of N staging has been challenged. However, due to differences in patients’ willingness and clinicians’ preferences, the selection of appropriate surgical methods based on axillary imaging evaluation is still controversial.

The ACOSOG Z0011 trial showed that there was no significant difference in the 10-year overall survival between the SLNB group and ALND group of early-stage breast cancer patients with 1–2 positive SLNs. The latest edition of the National Comprehensive Cancer Network (NCCN) guidelines suggests that ALND may be conditionally exempted in early breast cancer with positive SLNs.11 In the era of precision medicine, accurate preoperative N staging in early breast cancer is of great significance for the development of individualized treatment and the selection of appropriate surgical procedures. US plays an important role in the axillary evaluation of early breast cancer.

The predictive model based on clinicopathological and US features can screen out more patients with ALN metastasis, which is more in line with clinical research purposes. However, the prediction model based on US features alone used fewer variables, so it is easy to generalize. In this study, the nomogram based on US features was verified to be of high accuracy, and compared with the prediction model based on clinicopathological and US features, it is simpler and more intuitive. Moreover, it can realize the individualized prediction of the ALN metastasis rate and high axillary tumor burden rate and will become an important tool for the preoperative noninvasive evaluation of early breast cancer. The nomogram showed that early breast cancer with a higher rate of ALN metastasis had a luminal B-like subtype, a larger tumor size, an obscure margin, microcalcification and poor blood flow on masses, an asymmetric cortical thickness ≥3 mm, LNs without hilum, and LSR<2. Early breast cancer patients with a larger tumor size, mass microcalcification, asymmetric cortical thickness ≥3 mm and LSR< 2 were more likely to have a higher axillary tumor burden.

Previous studies have shown that cortical thickness is the strongest predictor of ALN involvement.12 The results of this study showed that the cortical thickness and shape of ALNs were associated with a higher risk of ALN metastasis or a higher axillary tumor burden, which was basically consistent with the findings of previous studies.13,14 In this study, cortical thickness was not specifically graded but was only evaluated at the time of initial diagnosis. The results still showed that with increased cortical thickness, the higher the risk of ALN metastasis and the greater the risk of high tumor burden.

Guo et al suggested that the US features of irregular shape and higher color Doppler flow imaging grades of masses correlated well with ALN metastasis.15 However, we found that patients with poor blood flow in masses were more likely to have ALN metastasis by the simple nomogram. The differences in the results may stem from the differences in the enrolled populations. In addition, the obscure margin of the mass is also an important predictor of ALN metastasis, which is consistent with previous results.16,17 Zhang et al reported a multicenter study of 1869 female patients from seven Chinese breast cancer centers and showed that molecular subtype was an independent predictor of ALN metastasis.18,19 In this study, multivariate analysis showed a correlation between molecular subtype and ALN involvement in early breast cancer, which was consistent with the findings of previous studies.20 However, Xin et al found that there was no significant correlation between molecular subtype and ALN metastasis in 323 patients with newly diagnosed breast cancer and suggested that molecular subtype could not predict ALN involvement currently and could not fully reveal the biological characteristics of tumors.21

The nomograms based on US characteristics were successfully established to predict the ALN metastasis rate and high tumor burden rate; the AUC values verified externally in the validation group were 0.731 and 0.802, respectively. The calibration curve of the nomogram shows that the nomogram prediction is consistent with the actual metastasis rate and the high tumor burden rate. The MSKCC model was established to predict the ALN metastasis rate, but it only considered clinicopathological features without adding imaging features. However, the nomogram in this study introduced US characteristics, which have wider clinical applicability and easier operation. The results of this study showed that through the simple prediction model, 79.0% of patients with negative ALNs could be screened out to avoid unnecessary axillary surgery, 91.1% of patients with a low axillary tumor burden could be screened out to avoid unnecessary ALND, and 62.7% of patients with a high tumor burden could be screened out to receive ALND directly to avoid injury from secondary surgery.

US is the most widely used assistive examination technique to evaluate ALN involvement. Comprehensive US may help accurately assess ALN involvement in early invasive breast cancer to guide clinical decision-making. In this study, 1204 patients with ≤2 suspicious ALNs were screened by preoperative US, of which 94.2% were pathologically confirmed to have a low axillary tumor burden. The specificity of US for evaluating axillary tumor burden was high, and SLNB was preferred for patients with ≤2 suspicious ALNs. Some patients can avoid unnecessary ALND, reduce surgical complications, and save medical resources such as rapid frozen sections during surgery. Among patients with negative US in early breast cancer, 19.8% had ALN metastasis in the axillae by postoperative pathology, with a high false-negative rate. US has a low sensitivity and cannot determine suspicious ALNs accurately in early breast cancer. As an important supplement to preoperative US, SLNB is an important means of accurate N staging. The present results do not support the hypothesis that preoperative US should be used instead of SLNB to detect ALN metastasis in early breast cancer.

Lee et al analyzed 224 patients, and the results showed that the false-negative rate of preoperative ultrasound for ALN involvement was higher, which was consistent with our study results.22 SLNB is still needed in patients with negative preoperative US. Among patients with >2 suspicious ALNs on US, only 69.4% of the patients were pathologically confirmed as having a high axillary tumor burden, and the results of the study did not support direct ALND for such patients. Next, we need to explore the causes of false negative US from the perspective of clinicopathological and US characteristics to decrease missed diagnoses and misdiagnoses and improve the clinical application value of preoperative US in the optimization of surgical methods.

This study is a single-center retrospective study with heterogeneous study designs and limited populations. Thus, slight differences between the training group and the validation group should be interpreted with these limitations in mind. The ongoing Sentinel node vs Observation after axillary UltraSouND (SOUND) trial was designed to explore whether SLNB can be avoided when US is negative in early breast cancer.23 In this study, SLNB alone is not sufficient as a reference point for the involved LN number. In addition, cortical thickness was not specifically graded to be more effectively used in clinical diagnosis in this study.

Conclusion

Molecular subtype, LVI, mass descriptors (size, margin, microcalcification and blood flow signal) and LN descriptors (shape, cortical thickness and LSR) were independent influencing factors for ALN involvement in early breast cancer. The simple prediction models based on US features alone have a high accuracy in predicting the ALN metastasis rate and high tumor burden rate. Compared with the prediction model based on clinicopathological features combined with US features, it is more intuitive and accurate and can realize individual prediction; thus, it should be promoted.

Disclosure

The authors report no conflicts of interest in this work.

References

1. Giuliano AE, Ballman KV, McCall L, et al. Effect of axillary dissection vs no axillary dissection on 10-year overall survival among women with invasive breast cancer and sentinel node metastasis: the ACOSOG Z0011 (Alliance) randomized clinical trial. JAMA. 2017;318(10):918–926. doi:10.1001/jama.2017.11470

2. Dumitru D, Khan A, Catanuto G, Rocco N, Nava MB, Benson JR. Axillary surgery in breast cancer: the beginning of the end. Minerva Chir. 2018;73(3):314–321. doi:10.23736/s0026-4733.18.07728-3

3. Chen JY, Chen JJ, Yang BL, et al. Predicting sentinel lymph node metastasis in a Chinese breast cancer population: assessment of an existing nomogram and a new predictive nomogram. Breast Cancer Res Treat. 2012;135(3):839–848. doi:10.1007/s10549-012-2219-x

4. Huang J, Chen X, Fei X, et al. Risk factors of non-sentinel lymph node metastasis and performance of MSKCC nomogramin breast cancer patients with metastatic sentinel lymph node. Zhonghua Wai Ke Za Zhi. 2015;53(12):941–946. doi:10.3760/cma.j.issn.0529-5815.2015.12.011

5. Chue KM, Yong WS, Thike AA, et al. Predicting the likelihood of additional lymph node metastasis in sentinel lymph node positive breast cancer: validation of the Memorial Sloan-Kettering Cancer Centre (MSKCC) nomogram. J Clin Pathol. 2014;67(2):112–119. doi:10.1136/jclinpath-2013-201524

6. Adler DD, Carson PL, Rubin JM, Quinn-reid D. Doppler ultrasound color flow imaging in the study of breast cancer: preliminary findings. Ultrasound Med Biol. 1990;16(6):553–559. doi:10.1016/0301-5629(90)90020-d

7. Net JM, Mirpuri TM, Plaza MJ, et al. Resident and fellow education feature: US evaluation of axillary lymph nodes. Radiographics. 2014;34(7):1817–1818. doi:10.1148/rg.347140081

8. Elmore LC, Appleton CM, Zhou G, Margenthaler JA. Axillary ultrasound in patients with clinically node-negative breast cancer: which features are predictive of disease? J Surg Res. 2013;184(1):234–240. doi:doi:10.1016/j.jss.2013.03.068

9. Hammond ME, Hayes DF, Dowsett M, et al. American Society of Clinical Oncology/College Of American Pathologists guideline recommendations for immunohistochemical testing of estrogen and progesterone receptors in breast cancer. J Clin Oncol. 2010;28(16):2784–2795. doi:10.1200/jco.2009.25.6529

10. Wolff AC, Hammond ME, Hicks DG, et al. Recommendations for human epidermal growth factor receptor 2 testing in breast cancer: American Society of Clinical Oncology/College of American Pathologists clinical practice guideline update. J Clin Oncol. 2013;31(31):3997–4013. doi:10.1200/jco.2013.50.9984

11. Gradishar WJ, Anderson BO, Balassanian R, et al. NCCN guidelines insights: breast cancer, version 1.2017. JNCCN. 2017;15(4):433–451. doi:10.6004/jnccn.2017.0044

12. Yu X, Hao X, Wan J, Wang Y, Yu L, Liu B. Correlation between ultrasound appearance of small breast cancer and axillary lymph node metastasis. Ultrasound Med Biol. 2018;44(2):342–349. doi:10.1016/j.ultrasmedbio.2017.09.020

13. Stachs A, Thi AT, Dieterich M, et al. Assessment of ultrasound features predicting axillary nodal metastasis in breast cancer: the impact of cortical thickness. Ultrasound Int Open. 2015;1(1):E19–E24. doi:10.1055/s-0035-1555872

14. Saffar B, Bennett M, Metcalf C, Burrows S. Retrospective preoperative assessment of the axillary lymph nodes in patients with breast cancer and literature review. Clin Radiol. 2015;70(9):954–959. doi:10.1016/j.crad.2015.04.019

15. Guo Q, Dong Z, Zhang L, et al. Ultrasound features of breast cancer for predicting axillary lymph node metastasis. J Ultrasound Med. 2018;37(6):1354. doi:10.1002/jum.14469

16. Kim GR, Choi JS, Han BK, et al. Preoperative axillary US in early-stage breast cancer: potential to prevent unnecessary axillary lymph node dissection. Radiology. 2018;288(1):55–63. doi:10.1148/radiol.2018171987

17. Li J, Ma W, Jiang X, et al. Development and validation of nomograms predictive of axillary nodal status to guide surgical decision-making in early-stage breast cancer. J Cancer. 2019;10(5):1263–1274. doi:10.7150/jca.32386

18. Zhang J, Li X, Huang R, et al. A nomogram to predict the probability of axillary lymph node metastasis in female patients with breast cancer in China: a nationwide, multicenter, 10-year epidemiological study. Oncotarget. 2017;8(21):35311–35325. doi:10.18632/oncotarget.13330

19. Dihge L, Bendahl PO, Ryden L. Nomograms for preoperative prediction of axillary nodal status in breast cancer. Br J Surg. 2017;104(11):1494–1505. doi:10.1002/bjs.10583

20. Wang NN, Yang ZJ, Wang X, et al. A mathematical prediction model incorporating molecular subtype for risk of non-sentinel lymph node metastasis in sentinel lymph node-positive breast cancer patients: a retrospective analysis and nomogram development. Breast Cancer. 2018;25(6):629–638. doi:10.1007/s12282-018-0863-7

21. Xin L, Chen L, Zhang H, et al. Analysis of detecting value of ultrasound and the clinic-pathological features of axillary metastasis in breast cancer. Zhonghua Wai Ke Za Zhi. 2014;52(12):924–928. doi:10.3760/cma.j.issn.0529-5815.2014.12.011

22. Lee B, Lim AK, Krell J, et al. The efficacy of axillary ultrasound in the detection of nodal metastasis in breast cancer. AJR Am J Roentgenol. 2013;200(3):W314–W320. doi:10.2214/AJR.12.9032

23. Gentilini O, Veronesi U. Abandoning sentinel lymph node biopsy in early breast cancer? A new trial in progress at the European Institute of Oncology of Milan (SOUND: sentinel node vs observation after axillary UltraSouND). Breast. 2012;21(5):678–681. doi:10.1016/j.breast.2012.06.013

Creative Commons License © 2020 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.