Emerging evidence has indicated nerve fibers as a marker in the progression of various types of cancers, such as pancreatic cancer and prostate cancer. However, whether nerve fibers are associated with breast cancer progression remains unclear. In this study, we evaluated the presence of nerve fibers in 352 breast cancer specimens and 83 benign breast tissue specimens including 43 cases of cystic fibrosis and 40 cases of fibroadenoma from 2 independent breast tumor center using immunohistochemical staining for specific peripheral nerve fiber markers.In all, nerve fibers were present in 130 out of 352 breast cancer tissue specimens, while none were detected in normal breast tissue specimens. Among 352 cases, we defined 239 cases from Sun Yat-Sen Memorial Hospital, Guangzhou, China, as the training set, and 113 cases from the First Affiliated Hospital of Shantou University, Guangdong, China, as the validation set. The thickness of tumor-involving nerve fibers is significantly correlated with poor differentiation, lymph node metastasis, high clinical staging, and triple negative subtype in breast cancer. More importantly, Cox multifactor analysis indicates that the thickness of tumor-involving nerve fibers is a previously unappreciated independent prognostic factors associated with shorter disease-free survival of breast cancer patients. Our findings are further validated by online Oncomine database. In conclusion, our results show that nerve fiber involvement in breast cancer is associated with progression of the malignancy and warrant further studies in the future.