Botulinum neurotoxin A (BoNT/A), the most acutely poisonous substance to humans known, cleave its SNAP-25 substrate with high specificity. Based on the endopeptidase activity, different methods have been developed to detect BoNT/A, but most lack ideal reproducibility or sensitivity, or suffer from long-term or unwanted interferences. In this study, we developed a simple method to detect and quantitate trace amounts of botulinum neurotoxin A using the IgY antibody against a linear-peptide substrate. The effects of reaction buffer, time, and temperature were analyzed and optimized. When the optimized assay was used to detect BoNT/A, the limit of detection of the assay was 0.01 mouse LD50 (0.04 pg), and the limit of quantitation was 0.12 mouse LD50/ml (0.48 pg). The findings also showed favorable specificity of detecting BoNT/A. When used to detect BoNT/A in milk or human serum, the proposed assay exhibited good quantitative accuracy (88% < recovery < 111%; inter- and intra-assay CVs < 18%). This method of detection took less than 3 h to complete, indicating that it can be a valuable method of detecting BoNT/A in food or clinical diagnosis.