In this work, we present a plasmonic photodetector (PPD) with high sensitivity to red light illumination. The ultrasensitive PPD was composed of high-crystalline CdSe nanoribbons (NRs) decorated with plasmonic hollow gold nanoparticles (HGNs) on the surface, which were capable of coupling the incident light due to localized surface plasmon resonance (LSPR). Device analysis reveals that after modification of HGNs, both responsivity and detectivity were considerably improved. Further device performance analysis and theoretical simulation based on finite element method (FEM) find that the optimized performance is due to HGNs induced localized field enhancement and direct electron transfer.