Rabies, caused by rabies virus (RABV), is an acute, fatal encephalitic disease that affects many warm-blooded mammals. Currently, post-exposure prophylaxis regimens are effective for most rabies cases, but once the clinical signs of the disease appear, current treatment options become ineffective. Carrageenan has been reported as a potent inhibitor of many viruses. In this study, the λ-carrageenan (λ-CG) P32 was investigated for its potential role in inhibiting RABV infection. Our results show that P32 specifically inhibits the replication of several RABV strains but not vesicular stomatitis virus in multiple cell lines and shows low cytotoxicity. P32 mainly abrogated viral replication during the early stage of the post-adsorption period. Further studies demonstrated that P32 could affect not only viral internalization but also viral uncoating by blocking cell fusion mediated by RABV glycoprotein. Moreover, P32 can fully inhibit RABV infection in vitro during the post-adsorption period, whereas heparin and heparan sulfate, which possess similar structures to P32, showed significant but not complete inhibition of RABV infectivity. Collectively, our results indicate that λ-CG P32 is a promising agent that can inhibit RABV infection mainly by inhibiting viral internalization and glycoprotein-mediated cell fusion and can be used for the development of novel anti-RABV drugs.