Microglial cells are the resident macrophages and intrinsic arm of the central nervous system innate immune defense. Microglial cells become activated in response to injury, infection, environmental toxins, and other stimuli that threaten neuronal survival. Therefore, regulating microglial activation may have therapeutic benefits that lead to alleviating the progression of inflammatory-mediated neurodegeneration. In the present study, we investigated the effect of glaucocalyxin A (GLA) isolated from Rabdosia japonica on the production of pro-inflammatory mediators in lipopolysaccharide (LPS)-stimulated primary microglia and BV-2 cells. GLA significantly inhibited LPS-induced production of nitric oxide and reversed the morphological changes in primary microglia. Further, GLA suppressed expression of inducible nitric oxide synthase and cyclooxygenase-2 dose-dependently at the mRNA and protein levels. The production of proinflammatory cytokines such as tumor necrosis factor-α, interleukin-1β (IL)-1β, and IL-6 were inhibited by suppressing their transcriptional activity. Furthermore, GLA suppressed nuclear factor-κB activation by blocking degradation of IκB-α and inhibited the induction of lipocalin-2 expression in LPS-stimulated BV-2 cells. Mechanistic study revealed that the inhibitory effects of GLA were accompanied by blocking the p38 mitogen activated protein kinase signaling pathway in activated microglia. In conclusion, given that microglial activation contributes to the pathogenesis of neurodegenerative diseases, GLA could be developed as a potential therapeutic agent for treating microglia-mediated neuroinflammatory diseases.