Zr doped ZnO nanoparticles are prepared by the sol-gel method with post-annealing. X-ray diffraction results show that all samples are the typical hexagonal wurtzite structure without any other new phase, as well as the Zr atoms have successfully entered into the ZnO lattices instead of forming other lattices. Magnetic measurements indicate that all the doping samples show room temperature ferromagnetism and the pure ZnO is paramagneism. The results of Raman and X-ray photoelectron spectroscopy indicate that there are a lot of oxygen vacancies in the samples by doping element of Zr. It is considered that the observed ferromagnetism is related to the doping induced oxygen vacancies.