This case report describes a patient with prolonged fever following a kidney biopsy. Workup disclosed a large perirenal and retroperitoneal hematoma. Neither imaging nor blood cultures supported an infective cause of his fever. Although the patient was initially treated with antibiotics, fever eventually resolved spontaneously. A review of the literature is provided addressing the association of fever with resorption of hematoma. Fever should be added to the list of potential complications of kidney biopsy. A conservative management is advocated.