The causative agent of human granulocytic ehrlichiosis was recently reclassified as Anaplasma phagocytophilum, unifying previously described bacteria that cause disease in humans, horses, dogs, and ruminants. For the characterization of genetic heterogeneity in this species, the homologue of Anaplasma marginale major surface protein 4 gene (msp4) was identified, and the coding region was PCR amplified and sequenced from a variety of sources, including 50 samples from the United States, Germany, Poland, Norway, Italy, and Switzerland and 4 samples of A. phagocytophilum-like organisms obtained from white-tailed deer in the United States. Sequence variation between strains of A. phagocytophilum (90 to 100% identity at the nucleotide level and 92 to 100% similarity at the protein level) was higher than in A. marginale. Phylogenetic analyses of msp4 sequences did not provide phylogeographic information but did differentiate strains of A. phagocytophilum obtained from ruminants from those obtained from humans, dogs, and horses. The sequence analysis of the recently discovered A. phagocytophilum msp2 gene corroborated these results. The results reported here suggest that although A. phagocytophilum-like organisms from white-tailed deer may be closely related to A. phagocytophilum, they could be more diverse. These results suggest that A. phagocytophilum strains from ruminants could share some common characteristics, including reservoirs and pathogenicity, which may be different from strains that infect humans.