Specific interactions between post-translational modifications (PTMs) and chromatin-binding proteins are central to the idea of a 'histone code'. Here, we used a 5,000-member, PTM-randomized, combinatorial peptide library based on the N terminus of histone H3 to interrogate the multisite specificity of six chromatin binding modules, which read the methylation status of Lys4. We found that Thr3 phosphorylation, Arg2 methylation and Thr6 phosphorylation are critical additional PTMs that modulate the ability to recognize and bind histone H3. Notably, phosphorylation of Thr6 yielded the most varied effect on protein binding, suggesting an important regulatory mechanism for readers of the H3 tail. Mass spectrometry and antibody-based evidence indicate that this previously uncharacterized modification exists on native H3, and NMR analysis of ING2 revealed the structural basis for discrimination. These investigations reveal a continuum of binding affinities in which multisite PTM recognition involves both switch- and rheostat-like properties, yielding graded effects that depend on the inherent 'reader' specificity.