On the basis of previous study on 2-methylpyrimidine-4-ylamine derivatives I, further synthetic optimization was done to find potent PDHc-E1 inhibitors with antibacterial activity. Three series of novel pyrimidine derivatives 6, 11 and 14 were designed and synthesized as potential Escherichia coli PDHc-E1 inhibitors by introducing 1,3,4-oxadiazole-thioether, 2,4-disubstituted-1,3-thiazole or 1,2,4-triazol-4-amine-thioether moiety into lead structure I, respectively. Most of 6, 11 and 14 exhibited good inhibitory activity against E. coli PHDc-E1 (IC₅₀ 0.97–19.21 μM) and obvious inhibitory activity against cyanobacteria (EC₅₀ 0.83–9.86 μM). Their inhibitory activities were much higher than that of lead structure I. 11 showed more potent inhibitory activity against both E. coli PDHc-E1 (IC₅₀ < 6.62 μM) and cyanobacteria (EC₅₀ < 1.63 μM) than that of 6, 14 or lead compound I. The most effective compound 11d with good enzyme-selectivity exhibited most powerful inhibitory potency against E. coli PDHc-E1 (IC₅₀ = 0.97 μM) and cyanobacteria (EC₅₀ = 0.83 μM). The possible interactions of the important residues of PDHc-E1 with title compounds were studied by molecular docking, site-directed mutagenesis, and enzymatic assays. The results indicated that 11d had more potent inhibitory activity than that of 14d or I due to its 1,3,4-oxadiazole moiety with more binding position and stronger interaction with Lsy392 and His106 at active site of E. coli PDHc-E1.