The excitatory neurotransmitter glutamate shapes learning and memory, but the underlying epigenetic mechanism of glutamate regulation in neuron remains poorly understood. Here, we showed that lysine demethylase KDM6B was expressed in excitatory neurons and declined in hippocampus with age. Conditional knockout of KDM6B in excitatory neurons reduced spine density, synaptic vesicle number and synaptic activity, and impaired learning and memory without obvious effect on brain morphology in mice. Mechanistically, KDM6B upregulated vesicular glutamate transporter 1 and 2 (VGLUT1/2) in neurons through demethylating H3K27me3 at their promoters. Tau interacted and recruited KDM6B to the promoters of Slc17a7 and Slc17a6, leading to a decrease in local H3K27me3 levels and induction of VGLUT1/2 expression in neurons, which could be prevented by loss of Tau. Ectopic expression of KDM6B, VGLUT1, or VGLUT2 restored spine density and synaptic activity in KDM6B-deficient cortical neurons. Collectively, these findings unravel a fundamental mechanism underlying epigenetic regulation of synaptic plasticity and cognition.