Zinc plays a vital role in our metabolism, encompassing antioxidant regulation, immune response, and auditory function. Several studies have reported that zinc levels correlate with hearing loss. We have previously demonstrated that the auditory brainstem response (ABR) threshold increased in mice fed a zinc-deficient diet. However, the effects of zinc deficiency on hearing were not fully elucidated. The present study investigated whether zinc deficiency affects hearing in association with neuronal components or cochlear structures. CBA/N mice were fed a normal or zinc-deficient diet for 8 weeks and assessed for ABR and distortion product otoacoustic emissions (DPOAE). The cochlear sections were stained with hematoxylin and eosin solution. Also, we observed the expression of synaptic ribbons, neurofilaments, and alpha-synuclein (α-Syn). The 8-week zinc-deficient diet mice had an elevated ABR threshold but no changed DPOAE threshold or cochlear structures. A reduced number of synaptic ribbons of inner hair cells (IHCs) and impaired efferent nerve fibers were observed in the zinc-deficient diet mice. The number of outer hair cells (OHCs) and expression of α-Syn remained unchanged. Our results suggest that zinc-mediated hearing loss is associated with the loss of neuronal components of IHCs.