Sperm harbours a wide range of proteins regulating their functions and fertility. In the present study, we made an effort to characterize and quantify the proteome of buffalo bull spermatozoa, and to identify fertility associated sperm proteins through comparative proteomics. Using high-throughput mass spectrometry platform, we identified 1305 proteins from buffalo spermatozoa and found that these proteins were mostly enriched in glycolytic process, mitochondrial respiratory chain, tricarboxylic acid cycle, protein folding, spermatogenesis, sperm motility and sperm binding to zona pellucida (p < 7.74E−08) besides metabolic (p = 4.42E−31) and reactive oxygen species (p = 1.81E−30) pathways. Differential proteomic analysis revealed that 844 proteins were commonly expressed in spermatozoa from both the groups while 77 and 52 proteins were exclusively expressed in high- and low-fertile bulls, respectively. In low-fertile bulls, 75 proteins were significantly (p < 0.05) upregulated and 176 proteins were significantly (p < 0.05) downregulated; these proteins were highly enriched in mitochondrial respiratory chain complex I assembly (p = 2.63E−07) and flagellated sperm motility (p = 7.02E−05) processes besides oxidative phosphorylation pathway (p = 6.61E−15). The down regulated proteins in low-fertile bulls were involved in sperm motility, metabolism, sperm-egg recognition and fertilization. These variations in the sperm proteome could be used as potential markers for the selection of buffalo bulls for fertility.