Methane leakage from deep-sea cold seeps has a major impact on marine ecosystems. Microbes sequester methane in the water column of cold seeps and can be divided into abundant and rare groups. Both abundant and rare groups play an important role in cold seep ecosystems, and the environmental heterogeneity in cold seeps may enhance conversion between taxa with different abundances. Yet, the environmental stratification and assembly mechanisms of these microbial sub-communities remain unclear. We investigated the diversities and assembly mechanisms in microbial sub-communities with distinct abundance in the deep-sea cold seep water column, from 400 m to 1400 m. We found that bacterial β-diversity, as measured by Sørensen dissimilarities, exhibited a significant species turnover pattern that was influenced by several environmental factors including depth, temperature, SiO₃²⁻, and salinity. In contrast, archaeal β-diversity showed a relatively high percentage of nestedness pattern, which was driven by the levels of soluble reactive phosphate and SiO₃²⁻. During the abundance dependency test, abundant taxa of both bacteria and archaea showed a significant species turnover, while the rare taxa possessed a higher percentage of nestedness. Stochastic processes were prominent in shaping the prokaryotic community, but deterministic processes were more pronounced for the abundant taxa than rare ones. Furthermore, the metagenomics results revealed that the abundances of methane oxidation, sulfur oxidation, and nitrogen fixation-related genes and related microbial groups were significantly higher in the bottom water. Our results implied that the carbon, sulfur, and nitrogen cycles were potentially strongly coupled in the bottom water. Overall, the results obtained in this study highlight taxonomic and abundance-dependent microbial community diversity patterns and assembly mechanisms in the water column of cold seeps, which will help understand the impacts of fluid seepage from the sea floor on the microbial community in the water column and further provide guidance for the management of cold seep ecosystem under future environmental pressures.