This study aimed to identify the species with better recovery effects by comprehensively assessing the rhizosphere abiotic and biotic factors of typical plants in the Mu Us Sandy Land, and to clarify the driving factors in the rhizosphere microbial activity among typical species. The rhizosphere microbial index (RMI) of different typical species was conducted using principal component analysis (PCA), and the driving factors affecting RMI were identified by partial least squares path modelling. The results showed that the greatest RMI was observed under Medicago sativa (0.561), followed by Pinus sylvestris var. mongolica (0.509), Hedysarum scoparium (0.470), Amorpha fruticosa (0.469) and Amygdalus pedunculata (0.416). From the perspective of nutrient input and ecological services, Medicago sativa with nitrogen fixation and Pinus sylvestris var. mongolica with strong sand-fixing and sand-prevention function which have higher RMI values could be recommended for vegetation restoration in Mu Us Sandy Land. In addition, the transformation and microbial decomposition of soil phosphorus (total phosphorus, available phosphorus, microbial biomass phosphorus and alkaline phosphatase) had a great impact on the rhizosphere microbial activity of typical plants in a desertified region. Partial least squares path modelling, generalized linear regression analysis and the Pearson correlation analysis suggested that dissolved organic carbon, microbial biomass nitrogen and phosphorus concentrations were the driving factors affecting the RMIs among typical plants. Medicago sativa and Pinus sylvestris var. mongolica could be the most suitable species for vegetation restoration in Mu Us sandy land. In addition, dissolved organic carbon, microbial biomass nitrogen and rhizosphere phosphorus transformation and utilization played a crucial role in affecting the rhizosphere microbes of typical plants.