Grain size is one of the major traits that determine rice grain yield and quality. The GS3 gene is the first major quantitative trait locus (QTL) that was identified in regulating rice grain length and weight. It was reported that the gs3 allele with a mutation in the organ size regulation (OSR) domain of the GS3 protein produced longer grains. In this study, we used the CRISPR/Cas9 gene editing technology to introduce an edited gs3 allele into our indica maintainer line, Mei1B, to enhance its grain yield and quality. Through molecular analysis and sequencing, a homologous edited-gs3 mutant line without any transgene was obtained in the T₁ generation and was named Mei2B. A superior male sterile line Mei2A was generated by backcrossing the cytoplasmic male sterile (CMS) line Mei1A with Mei2B. Mei2B had a higher grain quality and yield compared to its wild-type Mei1B. Its grain length increased by 7.9%, its length/width ratio increased from 3.89 to 4.19, TGW increased by 6.7%, and grain yield per plant increased by 14.9%. In addition, genetic improvement of other quality traits including brown rice length (6.83 mm), brown rice grain length/width ratio (3.61), matched the appearance standards set for traditional Simiao (silk seedling) type cultivars. Two restorer lines were outcrossed to both Mei1A and Mei2A to produce hybrid rice. Compared to two hybrids of Mei1A, the hybrids of Mei2A had longer grains, higher length/width ratio, TGW, and yield per plant. In addition, the hybrids of Mei2A showed a better grain appearance including better translucency, a lower chalky rice rate, and degree of chalkiness than the hybrids of Mei1A. These results demonstrated that the introduction of an elite gs3 allele into Mei1A via CRISPR/Cas9 gene editing technology led to significant genetic improvement of the rice grain. The resultant CMS line Mei2A(gs3) displayed much higher grain quality and yield than the original Mei1A. Therefore, our study demonstrated that the targeted genetic improvement via gene editing technology can enhance rice breeding, especially the breeding of three-line hybrid rice.