Grain boundaries, the two-dimensional defects between differently oriented crystals, tend to preferentially attract solutes for segregation. Solute segregation has a significant effect on the mechanical and transport properties of materials. At the atomic level, however, the interplay of structure and composition of grain boundaries remains elusive, especially with respect to light interstitial solutes like B and C. Here, we use Fe alloyed with B and C to exploit the strong interdependence of interface structure and chemistry via charge-density imaging and atom probe tomography methods. Direct imaging and quantifying of light interstitial solutes at grain boundaries provide insight into decoration tendencies governed by atomic motifs. We find that even a change in the inclination of the grain boundary plane with identical misorientation impacts grain boundary composition and atomic arrangement. Thus, it is the smallest structural hierarchical level, the atomic motifs, that controls the most important chemical properties of the grain boundaries. This insight not only closes a missing link between the structure and chemical composition of such defects but also enables the targeted design and passivation of the chemical state of grain boundaries to free them from their role as entry gates for corrosion, hydrogen embrittlement, or mechanical failure.