The rearrangement hotspot (Rhs) repeat is an ancient giant protein fold found in all domains of life. Rhs proteins are polymorphic toxins that could either be deployed as an ABC complex or via a type VI secretion system (T6SS) in interbacterial competitions. To explore the mechanism of T6SS-delivered Rhs toxins, we used the gastroenteritis-associated Vibrio parahaemolyticus as a model organism and identified an Rhs toxin-immunity pair, RhsP-RhsP_I. Our data show that RhsP-dependent prey targeting by V. parahaemolyticus requires T6SS2. RhsP can bind to VgrG2 independently without a chaperone and spontaneously self-cleaves into three fragments. The toxic C-terminal fragment (RhsP_C) can bind to VgrG2 via a VgrG2-interacting region (VIR). Our electron microscopy (EM) analysis reveals that the VIR is encapsulated inside the Rhs β barrel structure and that autoproteolysis triggers a dramatic conformational change of the VIR. This alternative VIR conformation promotes RhsP dimerization, which significantly contributes to T6SS2-mediated prey targeting by V. parahaemolyticus.