The vibrational strong coupling (VSC) between molecular vibrations and cavity photon modes has recently emerged as a promising tool for influencing chemical reactivities. Despite numerous experimental and theoretical efforts, the underlying mechanism of VSC effects remains elusive. In this study, we combine state-of-art quantum cavity vibrational self-consistent field/configuration interaction theory (cav-VSCF/VCI), quasi-classical trajectory method, along with the quantum-chemical CCSD(T)-level machine learning potential, to simulate the hydrogen bond dissociation dynamics of water dimer under VSC. We observe that manipulating the light-matter coupling strength and cavity frequencies can either inhibit or accelerate the dissociation rate. Furthermore, we discover that the cavity surprisingly modifies the vibrational dissociation channels, with a pathway involving both water fragments in their ground vibrational states becoming the major channel, which is a minor one when the water dimer is outside the cavity. We elucidate the mechanisms behind these effects by investigating the critical role of the optical cavity in modifying the intramolecular and intermolecular coupling patterns. While our work focuses on single water dimer system, it provides direct and statistically significant evidence of VSC effects on molecular reaction dynamics.