Misfolded proteins in the endoplasmic reticulum (ER) activate IRE1α endoribonuclease in mammalian cells, which mediates XBP1 mRNA splicing to produce an active transcription factor. This promotes the expression of specific genes to alleviate ER stress, thereby attenuating IRE1α. Although sustained activation of IRE1α is linked to human diseases, it is not clear how IRE1α is attenuated during ER stress. Here, we identify that Sec63 is a subunit of the previously identified IRE1α/Sec61 translocon complex. We find that Sec63 recruits and activates BiP ATPase through its luminal J-domain to bind onto IRE1α. This leads to inhibition of higher-order oligomerization and attenuation of IRE1α RNase activity during prolonged ER stress. In Sec63-deficient cells, IRE1α remains activated for a long period of time despite the presence of excess BiP in the ER. Thus, our data suggest that the Sec61 translocon bridges IRE1α with Sec63/BiP to regulate the dynamics of IRE1α signaling in cells.