Ribosomal S6 kinase (RSK) family is a group of serine/threonine kinases, including four isoforms (RSK1/2/3/4). As a downstream effector of the Ras-mitogen-activated protein kinase (Ras-MAPK) pathway, RSK participates in many physiological activities such as cell growth, proliferation, and migration, and is intimately involved in tumor occurrence and development. As a result, it is recognized as a potential target for anti-cancer and anti-resistance therapies. There have been several RSK inhibitors discovered or designed in recent decades, but only two have entered clinical trials. Low specificity, low selectivity, and poor pharmacokinetic properties in vivo limit their clinical translation. Published studies performed structure optimization by increasing interaction with RSK, avoiding hydrolysis of pharmacophores, eliminating chirality, adapting to binding site shape, and becoming prodrugs. Besides enhancing efficacy, the focus of further design will move towards selectivity since there are functional differences among RSK isoforms. This review summarized the types of cancers associated with RSK, along with the structural characteristics and optimization process of the reported RSK inhibitors. Furthermore, we addressed the importance of RSK inhibitors' selectivity and discussed future drug development directions. This review is expected to shed light on the emergence of RSK inhibitors with high potency, specificity, and selectivity.