JIB-04, a pan-histone lysine demethylase (KDM) inhibitor, targets drug-resistant cells, along with colorectal cancer stem cells (CSCs), which are crucial for cancer recurrence and metastasis. Despite the advances in CSC biology, the effect of JIB-04 on liver CSCs (LCSCs) and the malignancy of hepatocellular carcinoma (HCC) has not been elucidated yet. Here, we showed that JIB-04 targeted KDMs, leading to the growth inhibition and cell cycle arrest of HCC, and abolished the viability of LCSCs. JIB-04 significantly attenuated CSC tumorsphere formation, growth, relapse, migration, and invasion in vitro. Among KDMs, the deficiency of KDM4B, KDM4D, and KDM6B reduced the viability of the tumorspheres, suggesting their roles in the function of LCSCs. RNA sequencing revealed that JIB-04 affected various cancer-related pathways, especially the PI3K/AKT pathway, which is crucial for HCC malignancy and the maintenance of LCSCs. Our results revealed KDM6B-dependent AKT2 expression and the downregulation of E2F-regulated genes via JIB-04-induced inhibition of the AKT2/FOXO3a/p21/RB axis. A ChIP assay demonstrated JIB-04-induced reduction in H3K27me3 at the AKT2 promoter and the enrichment of KDM6B within this promoter. Overall, our results strongly suggest that the inhibitory effect of JIB-04 on HCC malignancy and the maintenance of LCSCs is mediated via targeting the KDM6B-AKT2 pathway, indicating the therapeutic potential of JIB-04.