Effective Seed-Guided Topic Labeling for Dataless Hierarchical Short Text Classification

Yang, Yi; Wang, Hongan; Zhu, Jiaqi; Shi, Wandong; Guo, Wenli; Zhang, Jiawen

doi:10.1007/978-3-030-74296-6_21

Cited by 2 publications

(1 citation statement)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…At an early stage, some researchers used auxiliary knowledge bases like Wikipedia to establish the semantic correlation between texts and labels [3,29]. Subsequently, topic-model based methods emerged [4,13,14,33,34], which inferred category-aware topics from a limited set of seed words. In the last few years, neural methods has gained prominance [22,23,31,36,39].…”

Section: Related Work 21 Weakly Supervised Text Classificationmentioning

confidence: 99%

RulePrompt: Weakly Supervised Text Classification with Prompting PLMs and Self-Iterative Logical Rules

Li,

Zhu,

Wang

et al. 2024

Proceedings of the ACM Web Conference 2024

Self Cite

View full text Add to dashboard Cite

Weakly supervised text classification (WSTC), also called zero-shot or dataless text classification, has attracted increasing attention due to its applicability in classifying a mass of texts within the dynamic and open Web environment, since it requires only a limited set of seed words (label names) for each category instead of labeled data. With the help of recently popular prompting Pre-trained Language Models (PLMs), many studies leveraged manually crafted and/or automatically identified verbalizers to estimate the likelihood of categories, but they failed to differentiate the effects of these category-indicative words, let alone capture their correlations and realize adaptive adjustments according to the unlabeled corpus. In this paper, in order to let the PLM effectively understand each category, we at first propose a novel form of rule-based knowledge using logical expressions to characterize the meanings of categories. Then, we develop a prompting PLM-based approach named RulePrompt for the WSTC task, consisting of a rule mining module and a rule-enhanced pseudo label generation module, plus a self-supervised fine-tuning module to make the PLM align with this task. Within this framework, the inaccurate pseudo labels assigned to texts and the imprecise logical rules associated with categories mutually enhance each other in an alternative manner. That establishes a self-iterative closed loop of knowledge (rule) acquisition and utilization, with seed words serving as the starting point. Extensive experiments validate the effectiveness and robustness of our approach, which markedly outperforms state-of-the-art weakly supervised methods. What is more, our approach yields interpretable category rules, proving its advantage in disambiguating easily-confused categories.

show abstract