Evaluation of automatic updates of Roget’s Thesaurus

Abstract

Thesauri and similarly organised resources attract increasing interest of Natural Language Processing researchers. Thesauri age fast, so there is a constant need to update their vocabulary. Since a manual update cycle takes considerable time, automated methods are required. This work presents a tuneable method of measuring semantic relatedness, trained on Roget's Thesaurus, which generates lists of terms related to words not yet in the Thesaurus. Using these lists of terms, we experiment with three methods of adding words to the Thesaurus. We add, with high confidence, over 5500 and 9600 new word senses to versions of Roget's Thesaurus from 1911 and 1987 respectively. We evaluate our work both manually and by applying the updated thesauri in three NLP tasks: selection of the best synonym from a set of candidates, pseudo-word-sense disambiguation and SAT-style analogy problems. We find that the newly added words are of high quality. The additions significantly improve the performance of Roget's-based methods in these NLP tasks. The performance of our system compares favourably with that of WordNet-based methods. Our methods are general enough to work with different versions of Roget's Thesaurus.

Exploring User Experience with Image Schemas, Sentiments, and Semantics

“…The lexical resource used for this purpose is OntoRo. This is an electronic resource based on Roget's Thesaurus [60] and has been employed in several other studies related to design [61] and information retrieval [62], [63]. Moreover, the use of OntoRo is also justified by linguistic studies [36], which have found that many of the names of image schemas correspond to Roget's subcategories.…”