Creating and Weighting Hunspell Dictionariesas Finite-State Automata

Pirinen, Tommi A.; Lindén, Krister

doi:10.14746/il.2010.21.1

Cited by 12 publications

(6 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The Hunspell spelling system is adapted to languages with rich morphology, and was originally developed for Hungarian. In OpenOffice.org Hunspell supports over 98 languages (Pirinen and Lindén 2010). When using these spell checkers for clinical text medical, or clinical dictionaries need to be added, see Patrick and Nguyen (2011).…”

Section: Spell Checking Of Clinical Textmentioning

confidence: 99%

Clinical Text Mining

Dalianis

2018

View full text Add to dashboard Cite

distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made. The images or other third party material in this book are included in the book's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the book's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

show abstract

Section: Spell Checking Of Clinical Textmentioning

confidence: 99%

Clinical Text Mining

Dalianis

2018

View full text Add to dashboard Cite

show abstract

“…They use test corpora containing words and calculate an error value for every record using overstemming and understemming indices [2]. We also found a very detailed Hungarian paper comparing some of the analyzers that we will evaluate, namely Hunmorph-Ocamorph [16], Hunmorph-Foma [5], Humor [13] and Hunspell [9]. The authors also brought in some other models that we didn't consider, as they can only be used for stemming purposes and not lemmatization or deeper morphological analysis: the Porter stemmer [10], the Hungarian adaptation of Snowball [11,14] and some Apache Lucene [6] modules like KStem, Porter, EnglishMinimal, Stempel and Morfologik.…”

Section: Morphological Analyzersmentioning

confidence: 99%

“…Hunspell [9] is a popular open-source spell checker of LibreOffice, OpenOffice.org, Mozilla Firefox and Thunderbird, Google Chrome, etc. Although it's mainly used for spell checking, it has other use cases as well, including morphological analysis.…”

Section: Hunspellmentioning

confidence: 99%

Benchmarking morphological analyzers for the Hungarian language

Szabó¹,

Kovács²

2018

AMI

View full text Add to dashboard Cite

In this paper we evaluate, compare and benchmark the four most widely used and most advanced morphological analyzers for the Hungarian language, namely Hunmorph-Ocamorph, Hunmorph-Foma, Humor and Hunspell. The main goal of the current research is to define objective metrics while comparing these tools. The novelty of this paper is the fact that the analyzers are compared based on their annotation token systems instead of their lemmatization features. The proposed metrics for the comparison are the following: how different their annotation token systems are, how many words are recognized by the different analyzers and how many words are there whose morphological structure is equivalent using a well-defined mapping among the annotation token systems. For each of these metrics, we define the concept of similarity and distance. For the evaluation we use a unique Hungarian corpus that we generated in an automated way from Hungarian free texts, as well as a novel automated token mapping generation algorithm. According to our experimental results, Hunmorph-Ocamorph gives the best results. Hunmorph-Foma is very close to it, but sometimes returns an invalid lemma. Humor is the third best analyzer, while Hunspell is far worse than the other three tools.

show abstract

“…A real-word spelling error occurs when one word is mistakenly used for another word, such as in fly form* Paris. Typical approaches include using confusion set (Golding and Roth, 1999;Carlson et al, 2001), contextual information (Verberne, 2002;Islam and Inkpen, 2009), and others (Pirinen and Linden, 2010;Amorim and Zampieri, 2013).…”

Section: Introductionmentioning

confidence: 99%

NTOU Chinese Spelling Check System in Sighan-8 Bake-off

Chu¹,

Lin

2015

Proceedings of the Eighth SIGHAN Workshop on Chinese Language Processing

View full text Add to dashboard Cite

This paper describes details of NTOU Chinese spelling check system in SIGHAN-8 Bakeoff. Besides the basic architecture of the previous system participating in last two CSC tasks, three new preference rules were proposed to deal with Simplified Chinese characters, variants, sentence-final particles, and DE-particles. A new sentence likelihood function was proposed based on frequencies of space-removed version of Google n-gram datasets. Two formal runs were submitted where the best one was created by the system using Google n-gram frequency information.

show abstract

Creating and Weighting Hunspell Dictionariesas Finite-State Automata

Cited by 12 publications

References 7 publications

Clinical Text Mining

Clinical Text Mining

Benchmarking morphological analyzers for the Hungarian language

NTOU Chinese Spelling Check System in Sighan-8 Bake-off

Contact Info

Product

Resources

About