BLARK for multi-dialect languages: towards the Kurdish BLARK

Hassani, Hossein

doi:10.1007/s10579-017-9400-0

Cited by 13 publications

(15 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Regarding the Kurdish language, eforts has increased recently to create language resources, such as lexicographical resources [5], monolingual corpora [1,16], dialect corpora [32] and even a folkloric corpus [4]. These have improved the situation that was reported by Hassani [21]. Moreover, the construction of inter-dialectal resources for Kurdish has been of interest previously.…”

Section: Related Workmentioning

confidence: 99%

Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus

Ahmadi

Hassani

Jaff

2022

ACM Trans. Asian Low-Resour. Lang. Inf. Process.

Self Cite

View full text Add to dashboard Cite

Machine translation has been a major motivation of development in natural language processing. Despite the burgeoning achievements in creating more efficient machine translation systems, thanks to deep learning methods, parallel corpora have remained indispensable for progress in the field. In an attempt to create parallel corpora for the Kurdish language, in this article, we describe our approach in retrieving potentially alignable news articles from multi-language websites and manually align them across dialects and languages based on lexical similarity and transliteration of scripts. We present a corpus containing 12,327 translation pairs in the two major dialects of Kurdish, Sorani and Kurmanji. We also provide 1,797 and 650 translation pairs in English-Kurmanji and English-Sorani. The corpus is publicly available under the CC BY-NC-SA 4.0 license. 1

show abstract

Section: Related Workmentioning

confidence: 99%

Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus

Ahmadi

Hassani

Jaff

2022

ACM Trans. Asian Low-Resour. Lang. Inf. Process.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Our literature review indicates that some of these contributions fail to provide open-source solutions. Despite financial and scientific constraints in Kurdish language processing, the Kurdish Language Processing Project (KLPP) in 2012 3 and Kurdish Basic Language Resource Kit (Kurdish BLARK) (Hassani, 2018) putational linguistics, we reviewed the scientific publications that directly address an issue in those fields. A total number of 53 publications are collected from the widely-used academic databases and search engines such as Google Scholar 5 , and then classified based on their discussed sub-fields which are illustrated in Figure 1.…”

Section: Current State Of Kurdish Language Processingmentioning

confidence: 99%

KLPT – Kurdish Language Processing Toolkit

Ahmadi¹

2020

Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS)

View full text Add to dashboard Cite

Despite the recent advances in applying language-independent approaches to various natural language processing tasks thanks to artificial intelligence, some language-specific tools are still essential to process a language in a viable manner. Kurdish language is a lessresourced language with a notable diversity in dialects and scripts and lacks basic language processing tools. To address this issue, we introduce a language processing toolkit to handle such a diversity in an efficient way. Our toolkit is composed of fundamental components such as text preprocessing, stemming, tokenization, lemmatization and transliteration and is able to get further extended by future developers. This project is publicly available 1 .

show abstract

“…However, not all Kurdish readers are familiar with both mentioned scripts that could be resolved by automatic transliterators. So far, the developed tools mostly transliterate Persian-Arabic scripts into Latin (Hassani, 2018;Ahmadi, 2019). We present a transliterator to transliterate Kurdish texts in Latin into Persian-Arabic script.…”

Section: Introductionmentioning

confidence: 99%

“…Kurdish language processing requires endeavor by interested researchers and scholars to overcome the resource and tool scarcity to eliminate the obstacles in front of its tasks. The areas that need attention and the efforts required have been addressed in (Hassani, 2018).…”

Section: Introductionmentioning

confidence: 99%

Transliterating Kurdish texts in Latin into Persian-Arabic script

Hassani¹

2021

Preprint

Self Cite

View full text Add to dashboard Cite

Kurdish is written in different scripts. The two most popular scripts are Latin and Persian-Arabic. However, not all Kurdish readers are familiar with both mentioned scripts that could be resolved by automatic transliterators. So far, the developed tools mostly transliterate Persian-Arabic scripts into Latin. We present a transliterator to transliterate Kurdish texts in Latin into Persian-Arabic script. We also discuss the issues that should be considered in the transliteration process. The tool is a part of Kurdish BLARK, and it is publicly available for non-commercial use 1 .

show abstract

BLARK for multi-dialect languages: towards the Kurdish BLARK

Cited by 13 publications

References 16 publications

Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus

Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus

KLPT – Kurdish Language Processing Toolkit

Transliterating Kurdish texts in Latin into Persian-Arabic script

Contact Info

Product

Resources

About