Dzongkha Word Segmentation using Deep Learning

Jamtsho, Yeshi; Muneesawang, Paisarn

doi:10.1109/kst48564.2020.9059451

Cited by 5 publications

(2 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The author had used a POS tagged corpus prepared by the Dzongkha Development Commission of Bhutan (DDC). However, Jamtsho and Muneesawang (2020) studied Dzongkha word segmentation using deep learning. They used the syllable-tagged corpus curated by DDC.…”

Section: Introductionmentioning

confidence: 99%

Dzongkha Next Words Prediction Using Bidirectional LSTM

Wangchuk¹,

Wangchuk

Namgyel

2023

bjrd

View full text Add to dashboard Cite

Dzongkha Development Commission of Bhutan (DDC) is trying to computerize Dzongkha. However, the computerization of Dzongkha poses numerous challenges. Currently, the support for Dzongkha in modern technology is limited to printing, typing, and storage. Typewriting a single Dzongkha word requires several keypresses. As a result, typing Dzongkha is tedious. In this paper, the Dzongkha word label prediction was studied. The purpose of the study was to further reduce keystrokes and make Dzongkha typing much faster. The dataset encompasses different genres curated by DDC. The dataset consisted of 10000 sentences and 4820 unique words. Next, 52150 sequences were generated using N-gram methods followed by vectorizing text using embedding techniques. Different RNN-based models were evaluated for the next Dzongkha words prediction. Two Bi-LSTM layers with 512 hidden layer neurons gave the best accuracy of 73.89% with a loss of 1.0722.

show abstract

Section: Introductionmentioning

confidence: 99%

Dzongkha Next Words Prediction Using Bidirectional LSTM

Wangchuk¹,

Wangchuk

Namgyel

2023

bjrd

View full text Add to dashboard Cite

show abstract

“…To date, there has been no attempt to study English to Dzongkha translation or vice-versa. Nonetheless, next syllables prediction for Dzongkha [2], Dzongkha word segmentation [3], text to speech [4], part-of-speech (POS) tagging, and annotation of the corpus have been studied. To keep on par with the advancement of technologies and to resolve the digital divide in the country, the study on Dzongkha translation is timely.…”

Section: Introductionmentioning

confidence: 99%

Dzongkha to English translation using the neural machine translation approach

Wangchuk

Navaneethakrishnan

Jamtsho

et al. 2023

IJEECS

View full text Add to dashboard Cite

<span>In this era of technology, a communication barrier is a thing of the past. With each passing day, different types of language-based applications are being launched. There are 109 official languages Google has translated to date. However, the Dzongkha translation has not been studied. The purpose of this paper was to study Dzongkha to English translation. The parallel corpus was collected from the Dzongkha development commission of Bhutan. The dataset consisted of 53018 sentence pairs. Unique words in Dzongkha and English were 13,393 and 12,506 respectively. Different neural machine translation models were implemented. The experimental results show that the bleu score of Seq2Seq models followed a fluctuating trend. However, the bleu score of the transformer model increases gradually. It was observed that the transformer outperformed the Seq2Seq models. The highest accuracy and the lowest training loss obtained were 84.46% and 0.014858 respectively with a bleu score of 64.89.</span>

show abstract

Text Segmentation and Transliteration Using Deep Learning

et al. 2023

2023 International Conference on Ambient Intelligence, Knowledge Informatics and Industrial Electronics (AIKIIE)

View full text Add to dashboard Cite

Dzongkha Word Segmentation using Deep Learning

Cited by 5 publications

References 20 publications

Dzongkha Next Words Prediction Using Bidirectional LSTM

Dzongkha Next Words Prediction Using Bidirectional LSTM

Dzongkha to English translation using the neural machine translation approach

Text Segmentation and Transliteration Using Deep Learning

Contact Info

Product

Resources

About