On the design of web crawlers for constructing an efficient Chinese-Portuguese bilingual corpus system

Cheong, Sio Tai; Xu, Jiabo; Liu, Yue

doi:10.23919/elinfocom.2018.8330698

2018 International Conference on Electronics, Information, and Communication (ICEIC) 2018

DOI: 10.23919/elinfocom.2018.8330698

|View full text |Cite

On the design of web crawlers for constructing an efficient Chinese-Portuguese bilingual corpus system

Sio Tai Cheong

Jiabo Xu

Yue Liu

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Construction of Mizo: English Parallel Corpus for Machine Translation

Thangkhanhau

Hussain

2023

ACM Trans. Asian Low-Resour. Lang. Inf. Process.

View full text Add to dashboard Cite

Parallel corpus is a key component of statistical and Neural Machine Translation (NMT). While most research focuses on machine translation, corpus creation studies are limited for many languages and no research paper on a Mizo–English corpus exists yet. A high-quality parallel corpus is required for Natural Language Processing (NLP) activities including machine translation, Chatbots, Transliteration, and Cross-Language Information Retrieval. This work aims to investigate parallel corpus creation techniques and apply them to the Mizo-English language pair. Another goal is to test machine translation on the newly constructed corpus. We contributed to LF Aligner tool to support Mizo language for Mizo sentence alignment in corpus development. Our effort created the first large-scale Mizo-English parallel corpus with over 529K sentences. The pre-processed corpus was used for Mizo-to-English NMT. It was evaluated using BLEU, ChrF, and TER scores. Our system achieved BLEU 45.08, ChrF 65.36, and TER 41.16, setting a new benchmark for Mizo-to-English translation.

show abstract

Construction of Mizo: English Parallel Corpus for Machine Translation

Thangkhanhau

Hussain

2023

ACM Trans. Asian Low-Resour. Lang. Inf. Process.

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

On the design of web crawlers for constructing an efficient Chinese-Portuguese bilingual corpus system

Cited by 1 publication

References 5 publications

Construction of Mizo: English Parallel Corpus for Machine Translation

Construction of Mizo: English Parallel Corpus for Machine Translation

Contact Info

Product

Resources

About