Multilingual Media Monitoring and Text Analysis – Challenges for Highly Inflected Languages

Steinberger, Ralf; Ehrmann, Maud; Pajzs, Júlia; Ebrahim, Mohamed; Shinar, J.; Turchi, Marco

doi:10.1007/978-3-642-40585-3_3

Cited by 7 publications

(4 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition, the existence of different inflected wordforms in the text implies that the task of automatic indexing for texts written in a highly inflected language such Greek would be greatly facilitated by the use of tools such as lemmatizers in a linguistic preprocessing phase [11]. …”

Section: Discussionmentioning

confidence: 99%

A Preliminary Investigation into the Automatic EuroVoc Indexing of Greek Documents

Galiotou

2014

Proceedings of the 18th Panhellenic Conference on Informatics

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 99%

A Preliminary Investigation into the Automatic EuroVoc Indexing of Greek Documents

Galiotou

2014

Proceedings of the 18th Panhellenic Conference on Informatics

View full text Add to dashboard Cite

show abstract

“…A multilingual goal hardly can be fulfilled with classical monolingual approaches. This is particularly the case for highly inflected languages [12]. Despite the sequential aspect of the classic IE chain, a decomposition problem arises: a high marginal cost is needed for analyzing any new language.…”

Section: Introductionmentioning

confidence: 99%

Multilingual event extraction for epidemic detection

Lejeune

Brixtel²,

Doucet³

et al. 2015

Artificial Intelligence in Medicine

View full text Add to dashboard Cite

“…We are developing a robust and accurate classification technique for known and new topics, utilizing a rich dataset spanning various languages. For a comprehensive understanding of these issues, readers may refer to several sources: [1] presents a comprehensive overview of media monitoring problems and best practices in Europe for 14 languages from a social perspective; [2] describes various social media monitoring tools published by the NATO Strategic Communications Center of Excellence, and [3] discusses the challenges of highly inflected languages in multilingual media monitoring.…”

Section: Introductionmentioning

confidence: 99%

Towards Media Monitoring: Detecting Known and Emerging Topics through Multilingual and Crosslingual Text Classification

Kapočiūtė-Dzikienė,

Ungulaitis

2024

Applied Sciences

View full text Add to dashboard Cite

This study aims to address challenges in media monitoring by enhancing closed-set topic classification in multilingual contexts (where both training and testing occur in several languages) and crosslingual contexts (where training is in English and testing spans all languages). To achieve this goal, we utilized a dataset from the European Media Monitoring webpage, which includes approximately 15,000 article titles across 18 topics in 58 different languages spanning a period of nine months from May 2022 to March 2023. Our research conducted comprehensive comparative analyses of nine approaches, encompassing a spectrum of embedding techniques (word, sentence, and contextual representations) and classifiers (trainable/fine-tunable, memory-based, and generative). Our findings reveal that the LaBSE+FFNN approach achieved the best performance, reaching macro-averaged F1-scores of 0.944 ± 0.015 and 0.946 ± 0.019 in both multilingual and crosslingual scenarios. LaBSE+FFNN’s similar performance in multilingual and crosslingual scenarios eliminates the need for machine translation into English. We also tackled the open-set topic classification problem by training a binary classifier capable of distinguishing between known and new topics with the average loss of ∼0.0017 ± 0.0002. Various feature types were investigated, reaffirming the robustness of LaBSE vectorization. The experiments demonstrate that, depending on the topic, new topics can be identified with accuracies above ∼0.796 and of ∼0.9 on average. Both closed-set and open-set topic classification modules, along with additional mechanisms for clustering new topics to organize and label them, are integrated into our media monitoring system, which is now used by our real client.

show abstract

Multilingual Media Monitoring and Text Analysis – Challenges for Highly Inflected Languages

Cited by 7 publications

References 8 publications

A Preliminary Investigation into the Automatic EuroVoc Indexing of Greek Documents

A Preliminary Investigation into the Automatic EuroVoc Indexing of Greek Documents

Multilingual event extraction for epidemic detection

Towards Media Monitoring: Detecting Known and Emerging Topics through Multilingual and Crosslingual Text Classification

Contact Info

Product

Resources

About