Multimodal approach for tension levels estimation in news videos

Pereira, Moisés Henrique Ramos; Pádua, Flávio Luis Cardeal; Dalip, Daniel Hasan; Benevenuto, Fabrí­cio; Pereira, Adriano C. M.; Lacerda, Anísio

doi:10.1007/s11042-019-7691-4

Cited by 9 publications

(2 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The authors upload the two documents to Wmatrix 5 2 to obtain the emotional semantic tagging of them. And 10 tagged news texts are randomly selected from CC and AC respectively, and they are manually checked by two authors, the two authors cross-review and negotiate the emotional semantic tagging of these 20 texts, and calculate the emotional semantic tagging accuracy of Wmatrix 5 by means of the tagging accuracy formula introduced by Pereira et al (2019: 23,797). The formula is as following: the accuracy ratio of emotional semantic tagging is equal to (TP + TN)/(TP + TN + FP + FN), where TP is the numbers of emotional words correctly tagged by the software, TN is the numbers of the words that are correctly tagged as non-emotional words by the software, FP is the numbers of the non-emotional words that are incorrectly tagged as emotional words, and FN is the numbers of the emotional words that are incorrectly tagged as non-emotional words.…”

Section: The Construction Of Socio-emotional Theorymentioning

confidence: 99%

“…At present, the researches on discoursal emotions in news mainly involve recognition (Li et al, 2019: 746; Pereira et al, 2019: 23783), functions (Lee and Chen, 2021: 504; Ming and Ma, 2022: 37), and characteristics (Joa and Yun, 2022: 1449; Sing Bik Ngai et al, 2022: 572) of the discoursal emotions. Most of these researches are based on computerized statistical models, and not many scholars construct the theories specifically for the researches on discoursal emotions (Zhang, 2022: 74).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A contrastive study of discoursal emotions between China’s and American newspapers from the perspective of Socio-emotional Theory: The case of the reports on Hong Kong National Security Law

Peng

Hou

2023

Discourse & Communication

View full text Add to dashboard Cite

At present, there is an emotional turn in news researches, however, there are not many theories dedicated to the studies of emotions in news discourse. Therefore, by employing corpus analysis, this paper proposes Socio-emotional Theory, and contrasts the emotions in the news discourse on Hong Kong National Security Law between China’s and American newspapers. The results show that as for the themes of emotional discourse, China’s newspapers emphasize national security, social stability, anti-interference in China’s internal affairs, the positive roles of the law, the destructive nature of Hong Kong separatists, and their unreasonable resistance to the law; while American newspapers highlight their worry and fear about the law. Secondly, in terms of the distribution of emotional semantic categories, China’s newspapers talk more about confidence and happiness; however, American newspapers display more fear, sadness, worry, anger, and disappointment. As for ideologies, China’s newspapers show support for the law with less worry, while American newspapers display their opposition to the law with worry and anger, and these differences in ideologies actually reflect the conflict between China’s Democratic Centralism and western Populism. This study can provide enlightenment for the construction of a harmonious international discourse system, expand the ontological components and interpretation boundaries of discourse analysis theories, and promote the researches on emotions of news discourse.

show abstract

Section: The Construction Of Socio-emotional Theorymentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

A contrastive study of discoursal emotions between China’s and American newspapers from the perspective of Socio-emotional Theory: The case of the reports on Hong Kong National Security Law

Peng

Hou

2023

Discourse & Communication

View full text Add to dashboard Cite

show abstract

Multimodal sentimental analysis for social media applications: A comprehensive review

Chandrasekaran

Nguyen

Hemanth

2021

WIREs Data Min & Knowl

View full text Add to dashboard Cite

The analysis of sentiments is essential in identifying and classifying opinions regarding a source material that is, a product or service. The analysis of these sentiments finds a variety of applications like product reviews, opinion polls, movie reviews on YouTube, news video analysis, and health care applications including stress and depression analysis. The traditional approach of sentiment analysis which is based on text involves the collection of large textual data and different algorithms to extract the sentiment information from it. But multimodal sentimental analysis provides methods to carry out opinion analysis based on the combination of video, audio, and text which goes a way beyond the conventional text-based sentimental analysis in understanding human behaviors. The remarkable increase in the use of social media provides a large collection of multimodal data that reflects the user's sentiment on certain aspects. This multimodal sentimental analysis approach helps in classifying the polarity (positive, negative, and neutral) of the individual sentiments. Our work aims to present a survey of recent developments in analyzing the multimodal sentiments (involving text, audio, and video/image) which involve humanmachine interaction and challenges involved in analyzing them. A detailed survey on sentimental dataset, feature extraction algorithms, data fusion methods, and efficiency of different classification techniques are presented in this work.

show abstract

Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects

Khan,

Xu,

Liu

et al. 2024

Multimedia Systems

View full text Add to dashboard Cite

In recent years, emotion recognition has received significant attention, presenting a plethora of opportunities for application in diverse fields such as human–computer interaction, psychology, and neuroscience, to name a few. Although unimodal emotion recognition methods offer certain benefits, they have limited ability to encompass the full spectrum of human emotional expression. In contrast, Multimodal Emotion Recognition (MER) delivers a more holistic and detailed insight into an individual's emotional state. However, existing multimodal data collection approaches utilizing contact-based devices hinder the effective deployment of this technology. We address this issue by examining the potential of contactless data collection techniques for MER. In our tertiary review study, we highlight the unaddressed gaps in the existing body of literature on MER. Through our rigorous analysis of MER studies, we identify the modalities, specific cues, open datasets with contactless cues, and unique modality combinations. This further leads us to the formulation of a comparative schema for mapping the MER requirements of a given scenario to a specific modality combination. Subsequently, we discuss the implementation of Contactless Multimodal Emotion Recognition (CMER) systems in diverse use cases with the help of the comparative schema which serves as an evaluation blueprint. Furthermore, this paper also explores ethical and privacy considerations concerning the employment of contactless MER and proposes the key principles for addressing ethical and privacy concerns. The paper further investigates the current challenges and future prospects in the field, offering recommendations for future research and development in CMER. Our study serves as a resource for researchers and practitioners in the field of emotion recognition, as well as those intrigued by the broader outcomes of this rapidly progressing technology.

show abstract

Multimodal approach for tension levels estimation in news videos

Cited by 9 publications

References 41 publications

A contrastive study of discoursal emotions between China’s and American newspapers from the perspective of Socio-emotional Theory: The case of the reports on Hong Kong National Security Law

A contrastive study of discoursal emotions between China’s and American newspapers from the perspective of Socio-emotional Theory: The case of the reports on Hong Kong National Security Law

Multimodal sentimental analysis for social media applications: A comprehensive review

Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects

Contact Info

Product

Resources

About