Processing network emojis in Chinese sentence context: An ERP study

Tang, Mengmeng; Chen, Bingfei; Zhao, Xiufeng; Zhao, Lun

doi:10.1016/j.neulet.2020.134815

Cited by 21 publications

(8 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…We also extend prior emoji research that has largely focused on emoji-word substitutions (Cohn et al, 2018;Gustafsson, 2017;Tang et al, 2020;Weissman, 2019) by instead presenting the text and the emojis in our study at the same time (e.g., the apple emoji accompanied the word apple in the sentence). Although emojis commonly replace a word in text, they are also commonly appended to the end of the message (Cramer, Juan, & Tetreault, 2016).…”

mentioning

confidence: 63%

“…Prior investigations of emoji processing have used a substitution approach whereby emojis substituted for specific words in a sentence (e.g., the pizza and smiley face emojis could replace the words pizza and happy, respectively). Using this substitution approach with the self-paced reading paradigm (Cohn, Roijackers, Schaap, & Engelen, 2018) and the rapid serial visual presentation (RSVP) paradigm (Tang, Chen, Zhao, & Zhao, 2020;Weissman, 2019), results have demonstrated that emojis that are semantically congruent with the word they replace are read faster (Cohn et al, 2018) and elicit reduced N400 amplitudes (Tang et al, 2020;Weissman, 2019), compared with emojis that are semantically incongruent with the word they replace. Akin to the N400 effect with words (e.g., Dimigen et al, 2012;Kutas & Hillyard, 1980), the reduction in N400 amplitudes for congruent compared with incongruent emojis suggests that emojis are integrated with text in a similar manner as are words (Weissman, 2019).…”

mentioning

confidence: 99%

See 1 more Smart Citation

Are emojis processed like words?: Eye movements reveal the time course of semantic processing for emojified text

2021

View full text Add to dashboard Cite

Emojis have many functions that support reading. Most obviously, they convey semantic information and support reading comprehension (Lo, CyberPsychology & Behavior, 11[5], 595-597, 2008; Riordan, Computers in Human Behavior, 76, 75-86, 2017b). However, it is undetermined whether emojis recruit the same perceptual and cognitive processes for identification and integration during reading as do words. To investigate whether emojis are processed like words, we used eye tracking to examine the time course of semantic processing of emojis during reading. Materials consisted of sentences containing a target word (e.g., coffee in the sentence "My tall coffee is just the right temperature") when there was no emoji present and when there was a semantically congruent (i.e., synonymous) emoji (e.g., the cup of coffee emoji, ) or an incongruent emoji (e.g., the beer mug emoji, ) present at the end of the sentence. Similar to congruency effects with words, congruent emojis were fixated for shorter periods and were less likely to be refixated than were incongruent emojis. In addition, congruent emojis were more frequently skipped than incongruent emojis, which suggests that semantic aspects of emoji processing begin in the parafovea. Finally, the presence of an emoji, relative to its absence increased target-word skipping rates and reduced total time on target words. We discuss the implications of our findings for models of eye-movement control during reading.Keywords Emojis . Eye movements and reading . Reading models . Parafoveal processing Are emojis processed like words? As with words, a core function of emojis is to convey semantic information (Lo, 2008;Riordan, 2017b). Although emojis serve many different functions to support reading, it is unknown whether the same cognitive and perceptual processes that support the identification and integration of words during reading also extend to emojis. Given the growing popularity of emojis on the internet, social media (Novak, Smailović, Sluban, & Mozetič, 2015), and in text-based communication (Tigwell & Flatla, 2016; i.e., more than 3,000 emojis are available to date; Unicode 12.1; https:// unicode.org/emoji/charts/full-emoji-list.html), we aimed to determine whether the time course of semantic processing for emojis is similar to words. The time course of semantic processing provides empirical constraints for the development of models of eye movement control during reading (for reviews, see Rayner, 1998Rayner, , 2009. Considering the ubiquity * Eliza Barach

show abstract

mentioning

confidence: 63%

mentioning

confidence: 99%

Are emojis processed like words?: Eye movements reveal the time course of semantic processing for emojified text

2021

View full text Add to dashboard Cite

show abstract

“…Traditional textual languages rely on the regions of the brain that process language codes, whereas emojis activate regions of the brain that process nonverbal information (Yuasa et al, 2011). Previous studies have also confirmed that the combination of words and emoticons induce more complex brain activation patterns during the read-memory search process than words alone (Tang et al, 2020(Tang et al, , 2021. Therefore, when language in the form of text and emojis are combined, an increase in perceptual load may occur due to different information processing processes (Kahn, 2017) and the resulting cognitive complexity (Bashirzadeh et al, 2021) may reduce or eliminate the effectiveness of communication.…”

Section: Discussionmentioning

confidence: 90%

Does the relationship between brand attitude, brand attachment and purchase intention vary based on the type of prosocial expression-based brand emoji?

Jeon

2022

JPBM

View full text Add to dashboard Cite

Purpose This study aims to analyze the most effective type of emoji for deriving positive marketing results by determining whether the relationship between brand attitude, brand attachment and purchase intention is moderated by the various types of prosocial expression-based brand emojis used. Design/methodology/approach An online survey was administered to Koreans in their 20s. Starbucks brand emojis were classified into three types: static gesture, animated gesture and a combined animated gesture and displayed word. A moderated–mediation analysis was performed to verify the research hypotheses. Gender, age, region of residence, frequency of Starbucks use and Starbucks favorability were used as control variables. Findings Animations in emojis were shown to strengthen the marketing effect. Further, combining animated prosocial gestures and displayed words had a more positive marketing effect than merely applying animated prosocial gestures. Originality/value This study closely examined the role of verbal, in the form of colloquial words, and nonverbal aspects, in the form of emojis, in the creation of positive business outcomes. Additionally, the positive marketing effect of animated emojis is discussed from a mechanistic point of view by linking research results to those in the field of neuroscience (mirroring by mirror neurons).

show abstract

“…Languages not only include conceptual information, but also carry emotional information. Previous studies mostly focused on emotional faces [8] [22], internet-based social emotional symbols [1] [5] [21], emotional pictures and alphabetic words [10] [12], while few studies focused on Chinese emotional information now. Although some scholars study Chinese emotion words [26] [27], most of them are about emotion words, and few of them are about emotion characters and sentences.…”

Section: Introductionmentioning

confidence: 99%

Emotional visual processing of Chinese information based on ERPs

Zhang

Yu²

2023

Fifth International Conference on Computer Information Science and Artificial Intelligence (CISAI 2022)

View full text Add to dashboard Cite

The computer's processing of emotion mimics the human brain's processing of emotional language. The study of linguistic emotion processing is of great significance to the research of affective neuroscience and language understanding. In this study, we compared emotional character, words, and sentences in alphabetic languages and Chinese (logographic language) through literature review and described the possible P1/N1 components of early Chinese emotional characters through neural processing of early Chinese characters. Through literature survey, we found that like alphabetic languages, Chinese emotional words (negative and positive) also evoked greater EPN/LPC effect to emotion words than neutral words under different experimental tasks. This suggests that the human brain has the same emotional cognitive processing mechanism for alphabetic language and logographic language. The emotional event-related potential of Chinese characters, words, and sentences is conducive to further empower computers to understand and generate emotional expressions of text as human brains do.

show abstract

Processing network emojis in Chinese sentence context: An ERP study

Cited by 21 publications

References 24 publications

Are emojis processed like words?: Eye movements reveal the time course of semantic processing for emojified text

Are emojis processed like words?: Eye movements reveal the time course of semantic processing for emojified text

Does the relationship between brand attitude, brand attachment and purchase intention vary based on the type of prosocial expression-based brand emoji?

Emotional visual processing of Chinese information based on ERPs

Contact Info

Product

Resources

About