Appropriate emotions for facial expressions of 33-DOFs android head EveR-4 H33

Ahn, Ho Seok; Lee, Dong‐Wook; Choi, Dongwoon; Lee, Duk-Yeon; Hur, Manhong; Lee, Ho-Gil

doi:10.1109/roman.2012.6343898

Cited by 18 publications

(4 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Pneumatic-driven androids with a larger degree of freedom than the developed CA have also been developed [15]; however, their size and drive system make it difficult to utilize them as mobile avatars. The electric-driven Android EveR-4 H33 [29] has more degrees of freedom than the developed CA. However, this Android does not have components for perceptual functions, such as a microphone or camera, and is not developed as a remote-control avatar.…”

Section: Discussionmentioning

confidence: 99%

Development of the Lifelike Head Unit for a Humanoid Cybernetic Avatar ‘Yui’ and its Operation Interface

Nakajima,

Shinkawa,

Nakata

2024

IEEE Access

View full text Add to dashboard Cite

In avatar-mediated communication, the face-to-face interlocutor must sense the operator's presence and emotions via an avatar. Although androids resembling humans have been developed to convey presence through appearance and movement, few studies have prioritized deepening the communication experience for operators and interlocutors using android robots as avatars. To address this gap, we introduced the "cybernetic avatar 'Yui,' " featuring a human-like head unit with 28 actuation points, capable of expressing gaze, facial emotions, and speech-related mouth movements. Through an eye-tracking unit in a head-mounted display (HMD) and the degrees of freedom in both eyes of Yui, operators can naturally control the avatar's gaze. Additionally, microphones embedded in Yui's ears allowed operators to hear surrounding sounds in three dimensions, enabling them to discern the direction of calls based solely on auditory information. The HMD's face-tracking unit synchronizes the facial movements of the avatar with those of the operator. This immersive interface, coupled with Yui's human-like appearance, enabled realtime emotional transmission and communication, thus enhancing the sense of presence for both parties. Our experiments demonstrate Yui's facial expression capabilities and validate the efficacy of the system through teleoperation trials, suggesting potential advancements in avatar technology.

show abstract

Section: Discussionmentioning

confidence: 99%

Development of the Lifelike Head Unit for a Humanoid Cybernetic Avatar ‘Yui’ and its Operation Interface

Nakajima,

Shinkawa,

Nakata

2024

IEEE Access

View full text Add to dashboard Cite

show abstract

“…One of the main limitations of this study is the emotion analysis scheme we used, which was limited to the six basic emotions included in the Ekman classification, where four of the emotions are negatively charged (i.e., anger, disgust, fear, sadness), while alternative approaches propose broader schemes of eight [58] or sixteen emotions [60]. An enriched set of emotions would have fueled a more fine-grained analysis of online activity.…”

Section: Limitations and Future Directionsmentioning

confidence: 99%

Analysis of Pharmaceutical Companies’ Social Media Activity during the COVID-19 Pandemic and Its Impact on the Public

Gyftopoulos,

Drosatos,

Fico

et al. 2024

Behavioral Sciences

View full text Add to dashboard Cite

The COVID-19 pandemic, a period of great turmoil, was coupled with the emergence of an “infodemic”, a state when the public was bombarded with vast amounts of unverified information from dubious sources that led to a chaotic information landscape. The excessive flow of messages to citizens, combined with the justified fear and uncertainty imposed by the unknown virus, cast a shadow on the credibility of even well-intentioned sources and affected the emotional state of the public. Several studies highlighted the mental toll this environment took on citizens by analyzing their discourse on online social networks (OSNs). In this study, we focus on the activity of prominent pharmaceutical companies on Twitter, currently known as X, as well as the public’s response during the COVID-19 pandemic. Communication between companies and users is examined and compared in two discrete channels, the COVID-19 and the non-COVID-19 channel, based on the content of the posts circulated in them in the period between March 2020 and September 2022, while the emotional profile of the content is outlined through a state-of-the-art emotion analysis model. Our findings indicate significantly increased activity in the COVID-19 channel compared to the non-COVID-19 channel while the predominant emotion in both channels is joy. However, the COVID-19 channel exhibited an upward trend in the circulation of fear by the public. The quotes and replies produced by the users, with a stark presence of negative charge and diffusion indicators, reveal the public’s preference for promoting tweets conveying an emotional charge, such as fear, surprise, and joy. The findings of this research study can inform the development of communication strategies based on emotion-aware messages in future crises.

show abstract

“…However, although numerous studies have developed androids for emotional interactions (Kobayashi and Hara, 1993;Kobayashi et al, 2000;Minato et al, 2004Minato et al, , 2006Minato et al, , 2007Weiguo et al, 2004;Ishihara et al, 2005;Matsui et al, 2005;Berns and Hirth, 2006;Blow et al, 2006;Hashimoto et al, 2006Hashimoto et al, , 2008Oh et al, 2006;Sakamoto et al, 2007;Lee et al, 2008;Takeno et al, 2008;Allison et al, 2009;Lin et al, 2009Lin et al, , 2016Kaneko et al, 2010;Becker-Asano and Ishiguro, 2011;Ahn et al, 2012;Mazzei et al, 2012;Tadesse and Priya, 2012;Cheng et al, 2013;Habib et al, 2014;Yu et al, 2014;Asheber et al, 2016;Glas et al, 2016;Marcos et al, 2016;Faraj et al, 2021;Nakata et al, 2021; Table 1), few have empirically validated the androids that were developed. First, no study validated androids' AUs coded using FACS (Ekman and Friesen, 1978;Ekman et al, 2002).…”

Section: Introductionmentioning

confidence: 99%

An Android for Emotional Interaction: Spatiotemporal Validation of Its Facial Expressions

et al. 2022

View full text Add to dashboard Cite

Android robots capable of emotional interactions with humans have considerable potential for application to research. While several studies developed androids that can exhibit human-like emotional facial expressions, few have empirically validated androids’ facial expressions. To investigate this issue, we developed an android head called Nikola based on human psychology and conducted three studies to test the validity of its facial expressions. In Study 1, Nikola produced single facial actions, which were evaluated in accordance with the Facial Action Coding System. The results showed that 17 action units were appropriately produced. In Study 2, Nikola produced the prototypical facial expressions for six basic emotions (anger, disgust, fear, happiness, sadness, and surprise), and naïve participants labeled photographs of the expressions. The recognition accuracy of all emotions was higher than chance level. In Study 3, Nikola produced dynamic facial expressions for six basic emotions at four different speeds, and naïve participants evaluated the naturalness of the speed of each expression. The effect of speed differed across emotions, as in previous studies of human expressions. These data validate the spatial and temporal patterns of Nikola’s emotional facial expressions, and suggest that it may be useful for future psychological studies and real-life applications.

show abstract

Appropriate emotions for facial expressions of 33-DOFs android head EveR-4 H33

Cited by 18 publications

References 14 publications

Development of the Lifelike Head Unit for a Humanoid Cybernetic Avatar ‘Yui’ and its Operation Interface

Development of the Lifelike Head Unit for a Humanoid Cybernetic Avatar ‘Yui’ and its Operation Interface

Analysis of Pharmaceutical Companies’ Social Media Activity during the COVID-19 Pandemic and Its Impact on the Public

An Android for Emotional Interaction: Spatiotemporal Validation of Its Facial Expressions

Contact Info

Product

Resources

About