Modeling multimodal human-computer interaction

Obrenović, Željko; Starčević, Dušan

doi:10.1109/mc.2004.139

Cited by 95 publications

(52 citation statements)

References 11 publications

(5 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…As pointed out by Obrenovic and Starcevic [13], multimodal interfaces move the balance of interactions closer to the human and offer expressive, transparent, efficient, and robust human-computer interactions. In human-computer interactions, the term modality typically refers to the five human senses-sight, hearing, touch, smell, and taste.…”

Section: IImentioning

confidence: 99%

Service Design for Developing Multimodal Human-Computer Interaction for Smart Tvs

Wang¹,

Huang²

2015

ijacsa

View full text Add to dashboard Cite

Section: IImentioning

confidence: 99%

Service Design for Developing Multimodal Human-Computer Interaction for Smart Tvs

Wang¹,

Huang²

2015

ijacsa

View full text Add to dashboard Cite

“…Smart TV HCIs and UIs are important to all users, content providers and Smart TV manufacturers because innovative HCIs and UIs are required to provide enhanced services and meet user requirements [4,8]. Numerous works have established the importance of different criteria in designing HCIs and UIs [9][10][11][12][13]. Some researchers have proposed various processes for designing Smart TV HCIs and UIs [3,5,13,14].…”

Section: Introductionmentioning

confidence: 99%

Integratring Service Design and Eye Teacking Insight for Designing Smart TV User Interfaces

Wang¹

2015

ijacsa

View full text Add to dashboard Cite

Abstract-This research proposes a process that integrate service design method and eye tracking insight for designing a Smart TV user interface. The Service Design method, which is utilized for leading the combination of the quality function deployment (QFD) and the analytic hierarchy process (AHP), is used to analyze the features of three Smart TV user interface design mockups. Scientific evidences, which include the effectiveness and efficiency testing data obtained from eye tracking experiments with six participants, are provided the information for analysing the affordance of these design mockups. The results of this research demonstrate a comprehensive methodology that can be used iteratively for redesigning, redefining and evaluating of Smart TV user interfaces. It can also help to make the design of Smart TV user interfaces relate to users' behaviors and needs. So that to improve the affordance of design. Future studies may analyse the data that are derived from eye tracking experiments to improve our understanding of the spatial relationship between designed elements in a Smart TV user interface.

show abstract

“…Human-computer interaction has been centre of interest of many researchers for a number of years [1][2][3]. In order to facilitate this interaction it is essential for the computer system, for example a robot, to understand the feelings of the user [4,5].…”

Section: Introductionmentioning

confidence: 99%

Expression Recognition by Using Facial and Vocal Expressions

Anbarjafari¹,

Aabloo²

2014

Proceedings of the Third Workshop on Vision and Language

View full text Add to dashboard Cite

Human behaviour may be monitored by analysing facial expressions and vocal expressions. Hence an automatic technique which combines both these features will give a more accurate overall estimation of expression. In this work we propose a new method which is uses facial and vocal features to estimate the expression of the subject. Facial expressions are analysed by extracting important facial features and then clustering the movement of these features. In parallel the voice is processed by using considering sudden changes in amplitude and frequency in order to recognize the expression. Finally a weighted sum rule is used to combine the decisions obtained by facial and vocal expression recognition. The proposed technique is tested on an ongoing set of real data monitored by a psychologist.

show abstract

Modeling multimodal human-computer interaction

Cited by 95 publications

References 11 publications

Service Design for Developing Multimodal Human-Computer Interaction for Smart Tvs

Service Design for Developing Multimodal Human-Computer Interaction for Smart Tvs

Integratring Service Design and Eye Teacking Insight for Designing Smart TV User Interfaces

Expression Recognition by Using Facial and Vocal Expressions

Contact Info

Product

Resources

About