Real-time haptic interaction with RGBD video streams

Rasool, Shahzad; Sourin, Alexei

doi:10.1007/s00371-016-1224-1

Cited by 13 publications

(5 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Participants expect to be able to combine different communication modalities and switch between them seamlessly (Ibnelkaïd, 2015;Relieu, 2006;Sindoni, 2012). Drawing and handwriting is currently limited, especially with personal computers and mobile devices, and there are major restrictions in conveying haptic/tactile and olfactory perceptions during video-mediated interaction, although notable progress has been made in this area (Dangelmaier and Blach, 2017;Rasool and Sourin, 2016).…”

Section: Implications For Designmentioning

confidence: 99%

Situated Organization of Video-Mediated Interaction: A Review of Ethnomethodological and Conversation Analytic Studies

Mlynář

González-Martínez

Lalanne

2018

Interacting With Computers

View full text Add to dashboard Cite

Video-based communication has become a common way of interacting with remote interlocutors, whether through complex videoconferencing systems or webcams integrated into consumer technologies. Ethnomethodology and conversation analysis (EM/CA) are sociological approaches that have been influential in Human-Computer Interaction for nearly three decades due to their focus on the situated organization of practical activities. In this article, we present a state-of-the-art review of empirical research on video-mediated social interaction studied from the perspective of EM/CA. We put forward an original organization of the findings on the interplay of talk, bodily behavior and spatial and material resources. The review underscores the ways in which technology enables and constrains interaction, shaping familiar and novel social activities. We also propose directions for future research and systems design. RESEARCH HIGHLIGHTS• Video-mediated interaction has become ubiquitous due to dedicated technologies and devices.• Ethnomethodology and conversation analysis have produced a number of studies on participants' practices when involved in remote synchronous video communication. • The reviewed studies provide detailed descriptions of users' multimodal behavior when interacting with/through the technology. • This research is moving forward, simultaneously helping to anticipate future needs and find design solutions, while concentrating on the study of evolving technologies-in-practice.

show abstract

Section: Implications For Designmentioning

confidence: 99%

Situated Organization of Video-Mediated Interaction: A Review of Ethnomethodological and Conversation Analytic Studies

Mlynář

González-Martínez

Lalanne

2018

Interacting With Computers

View full text Add to dashboard Cite

show abstract

“…Such media has been termed multiple-sensorial media, or mulsemedia, and within a VR framework, could lead to next-generation immersive systems with increased sense of realism and immersion [9,167]. For example, inclusion of smells [168,169] and haptics [170] have shown to improve sense of immersion. Haptics can be used to provide the user with cues about physical characteristics of an object (e.g., weight or texture) hence increase sense of realism [171,172].…”

Section: Multiple-sensorial Media Applicationsmentioning

confidence: 99%

Immersive media experience: a survey of existing methods and tools for human influential factors assessment

2022

View full text Add to dashboard Cite

Virtual reality (VR) applications, especially those where the user is untethered to a computer, are becoming more prevalent as new hardware is developed, computational power and artificial intelligence algorithms are available, and wireless communication networks are becoming more reliable, fast, and providing higher reliability. In fact, recent projections show that by 2022 the number of VR users will double, suggesting the sector was not negatively affected by the worldwide COVID-19 pandemic. The success of any immersive communication system is heavily dependent on the user experience it delivers, thus now more than ever has it become crucial to develop reliable models of immersive media experience (IMEx). In this paper, we survey the literature for existing methods and tools to assess human influential factors (HIFs) related to IMEx. In particular, subjective, behavioural, and psycho-physiological methods are covered. We describe tools available to monitor these HIFs, including the user's sense of presence and immersion, cybersickness, and mental/affective states, as well as their role in overall experience. Special focus is placed on psycho-physiological methods, as it was found that such in-depth evaluation was lacking from the existing literature. We conclude by touching on emerging applications involving multiple-sensorial immersive media and provide suggestions for future research directions to fill existing gaps. It is hoped that this survey will be useful for researchers interested in building new immersive (adaptive) applications that maximize user experience.

show abstract

“…Similar to the research path of multimedia's effect on the learner [12], studies on the effect of mulsemedia are usually confined to practical demonstrations of use at present. However, the use and application of sensorial feedback in user immersion is growing, with contributions to date focused on olfactory [13] and haptic aspects [14].…”

Section: Related Workmentioning

confidence: 99%

Improving Student Learning Satisfaction by Using an Innovative DASH-Based Multiple Sensorial Media Delivery Solution

Lyons

Fox

et al. 2021

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Recently, innovative technologies such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR) and Multi-Sensorial Media (mulsemedia) have introduced new sensorial effects including vibration, smell, airflow, etc. to human life. These effects which have been largely deployed for entertainment and gaming have positively impacted user satisfaction. This paper explores the potential of mulsemedia in the education context. It describes a novel Dynamic Adaptive Streaming over HTTP (DASH)-based Multi-sensory Media Delivery Solution (DASHMS) which supports adaptive mulsemedia content distribution based on the operational environment which includes network, device and user settings.DASHMS was evaluated in a real-life educational experiment involving 44 students in an Irish university. The evaluation focused on both learner satisfaction and the impact on learning. The results demonstrate the potential of adaptive multi-sensorial media delivery to result in a statistically significant increase in user experience. In terms of benefit to learning outcomes however, it was only memory recall which was statistically improved in the experiment.

show abstract

Real-time haptic interaction with RGBD video streams

Cited by 13 publications

References 26 publications

Situated Organization of Video-Mediated Interaction: A Review of Ethnomethodological and Conversation Analytic Studies

Situated Organization of Video-Mediated Interaction: A Review of Ethnomethodological and Conversation Analytic Studies

Immersive media experience: a survey of existing methods and tools for human influential factors assessment

Improving Student Learning Satisfaction by Using an Innovative DASH-Based Multiple Sensorial Media Delivery Solution

Contact Info

Product

Resources

About