Model based 3D gaze estimation for provision of virtual eye contact

Waizenegger, Wolfgang; Atzpadin, N.; Schreer, Oliver; Feldmann, Ingo; Eisert, Peter

doi:10.1109/icip.2012.6467274

Cited by 8 publications

(4 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the result is to give the impression of the remote person looking at one's body when they are looking at one's eyes. A virtual camera solution for seated participants is presented in [43]. Participants are reconstructed in 3D so that a virtual camera can look at them from the perspective of the image of the remote participant, who then looks through it.…”

Section: Telepresencementioning

confidence: 99%

See 1 more Smart Citation

withyou—An Experimental End-to-End Telepresence System Using Video-Based Reconstruction

Roberts

Fairchild

Campion

et al. 2015

IEEE J. Sel. Top. Signal Process.

View full text Add to dashboard Cite

Supporting a wide set of linked non-verbal resources remains an evergreen challenge for communication technology, limiting effectiveness in many applications. Interpersonal distance, gaze, posture and facial expression, are interpreted together to manage and add meaning to most conversations. Yet today's technologies favor some above others. This induces confusion in conversations, and is believed to limit both feelings of togetherness and trust, and growth of empathy and rapport. Solving this problem will allow technologies to support most rather than a few interactional scenarios. It is likely to benefit teamwork and team cohesion, distributed decision-making and health and wellbeing applications such as tele-therapy, tele-consultation, and isolation. We introduce withyou, our telepresence research platform. This paper describes the end-to-end system including the psychology of human interaction and how this drives requirements throughout the design and implementation. Our technology approach is to combine the winning characteristics of video conferencing and immersive collaborative virtual environments. This is to allow, for example, people walking past each other to exchange a glance and smile. A systematic explanation of the theory brings together the linked nature of non-verbal communication and how it is influenced by technology. This leads to functional requirements for telepresence, in terms of the balance of visual, spatial and temporal qualities. The first end-to-end description of withyou describes all major processes and the display and capture environment. An unprecedented characterization of our approach is given in terms of the above qualities and what influences them. This leads to non-functional requirements in terms of number and place of cameras and the avoidance of resultant bottlenecks. Proposals are given for improved distribution of processes across networks, computers, and multi-core CPU and GPU. Simple conservative estimation shows that both approaches should meet our requirements. One is implemented and shown to meet minimum and come close to desirable requirements.

show abstract

Section: Telepresencementioning

confidence: 99%

“…Perhaps the most rigorous such approach in terms of supporting eye gaze is presented in [43]. Unlike shape from silhouette and low-resolution depth based approaches, such as Kinect, this accurately captures the shape of the eye socket.…”

Section: Telepresencementioning

confidence: 99%

withyou—An Experimental End-to-End Telepresence System Using Video-Based Reconstruction

Roberts

Fairchild

Campion

et al. 2015

IEEE J. Sel. Top. Signal Process.

View full text Add to dashboard Cite

show abstract

“…Furan is found in heat-treated commercial foods and it is produced through thermal degradation of natural food constituents [5,6]. Notably, it can be found in roasted coffee, instant coffee, and processed baby foods [7,8].…”

Section: Introductionmentioning

confidence: 99%

Vibrational Spectral Analysis And First Order Hyperpolarizability Calculations On (E)-N′-(furan-2-ylmethylene)nicotinohydrazide

Bharanidharan

Saleem

Subashchandrabose

et al. 2016

JNDC

View full text Add to dashboard Cite

Vibrational spectral analysis and first order hyperpolarizability calculations on (E)-N′-(furan-2-ylmethylene) nicotinohydrazide (F2CNH), a novel, organic, hydrozone Schiff base compound was synthesized and its structure was characterized by FT-IR, FT-Raman and UV-visible spectrum. The optimized molecular structure, vibrational frequencies and corresponding vibrational assignments of F2CNH were performed on the basis of TED analysis using SQM method. Natural boding orbital (NBO) assessment has been carried out to clarify the charge transfer or conjugative interaction and delocalization of electron density within the molecule. Electronic transitions were studied employing UV-visible spectrum and the observed values were compared with theoretical values. The first order hyperpolarizability and related properties of F2NH were calculated. Besides FMO's MEP, mulliken atomic charge and various thermodynamic paramefress such as Zero-point energy, rotational constant and enthalpy were also calculated and analyzed.

show abstract

“…Automatic gaze tracking provides several application in the fields of human-computer interaction (HCI) and human behavior analysis, therefore several techniques and methods have been investigated in recent years. When a person is in the field of view of a static camera, gaze can give information about the focus of attention of the subject, allowing for gaze-controlled interfaces for disabled people [ 2 ], driver attention monitoring [ 3 ], pilot training [ 4 ], provision of virtual eye contact in conferences [ 5 ] or marketing strategies analysis [ 6 ].…”

Section: Introductionmentioning

confidence: 99%

An Investigation on the Feasibility of Uncalibrated and Unconstrained Gaze Tracking for Human Assistive Applications by Using Head Pose Estimation

Cazzato

Leo

Distante

2014

Sensors

View full text Add to dashboard Cite

This paper investigates the possibility of accurately detecting and tracking human gaze by using an unconstrained and noninvasive approach based on the head pose information extracted by an RGB-D device. The main advantages of the proposed solution are that it can operate in a totally unconstrained environment, it does not require any initial calibration and it can work in real-time. These features make it suitable for being used to assist human in everyday life (e.g., remote device control) or in specific actions (e.g., rehabilitation), and in general in all those applications where it is not possible to ask for user cooperation (e.g., when users with neurological impairments are involved). To evaluate gaze estimation accuracy, the proposed approach has been largely tested and results are then compared with the leading methods in the state of the art, which, in general, make use of strong constraints on the people movements, invasive/additional hardware and supervised pattern recognition modules. Experimental tests demonstrated that, in most cases, the errors in gaze estimation are comparable to the state of the art methods, although it works without additional constraints, calibration and supervised learning.

show abstract

Model based 3D gaze estimation for provision of virtual eye contact

Cited by 8 publications

References 9 publications

withyou—An Experimental End-to-End Telepresence System Using Video-Based Reconstruction

withyou—An Experimental End-to-End Telepresence System Using Video-Based Reconstruction

Vibrational Spectral Analysis And First Order Hyperpolarizability Calculations On (E)-N′-(furan-2-ylmethylene)nicotinohydrazide

An Investigation on the Feasibility of Uncalibrated and Unconstrained Gaze Tracking for Human Assistive Applications by Using Head Pose Estimation

Contact Info

Product

Resources

About