Practical issues in subjective video quality evaluation

Sullivan, Marc A.; Pratt, James H.; Kortum, Philip

doi:10.1145/1453805.1453807

Cited by 9 publications

(6 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is some literature that suggests a person’s attitude toward a visual stimulus may affect: (a) their perception of its image quality, and (b) their perception of the stimulus itself (Kortum & Sullivan, 2010; Pozueco et al, 2017; Sullivan, Pratt, & Kortum, 2008). For this reason, we asked participants to subjectively rate their experience of each video clip by asking them three questions.…”

Section: Resultsmentioning

confidence: 99%

Narrative video scene description task discriminates between levels of cognitive impairment in Alzheimer’s disease.

et al. 2020

View full text Add to dashboard Cite

The process of interpreting and acting upon the visual environment requires both intact cognitive and visual systems. The narrative description (ND) task, initially developed to detect changes in ecologically relevant visual function in people with impaired vision, is an objective measure of the ability to perceive, understand, and describe a visual scene in a movie clip. Objective: Because the ND task draws heavily on semantic and working memory ability in addition to basic visual perception, we aimed to assess the discriminative performance of this task across levels of cognitive impairment. Method: We recruited 56 participants with cognitive status ranging from normal cognition to mild dementia (median age 82, range 66 to 99 years) to watch 20 30-s video clips and describe the visual content without time constraints. These verbal responses were transcribed and processed to generate ND shared word scores using a "wisdom of the crowd," natural-language processing approach. We compared ND scores across diagnostic groups, and used linear mixed models to examine decrements in task performance. Results: There was a stepwise decline of ND scores with increasing levels of cognitive impairment. Additional analyses showed that ND performance was highly related to performance on the Montreal Cognitive Assessment (MoCA) and domain-specific neuropsychological tests for semantic fluency and set shifting. Other models demonstrated differences in ND performance related video content between cognitively normal and impaired participants. Conclusion: The ND test was able to detect decrements in task performance between levels of cognitive impairment and was related to other global neuropsychological measures.

show abstract

Section: Resultsmentioning

confidence: 99%

Narrative video scene description task discriminates between levels of cognitive impairment in Alzheimer’s disease.

et al. 2020

View full text Add to dashboard Cite

show abstract

“…When facing the audience outside the laboratory, the slight difference in video quality parameters of different quality films may lose significance due to the influence of environment or hardware. Only the perception of very obvious difference in SVQA is valuable ( Sullivan et al., 2008 ). Considering the importance of SVQA as a part of QoE, this study used the method of controlling OVQA parameters of video samples to investigate and evaluate SVQA of audience.…”

Section: Literature Reviewmentioning

confidence: 99%

What do users care about? Research on user behavior of mobile interactive video advertising

Gu¹,

Lin²,

Sun³

et al. 2022

Heliyon

View full text Add to dashboard Cite

“…The proposed solution [21,28] is to more accurately measure the system quality and acceptability by immersing the subject in a more natural viewing experience. This "immersive method" uses distractor questions and longer audiovisual sequences to focus the subject on the intended application.…”

Section: Practicalmentioning

confidence: 99%

Evaluating experiment design with unrepeated scenes for video quality subjective assessment

2019

View full text Add to dashboard Cite

The conventional video subjective test design, in which subjects view and rate multiple versions of each source video sequence, was used for decades. New technology, like adaptive streaming, makes it almost impossible to use this design since much longer sequences are needed. In this paper we examine three experiment designs: the conventional design and two alternatives that use each source sequence only once. Based on data collected by three laboratories, we compare the accuracy and scoring behavior of these three designs. We check whether there is a significant difference in scoring behavior between the experiment designs. One of the proposed experiment designs is proposed for immediate use.

show abstract

Practical issues in subjective video quality evaluation

Cited by 9 publications

References 2 publications

Narrative video scene description task discriminates between levels of cognitive impairment in Alzheimer’s disease.

Narrative video scene description task discriminates between levels of cognitive impairment in Alzheimer’s disease.

What do users care about? Research on user behavior of mobile interactive video advertising

Evaluating experiment design with unrepeated scenes for video quality subjective assessment

Contact Info

Product

Resources

About