Modeling user perception of 3D video based on ambient illumination context for enhanced user centric media access and consumption

Abstract

Abstract-For enjoying 3D video to its full extent, it is imperative that access and consumption of it is user centric, which in turn ensures improved 3D video perception. Several important factors including video characteristics, users' preferences, contexts prevailing in various usage environments, etc have influences on 3D video perception. Thus, to assist efficient provision of user centric media, user perception of 3D video should be modeled considering the factors affecting perception. Considering ambient illumination context to model 3D video perception is an interesting research topic, which has not been particularly investigated in literature. This context is taken into account while modeling video quality and depth perception of 3D video in this paper. For the video quality perception model: motion and structural feature characteristics of color texture sequences; and for the depth perception model: luminance contrast of color texture and depth intensity of depth map sequences of 3D video are used as primary content related factors in the paper.Results derived using the video quality and depth perception models demonstrate that these models can efficiently predict user perception of 3D video considering the ambient illumination context in user centric media access and consumption environments.Index Terms-3D video, 3D user perception model, ambient illumination context, depth perception, user centric 3D media access and consumption, video quality perception. INTRODUCTION3-Dimensional (3D) video distribution and access in heterogeneous usage environments have posed significant research and technology development challenges for delivering 3D video to a wide range of users. These challenges have been exacerbated not only by the existence of different networking infrastructures, diverse user terminals, and numerous media content representations, but also by the users themselves and their various preferences and high levModeling User Perception of 3D Video Based on Ambient Illumination Context for Enhanced User Centric Media Access and Consumption 2 2 els of expectations. In turn, this has led the research efforts to focus on user centricity while providing media services rather than conventional purely technology orientated service provisions.Although the development of 3D video related technologies such as capture, representation, coding, transmission, rendering, etc are evolving promptly, the influence of these technologies on 3D perceptual quality to enrich proliferation of user centric 3D video applications into the consumer market has not been thoroughly investigated to date. One of the reasons for this is the lack of available 3D video perception models to predict the user perception towards 3Dvideo. Even though, there are commonly used 2D objective quality assessment models available in literature, which correlate with Human Visual System (HVS), these models cannot provide accurate video quality and depth perception assessments for 3D video due to the multi-dimensional nature of it (e.g., video qualit...