On the MDP-Based Cost Minimization for Video-on-Demand Services in a Heterogeneous Wireless Network with Multihomed Terminals

Lee, Jong‐Wook; Bahk, Saewoong

doi:10.1109/tmc.2012.139

Cited by 26 publications

(9 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similarly Lee et al [209] formulate a cost minimization problem for a multihomed mobile terminal that downloads and plays video-on-demand (VoD). The authors look into user's dissatisfaction due to playback disruptions and communication cost for downloading the VoD stream.…”

Section: B Other Multipath Solutionsmentioning

confidence: 99%

Seamless Multimedia Delivery Within a Heterogeneous Wireless Networks Environment: Are We There Yet?

Trestian

Comşa

Tüysüz

2018

IEEE Commun. Surv. Tutorials

View full text Add to dashboard Cite

Copyright and moral rights to this work are retained by the author and/or other copyright owners unless otherwise stated. The work is supplied on the understanding that any use for commercial gain is strictly forbidden. A copy may be downloaded for personal, non-commercial, research or study without prior permission and without charge.Works, including theses and research projects, may not be reproduced in any format or medium, or extensive quotations taken from them, or their content changed in any way, without first obtaining permission in writing from the copyright holder(s). They may not be sold or exploited commercially in any format or medium without the prior written permission of the copyright holder(s).Full bibliographic details must be given when referring to, or quoting from full items including the author's name, the title of the work, publication details where relevant (place, publisher, date), pagination, and for theses or dissertations the awarding institution, the degree type awarded, and the date of the award.If you believe that any material held in the repository infringes copyright law, please contact the Repository Team at Middlesex University via the following email address:eprints@mdx.ac.ukThe item will be removed from the repository while any claim is being investigated. This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Abstract-The increasing popularity of live video streaming from mobile devices such as Facebook Live, Instagram Stories, Snapchat, etc. pressurises the network operators to increase the capacity of their networks. However, a simple increase in system capacity will not be enough without considering the provisioning of Quality of Experience (QoE) as the basis for network control, customer loyalty and retention rate and thus increase in network operators revenue. As QoE is gaining strong momentum especially with increasing users' quality expectations, the focus is now on proposing innovative solutions to enable QoE when delivering video content over heterogeneous wireless networks. In this context, this paper presents an overview of multimedia delivery solutions, identifies the problems and provides a comprehensive classification of related state-of-theart approaches following three key directions: adaptation, energy efficiency and multipath content delivery. Discussions, challenges and open issues on the seamless multimedia provisioning faced by the current and next generation of wireless networks are also provided.

show abstract

Section: B Other Multipath Solutionsmentioning

confidence: 99%

Seamless Multimedia Delivery Within a Heterogeneous Wireless Networks Environment: Are We There Yet?

Trestian

Comşa

Tüysüz

2018

IEEE Commun. Surv. Tutorials

View full text Add to dashboard Cite

show abstract

“…The optimal policy that satisfies the Bellman's equation can be found via a well-known value iteration algorithm [23]. At the ith iteration, we have…”

Section: Optimal Transmission Policymentioning

confidence: 99%

On Hybrid Energy Utilization in Wireless Sensor Networks

Tala't

et al. 2017

Energies

View full text Add to dashboard Cite

Abstract:In a wireless sensor network (WSN), many applications have limited energy resources for data transmission. In order to accomplish a better green communication for WSN, a hybrid energy scheme can supply a more reliable energy source. In this article, hybrid energy utilization-which consists of constant energy source and solar harvested energy-is considered for WSN. To minimize constant energy usage from the hybrid source, a Markov decision process (MDP) is designed to find the optimal transmission policy. With a finite packet buffer and a finite battery size, an MDP model is presented to define the states, actions, state transition probabilities, and the cost function including the cost values for all actions. A weighted sum of constant energy source consumption and a packet dropping probability (PDP) are adopted as the cost value, enabling us to find the optimal solution for balancing the minimization of the constant energy source utilization and the PDP using a value iteration algorithm. As shown in the simulation results, the performance of optimal solution using MDP achieves a significant improvement compared to solution without its use.

show abstract

“…In practice, this future information cannot be known a priori and needs to be learned by the system. Other works use MDP models in similar ways [10,11], but still assuming some a priori knowledge about system statistics.…”

Section: Related Workmentioning

confidence: 99%

Online learning adaptation strategy for DASH clients

Chiariotti

D’Aronco

Toni

et al. 2016

Proceedings of the 7th International Conference on Multimedia Systems

View full text Add to dashboard Cite

In this work, we propose an online adaptation logic for Dynamic Adaptive Streaming over HTTP (DASH) clients, where each client selects the representation that maximize the long term expected reward. The latter is defined as a combination of the decoded quality, the quality fluctuations and the rebuffering events experienced by the user during the playback. To solve this problem, we cast a Markov Decision Process (MDP) optimization for the selection of the optimal representations. System dynamics required in the MDP model are a priori unknown and are therefore learned through a Reinforcement Learning (RL) technique. The developed learning process exploits a parallel learning technique that improves the learning rate and limits sub-optimal choices, leading to a fast and yet accurate learning process that quickly converges to high and stable rewards. Therefore, the efficiency of our controller is not sacrificed for fast convergence. Simulation results show that our algorithm achieves a higher QoE than existing RL algorithms in the literature as well as heuristic solutions, as it is able to increase average QoE and reduce quality fluctuations.

show abstract

On the MDP-Based Cost Minimization for Video-on-Demand Services in a Heterogeneous Wireless Network with Multihomed Terminals

Cited by 26 publications

References 27 publications

Seamless Multimedia Delivery Within a Heterogeneous Wireless Networks Environment: Are We There Yet?

Seamless Multimedia Delivery Within a Heterogeneous Wireless Networks Environment: Are We There Yet?

On Hybrid Energy Utilization in Wireless Sensor Networks

Online learning adaptation strategy for DASH clients

Contact Info

Product

Resources

About