To ensure reliable communication in randomly varying and error-prone channels, wireless systems use adaptive modulation and coding (AMC) as well as hybrid ARQ (HARQ). In order to elucidate their compatibility and interaction, we compare the throughput provided by AMC, HARQ, and their combination (AMC-HARQ) under two operational conditions: in slow-and fast block-fading channels. Considering both, incremental redundancy HARQ (HARQ-IR) and repetition redundancy HARQ (HARQ-RR)we optimize the rate-decision regions for AMC/HARQ and compare them in terms of attainable throughput. Under a fairly general model of the channel variation and the decoding functions, we conclude that i) adding HARQ on top of AMC may be counterproductive in the high average signal-to-noise ratio regime for fast fading channels, and ii) HARQ is useful for slow fading channels, but it provides moderate throughput gains. We provide explanations for these results which allow us to propose paths to improve AMC-HARQ systems.
Abstract. Online advertising is increasingly switching to real-time bidding on advertisement inventory, in which the ad slots are sold through real-time auctions upon users visiting websites or using mobile apps. To compete with unknown bidders in such a highly stochastic environment, each bidder is required to estimate the value of each impression and to set a competitive bid price. Previous bidding algorithms have done so without considering the constraint of budget limits, which we address in this paper. We model the bidding process as a Constrained Markov Decision Process based reinforcement learning framework. Our model uses the predicted click-through-rate as the state, bid price as the action, and ad clicks as the reward. We propose a bidding function, which outperforms the state-of-the-art bidding functions in terms of the number of clicks when the budget limit is low. We further simulate different bidding functions competing in the same environment and report the performances of the bidding strategies when required to adapt to a dynamic environment.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.