We provide a comprehensive overview of mathematical models and analytical techniques for millimeter wave (mmWave) cellular systems. The two fundamental physical differences from conventional Sub-6GHz cellular systems are (i) vulnerability to blocking, and (ii) the need for significant directionality at the transmitter and/or receiver, which is achieved through the use of large antenna arrays of small individual elements. We overview and compare models for both of these factors, and present a baseline analytical approach based on stochastic geometry that allows the computation of the statistical distributions of the downlink signal-to-interference-plus-noise ratio (SINR) and also the per link data rate, which depends on the SINR as well as the average load. There are many implications of the models and analysis: (a) mmWave systems are significantly more noise-limited than at Sub6GHz for most parameter configurations; (b) initial access is much more difficult in mmWave; (c) self-backhauling is more viable than in Sub-6GHz systems which makes ultra-dense deployments more viable, but this leads to increasingly interference-limited behavior; and (d) in sharp contrast to Sub-6GHz systems cellular operators can mutually benefit by sharing their spectrum licenses despite the uncontrolled interference that results from doing so. We conclude by outlining several important extensions of the baseline model, many of which are promising avenues for future research.

No abstract

Reinforcement learning provides an appealing formalism for learning control policies from experience. However, the classic active formulation of reinforcement learning necessitates a lengthy active exploration process for each behavior, making it difficult to apply in real-world settings. If we can instead allow reinforcement learning to effectively use previously collected data to aid the online learning process, where the data could be expert demonstrations or more generally any prior experience, we could make reinforcement learning a substantially more practical tool. While a number of recent methods have sought to learn offline from previously collected data, it remains exceptionally difficult to train a policy with offline data and improve it further with online reinforcement learning. In this paper we systematically analyze why this problem is so challenging, and propose a novel algorithm that combines sample-efficient dynamic programming with maximum likelihood policy updates, providing a simple and effective framework that is able to leverage large amounts of offline data and then quickly perform online fine-tuning of reinforcement learning policies. We show that our method enables rapid learning of skills with a combination of prior demonstration data and online experience across a suite of difficult dexterous manipulation and benchmark tasks.Preprint. Under review.

The highly directional and adaptive antennas used in mmWave communication open up the possibility of uncoordinated sharing of spectrum licenses between commercial cellular operators. There are several advantages to sharing including a reduction in license costs and an increase in spectrum utilization. In this paper, we establish the theoretical feasibility of spectrum license sharing among mmWave cellular operators. We consider a heterogeneous multi-operator system containing multiple independent cellular networks, each owned by an operator. We then compute the SINR and rate distribution for downlink mobile users of each network. Using the analysis, we compare systems with fully shared licenses and exclusive licenses for different access rules and explore the trade-offs between system performance and spectrum cost. We show that sharing spectrum licenses increases the per-user rate when antennas have narrow beams and is also favored when there is a low density of users. We also consider a multi-operator system where BSs of all the networks are co-located to show that the simultaneous sharing of spectrum and infrastructure is also feasible. We show that all networks can share licenses with less bandwidth and still achieve the same per-user median rate as if they each had an exclusive license to spectrum with more bandwidth.

The single most important factor enabling the data rate increases in wireless networks over the past few decades has been densification, namely adding more base stations and access points and thus getting more spatial reuse of the spectrum. This trend is set to continue into 5G and beyond. However, at some point further densification will no longer be able to provide exponentially increasing data rates. Like the end of Moore's Law, this will have extensive implications on the entire technology landscape, which depends ever more heavily on wireless connectivity. When and why will this happen? How might we prolong this from occurring for as long as possible? These are the questions explored in this paper.

We model and analyze heterogeneous cellular networks with multiple antenna BSs (multi-antenna HetNets) with K classes or tiers of base stations (BSs), which may differ in terms of transmit power, deployment density, number of transmit antennas, number of users served, transmission scheme, and path loss exponent. We show that the cell selection rules in multi-antenna HetNets may differ significantly from the singleantenna HetNets due to the possible differences in multi-antenna transmission schemes across tiers. While it is challenging to derive exact cell selection rules even for maximizing signal-tointerference-plus-noise-ratio (SINR) at the receiver, we show that adding an appropriately chosen tier-dependent cell selection bias in the received power yields a close approximation. Assuming arbitrary selection bias for each tier, simple expressions for downlink coverage and rate are derived. For coverage maximization, the required selection bias for each tier is given in closed form. Due to this connection with biasing, multi-antenna HetNets may balance load more naturally across tiers in certain regimes compared to single-antenna HetNets, where a large cell selection bias is often needed to offload traffic to small cells.Index Terms-Multi-antenna heterogeneous cellular network, stochastic geometry, coverage probability, cell selection bias. 0090-6778

Blocking objects (blockages) between a transmitter and receiver cause wireless communication links to transition from line-of-sight (LOS) to non-line-of-sight (NLOS) propagation, which can greatly reduce the received power, particularly at higher frequencies such as millimeter wave (mmWave). We consider a cellular network in which a mobile user attempts to connect to two or more base stations (BSs) simultaneously, to increase the probability of at least one LOS link, which is a form of macrodiversity.We develop a framework for determining the LOS probability as a function of the number of BSs, when taking into account the correlation between blockages: for example, a single blockage close to the device -including the user's own body -could block multiple BSs. We consider the impact of the size of blocking objects on the system reliability probability and show that macrodiversity gains are higher when the blocking objects are small. We also show that the BS density must scale as the square of the blockage density to maintain a given level of reliability.

Abstract-We consider a dense urban cellular network where the base stations (BSs) are stacked vertically as well as extending infinitely in the horizontal plane, resulting in a greater than two dimensional (2D) deployment. Using a dual-slope path loss model that is well supported empirically, we extend recent 2D coverage probability and potential throughput results to 3 dimensions. We prove that the "critical close-in path loss exponent" α0 where SINR eventually decays to zero is equal to the dimensionality d, i.e. α0 ≤ 3 results in an eventual SINR of 0 in a 3D network. We also show that the potential (i.e. best case) aggregate throughput decays to zero for α0 < d/2. Both of these scaling results also hold for the more realistic case that we term 3D + , where there are no BSs below the user, as in a dense urban network with the user on or near the ground.