Exploring Partially Observed Networks with Nonparametric Bandits

Abstract

Real-world networks such as social and communication networks are too large to be observed entirely. Such networks are often partially observed such that network size, network topology, and nodes of the original network are unknown. In this paper we formalize the Adaptive Graph Exploring problem. We assume that we are given an incomplete snapshot of a large network and additional nodes can be discovered by querying nodes in the currently observed network. The goal of this problem is to maximize the number of observed nodes within a given query budget. Querying which set of nodes maximizes the size of the observed network? We formulate this problem as an explorationexploitation problem and propose a novel nonparametric multi-arm bandit (MAB) algorithm for identifying which nodes to be queried. Our contributions include: (1) iKNN-UCB, a novel nonparametric MAB algorithm, applies k-nearest neighbor UCB to the setting when the arms are presented in a vector space. (2) provide theoretical guarantee that iKNN-UCB algorithm has sublinear regret and (3) applying iKNN-UCB algorithm on synthetic networks and real-world networks from different domains, we show that our method discovers up to 40% more nodes compared to existing baselines.

A multi-armed bandit approach for exploring partially observed networks

“…In this manuscript, we extend the approach proposed in Madhawa and Murata (2018). Our contributions are listed below.…”