We present the design of an entire on-device system for large-scale urban localization using images. The proposed design integrates compact image retrieval and 2D-3D correspondence search to estimate the location in extensive city regions. Our design is GPS agnostic and does not require network connection. In order to overcome the resource constraints of mobile devices, we propose a system design that leverages the scalability advantage of image retrieval and accuracy of 3D model-based localization. Furthermore, we propose a new hashing-based cascade search for fast computation of 2D-3D correspondences. In addition, we propose a new one-many RANSAC for accurate pose estimation. The new one-many RANSAC addresses the challenge of repetitive building structures (e.g. windows, balconies) in urban localization. Extensive experiments demonstrate that our 2D-3D correspondence search achieves state-of-the-art localization accuracy on multiple benchmark datasets. Furthermore, our experiments on a large Google Street View (GSV) image dataset show the potential of large-scale localization entirely on a typical mobile device.Index Terms-Image-based localization, on-device localization, image retrieval, 2D-3D correspondence search, hashing, RANSAC
We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold learning-based regularization to explicitly retain local structures of latent samples in the generated samples. This prevents generator from producing nearly identical data samples from different latent samples, and reduces mode collapse. We propose an inverse t-SNE regularizer to achieve this. Second, we propose a new technique, gradient matching, to align the distributions of the generated samples and the real samples. As it is challenging to work with high-dimensional sample distributions, we propose to align these distributions through the scalar discriminator scores. We constrain the difference between the discriminator scores of the real samples and generated ones. We further constrain the difference between the gradients of these discriminator scores. We derive these constraints from Taylor approximations of the discriminator function. We perform experiments to demonstrate that our proposed techniques are computationally simple and easy to be incorporated in existing systems. When Gradient matching and Neighbour embedding are applied together, our GN-GAN achieves outstanding results on 1D/2D synthetic, CIFAR-10 and STL-10 datasets, e.g. FID score of 30.80 for the STL-10 dataset. Our code is available at: https://github.com/tntrung/gan * These authors have contributed equally to this work
The emergence of mobile cloud computing (MCC) brings benefits to mobile users and cloud providers. However, due to the inherent limitations of the device such as battery life time, CPU and memory capacity, a mobile thin client device (e.g. smart phones, tablets, iWatch, Google Glass, etc) cannot meet the requirements of some demanding applications. To alleviate this limitation, the mobile device should cooperate with external resources to increase its performance. Recently, current research approaches have been unable to offer an efficient, seamless computing experience. In this paper, we present a comprehensive thin-thick client collaboration that involves conventional desktop or laptop computers, known as thick clients, by allowing the thin client to borrow resources from thick clients, particularly for optimizing data distribution and utilizing MCC resources to meet Service-Level Agreements, Quality-of-Service requirements and cloud service customers' budget. Our work uses both numerical analysis and simulation to prove that our proposed architecture can improve resource allocation efficiency and achieve better performance than other existing approaches in some cases.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.