apt-p2p: A Peer-to-Peer Distribution System for Software Package Releases and Updates

Abstract

Abstract-The Internet has become a cost-effective vehicle for software development and release, particular in the free software community. Given the free nature of this software, there are often a number of users motivated by altruism to help out with the distribution, so as to promote the healthy development of this voluntary society. It is thus naturally expected that a peer-topeer distribution can be implemented, which will scale well with large user bases, and can easily explore the network resources made available by the volunteers.Unfortunately, this application scenario has many unique characteristics, which make a straightforward adoption of existing peer-to-peer systems for file sharing (such as BitTorrent) suboptimal. In particular, a software release often consists of a large number of packages, which are difficult to distribute individually, but the archive is too large to be distributed in its entirety. The packages are also being constantly updated by the loosely-managed developers, and the interest in a particular version of a package can be very limited depending on the computer platforms and operating systems used.In this paper, we propose a novel peer-to-peer assisted distribution system design that addresses the above challenges. It enhances the existing distribution systems by providing compatible and yet more efficient downloading and updating services for software packages. Our design leads to apt-p2p, a practical implementation that extends the popular apt distributor. apt-p2p has been used in conjunction with Debian-based distribution of Linux software packages and is also available in the latest release of Ubuntu. We have addressed the key design issues in apt-p2p, including indexing table customization, response time reduction, and multi-value extension. They together ensure that the altruistic users' resources are effectively utilized and thus significantly reduces the currently large bandwidth requirements of hosting the software, as confirmed by our existing real user statistics gathered over the Internet.

Peer-to-peer secure updates for heterogeneous edge devices

“…For instance, the Windows 10 'Delivery Optimization' system [14] provides a peer-based distributed cache, as of late 2016, to mitigate bandwidth issues for large updates [15]. The Debian package management tool has an integrated peer-to-peer download facility called apt-p2p [7], [16]. It fetches update files using BitTorrent, via a transparent http proxy.…”

“…Dale and Liu [16] identify problems with peer-to-peer updating, such as long wait times and different users requiring different subsets of available applications. Zhang et al [17] present optimizations to the underlying Kademlia distributed hash table (DHT) algorithm to improve the file-piece search .…”

New Approach to Develop the Messenger Application : From Client Server Design to P2P Implementation

“…For applying P2P in client-server application, in [4] a software system allowing using P2P file subsystem for distribution of software sources. In this solution, client remains the same, but a local agent that can share software sources with similar agents on other hosts replaces the server.…”

Modeling the Performance of Ring Based DHTs in the Presence of Network Address Translators

“…According to [5], another result related to BitTorrent is that NAT devices are responsible for the poor performance of DHTs as "DNS" for torrents. Such conclusion is shared by apt-p2p [2] where peers behind NATs are not allowed to join the DHT. Apt-p2p is a real application for software distribution used by a small community within Debian/Ubuntu users.…”