Proliferation of web-based multimedia content sources and servers led to a tremendous growth in the volume and diversity of multimedia content that is consumed by a diverse set of users. This diversity results in users exhibiting a vast range of preferences over the content, which often depends on the context in which they consume the content. Such demand led to the emergence of multimedia content aggregators (MCAs) [1,2] that gather and fuse content from numerous multimedia sources to provide a ubiquitous content delivery experience for their users. It is thus essential for these systems to learn the context-specific content preferences of their users using past feedback of their users on the content that they provide. The context of a user includes information that is related to its content preferences, including but not limited to the location information, search query, gender, age, and the type of the device that the user is using (e.g., mobile phone, tablet, PC) to access the content [3]. Thus, the goal of the MCA is to match its users with the most appropriate content by learning how users with different contexts react to different contents. Such learning is necessary for continuous satisfaction of a user's request for content, which dynamically evolves over time depending on how the user's context evolves. This problem can be formulated as an online learning problem where the MCA learns the best content for its users through exploring how its users react to different content. In order to maximize the user satisfaction, an MCA needs to connect with other MCAs that have access to other multimedia sources to find the right content for its users. This requires cooperation between the MCAs: In addition to serving its own users, an MCA should also serve content to the users of other MCAs when a request is made. Thus, each MCA has two types of users: direct users, who visit the website of the MCA to search for content, and indirect users, who are users of another MCA Cooperative and Graph Signal Processing.