Handling big data of online social networks on a small machine

Abstract

Dealing with big data in computational social networks may require powerful machines, big storage, and high bandwidth, which may seem beyond the capacity of small labs. We demonstrate that researchers with limited resources may still be able to conduct big-data research by focusing on a specific type of data. In particular, we present a system called MPT (Microblog Processing Toolkit) for handling big volume of microblog posts with commodity computers, which can handle tens of millions of micro posts a day. MPT supports fast search on multiple keywords and returns statistical results. We describe in this paper the architecture of MPT for data collection and phrase search for returning search results with statistical analysis. We then present different indexing mechanisms and compare them on the microblog posts we collected from popular online social network sites in mainland China.

Analysis of the Structural Characteristics of the Online Social Network of Chinese Professional Athletes

“…e training, learning, and living environment of athletes is relatively independent and closed for a long time, and the breadth, depth, and integration of real social interaction are subject to certain limitations [1][2][3][4][5]. With the rapid development of the Internet, online social network platforms such as WeChat, Weibo, QQ, and social networking sites have been integrated into people's daily lives, and the huge Internet user base has formed an intricate virtual society-Online Social Network (OSN) [6][7][8][9][10][11][12][13][14], which provides athletes with a more modern and diverse way to socialize [15][16][17].…”

Athlete Social Support Network Modeling Based on Modern Valence Bond Theory

“…Big data and social network have become a powerful tool to study social phenomena, and the research on social network is still very popular [1][2][3][4][5][6]. e research of network dynamics is that, under the impetus of "external stimulus" or the trigger of "internal message," the state of node itself or the information contained in the network changes (the propagation of message), or the change of connection relationship between nodes [7][8][9][10].…”