2016 IEEE International Conferences on Big Data and Cloud Computing (BDCloud), Social Computing and Networking (SocialCom), Sus 2016
DOI: 10.1109/bdcloud-socialcom-sustaincom.2016.63
|View full text |Cite
|
Sign up to set email alerts
|

Evaluating Link Prediction Accuracy in Dynamic Networks with Added and Removed Edges

Abstract: In this paper, we investigate several metrics currently used for evaluating accuracies of dynamic link prediction methods and demonstrate why they can be misleading in many cases. We provide several recommendations on evaluating dynamic link prediction accuracy, including separation into two categories of evaluation. Finally we propose a unified metric to characterize link prediction accuracy effectively using a single number.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

1
20
0

Year Published

2017
2017
2024
2024

Publication Types

Select...
7
1

Relationship

0
8

Authors

Journals

citations
Cited by 30 publications
(21 citation statements)
references
References 15 publications
(80 reference statements)
1
20
0
Order By: Relevance
“…In [4], authors discuss on the problem of current link prediction approaches. We have pointed out that evaluating link predictions based on deleted edges is not suitable considering the dynamics of social networks.…”
Section: Discussionmentioning
confidence: 99%
See 1 more Smart Citation
“…In [4], authors discuss on the problem of current link prediction approaches. We have pointed out that evaluating link predictions based on deleted edges is not suitable considering the dynamics of social networks.…”
Section: Discussionmentioning
confidence: 99%
“…As of January 2017, daily average audience is about 87 million visitors, 3 with more than 410 million registered users. 4 Any user in VK has a profile which contains various information. First and last names are mandatory fields, and other data such as birthday, city and interests are optional.…”
Section: Vkontaktementioning
confidence: 99%
“…However, the removed links in the near future, as a significant aspect of DNLP, are not characterized by PR curve and thus PRAUC may lose its effectiveness in this case. Junuthula et al [44] restricted the measurements to only part of node pairs and proposed the Geometric Mean of AUC and PRAUC (GMAUC) for the added and removed links, which can better reflect the dynamic performance. Li et al [29] use SumD that counts the differences between the predicted network and the true one, evaluating link prediction methods in a more strict way.…”
Section: Evaluation Metricsmentioning
confidence: 99%
“…Evaluation measures used in the area of link prediction are embraced from other research areas i.e., classification, information retrieval [39]. These evaluation measures can be classified into two categorize: (1) threshold curves and (2) fixed threshold [58][101] [24].…”
Section: Performance Evaluation Measuresmentioning
confidence: 99%
“…It only considers the positive links for instead of negative links. Since, in periodic link prediction, it is required to predict removed links for that PR curve is not suitable [39].…”
Section: Pr: Pr Is Abbreviation Of Precision-recall Curve Itmentioning
confidence: 99%