Relevance Scores for Triples from Type-Like Relations

Abstract

We compute and evaluate relevance scores for knowledge-base triples from type-like relations. Such a score measures the degree to which an entity "belongs" to a type. For example, Quentin Tarantino has various professions, including Film Director, Screenwriter, and Actor. The first two would get a high score in our setting, because those are his main professions. The third would get a low score, because he mostly had cameo appearances in his own movies. Such scores are essential in the ranking for entity queries, e.g. "american actors" or "quentin tarantino professions". These scores are different from scores for "correctness" or "accuracy" (all three professions above are correct and accurate). We propose a variety of algorithms to compute these scores. For our evaluation we designed a new benchmark, which includes a ground truth based on about 14K human judgments obtained via crowdsourcing. Inter-judge agreement is slightly over 90%. Existing approaches from the literature give results far from the optimum. Our best algorithms achieve an agreement of about 80% with the ground truth.

Target Type Identification for Entity-Bearing Queries

“…eries that got only the NIL-type assigned to them are removed (6 queries in total). No re-normalization of the relevance levels for NIL-typed queries is performed (similar to the se ing in [5]). For the LTR results, we used 5-fold cross-validation.…”

A spatially explicit reinforcement learning model for geographic knowledge graph summarization

“…While these papers primarily take advantage of the intrinsic information of knowledge graphs, some work is geared toward extrinsic knowledge. For instance, Bast et al (2015) utilized textual information from Wikipedia to build logistic regression and generative models to calculate relevance scores for relations in knowledge graph triples. Our work takes the best of both worlds by considering intrinsic knowledge graph structure and extrinsic information simultaneously.…”

Utilizing Entities for an Enhanced Search Experience

“…For example, the types of ARNOLD SCHWARZENEGGER in Freebase include, among others, tv.tv actor, sports.pro athlete, and government.politician. The problem of selecting a single "main" type to be displayed on the card has been addressed using both context-independent [7] and context-dependent [50] methods. For emerging entities, that already have some facts stored about them in the KB, but lack a Wikipedia-style summary, natural language descriptions may be produced automatically [17,41].…”