Multilingual Ontology Matching Evaluation – A First Report on Using MultiFarm

Abstract

This paper reports on the first usage of the MultiFarm dataset for evaluating ontology matching systems. This dataset has been designed as a comprehensive benchmark for multilingual ontology matching. In this first set of experiments, we analyze how state-of-the-art matching systems -not particularly designed for the task of multilingual ontology matching -perform on this dataset. Our experiments show the hardness of MultiFarm and result in baselines for any algorithm specifically designed for multilingual ontology matching. Moreover, this first reporting allows us to draw relevant conclusions for both multilingual ontology matching and ontology matching evaluation in general.

Interlinking Cross-Lingual RDF Data Sets

“…-Since we will attempt to automate the linking process as much as possible, standard statistical measures will serve for evaluation. As a starting point, the results of the best multilingual ontology matcher [10] with F-measure = 18% could be considered as a baseline. As of today, there is no official benchmark for doing evaluation.…”

“…Recent developments have been made in the field of multilingual ontology matching [8,10]. Some work has also been done in creating a multilingual ontology known as BabelNet [9].…”