Fast Linking of Mathematical Wikidata Entities in Wikipedia Articles Using Annotation Recommendation

Abstract

Mathematical information retrieval (MathIR) applications such as semantic formula search and question answering systems rely on knowledgebases that link mathematical expressions to their natural language names. For database population, mathematical formulae need to be annotated and linked to semantic concepts, which is very time-consuming. In this paper, we present our approach to structure and speed up this process by supporting annotators with a system that suggests formula names and meanings of mathematical identifiers. We test our approach annotating 25 articles on en.wikipedia.org. We evaluate the quality and time-savings of the annotation recommendations. Moreover, we watch editor reverts and comments on Wikipedia formula entity links and Wikidata item creation and population to ground the formula semantics. Our evaluation shows that the AI guidance was able to significantly speed up the annotation process by a factor of 1.4 for formulae and 2.4 for identifiers. Our contributions were reverted in 12% of the edited Wikipedia articles and 33% of the Wikidata items within a test window of one month. The »An-noMathTeX« annotation recommender system is hosted by Wikimedia at annomathtex.wmflabs.org. In the future, our data refinement pipeline is ready to be integrated seamlessly into the Wikipedia user interface.

Investigating the potential of the semantic web for education: Exploring Wikidata as a learning platform

“…More Specifically, review of the literature illustrated that researchers use Wikidata to conduct new types of research (Amaral et al, 2021;Colla et al, 2021;Ferradji & Benchikha, 2021;Good et al, 2016;Kaffee, 2016;Konieczny & Klein, 2018;Lemus-Rojas & Odell, 2018;Li et al, 2022;Meier, 2022;Mietchen et al, 2015;Morshed, 2021;Neelam et al, 2022;Rasberry & Mietchen, 2021;Shenoy et al, 2022;Taveekarn et al, 2019;Waagmeester et al, 2020Waagmeester et al, , 2021Zhang et al, 2022). Researchers also use Wikidata to conduct new types of academic analysis in a variety of disciplines (Arnaout et al, 2021;Burgstaller-Muehlbacher et al, 2016;Kaffee et al, 2017;Klein et al, 2016;Lemus-Rojas, n.d.;Pfundner et al, 2015;Putman et al, 2017;Rutz et al, 2021;Scharpf et al, 2021a, b;Turki et al, 2019Turki et al, , 2022a. Finally, at times researchers use Wikidata to demonstrate new types of visualizations (Hernández et al, 2016;Metilli et al, 2019;Nielsen et al, 2017;Nielsen, 2016a, b).…”

Mining mathematical documents for question answering via unsupervised formula labeling

“…Our evaluation sample consists of formula concepts, which were annotated using the AnnoMathTeX 9 formula and identifier annotation recommender system [40,41]. The formulae were taken from an already existing benchmark selection of 25 Wikipedia articles from physics (classical mechanics).…”

zbMATH Open: API Solutions and Research Challenges

“…• MathOverflow is a question-and-answer platform for mathematics that is part of the StackExchange Network 15 . In a previous collaboration, zb-MATH and MathOverflow added the possibility to cite zbMATH entries in a MathOverflow post directly, see [11].…”

“…Formula Disambiguation I Similar formulas can have vastly different meanings in different contexts [15,16,17,18]. This is especially true for single symbols used in these formulas as researchers in different fields will certainly have assigned a different meaning to symbols.…”