Supporting Product Development by a Trend Analysis Tool Applying Aspect-Based Sentiment Detection

Wörner, Janik; Konadl, Daniel; Schmid, Isabel; Leist, Susanne

doi:10.1007/978-3-031-06516-3_6

Cited by 1 publication

(1 citation statement)

References 35 publications

(77 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although, some research on the comparative analysis of several topic modeling strategies has been done in the literature. (7,8,9) However, the existing studies have been conducted for specific application domains. This constitutes a significant limitation, as we were unable to locate any systematic attempt to compare and empirically evaluate topic modeling approaches with the goal of identifying a generalized topic model approach that is appropriate for data lake systems that handle heterogeneous data sources.…”

Section: Introductionmentioning

confidence: 99%

Data lake management using topic modeling techniques

Cherradi,

El Haddadi

2024

Data and Metadata

View full text Add to dashboard Cite

With the rapid rise of information technology, the amount of unstructured data from the data lake is rapidly growing and has become a great challenge in analyzing, organizing and automatically classifying in order to derive the meaningful information for a data-driven business. The scientific document has unlabeled text, so it's difficult to properly link it to a topic model. However, crafting a topic perception for a heterogeneous dataset within the domain of big data lakes presents a complex issue. The manual classification of text documents requires significant financial and human resources. Yet, employing topic modeling techniques could streamline this process, enhancing our understanding of word meanings and potentially reducing the resource burden. This paper presents a comparative study on metadata-based classification of scientific documents dataset, applying the two well-known machine learning-based topic modelling approaches, Latent Dirichlet Analysis (LDA) and Latent Semantic Allocation (LSA). To assess the effectiveness of our proposals, we conducted a thorough examination primarily centred on crucial assessment metrics, including coherence scores, perplexity, and log-likelihood. This evaluation was carried out on a scientific publications corpus, according to information from the title, abstract, keywords, authors, affiliation, and other metadata aspects. Results of these experiments highlight the superior performance of LDA over LSA, evidenced by a remarkable coherence value of (0.884) in contrast to LSA's (0.768).

show abstract

Section: Introductionmentioning

confidence: 99%