A comparative analysis of Latent Semantic analysis and Latent Dirichlet allocation topic modeling methods using Bible data

Abstract

Objective: To compare the topic modeling techniques, as no free lunch theorem states that under a uniform distribution over search problems, all machine learning algorithms perform equally. Hence, here, we compare Latent Semantic Analysis (LSA) or Latent Dirichlet Allocation (LDA) to identify better performer for English bible data set which has not been studied yet. Methods: This comparative study divided into three levels: In the first level, bible data was extracted from the sources and preprocessed to remove the words and characters which were not useful to obtain the semantic structures or necessary patterns to make the meaningful corpus. In the second level, the preprocessed data were converted into a bag of words and numerical statistic TF-IDF (Term Frequency – Inverse Document Frequency) is used to assess how relevant a word is to a document in a corpus. In the third level, Latent Semantic analysis and Latent Dirichlet Allocations methods were applied over the resultant corpus to study the feasibility of the techniques. Findings: Based on our evaluation, we observed that the LDA achieves 60 to 75% superior performance when compared to LSA using document similarity within-corpus, document similarity with the unseen document. Additionally, LDA showed better coherence score (0.58018) than LSA (0.50395). Moreover, when compared to any word within-corpus, the word association showed better results with LDA. Some words have homonyms based on the context; for example, in the bible; bear has a meaning of punishment and birth. In our study, LDA word association results are almost near to human word associations when compared to LSA. Novelty: LDA was found to be the computationally efficient and interpretable method in adopting the English Bible dataset of New International Version that was not yet created. Keywords: Topic modeling; LSA; LDA; word association; document similarity;Bible data set

Alignment of Unsupervised Machine Learning with Human Understanding: A Case Study of Connected Vehicle Patents

“…The NLP pipeline focused on evaluating the most mature and best performing topic modeling algorithms reported in the literature. For example, Garbhapu and Bodapati (2020) found that LDA was better than LSA at aligning word associations with human word associations [38]. Kherwa and Bansal (2019) assessed that LDA was more efficient than other topic modeling algorithms [28].…”

Analisis Tren Pertemuan Tatap Muka Terbatas dari Persepsi Warganet pada Twitter Menggunakan Topic Modeling

“…Terdapat bebeberapa metode dalam topic modeling, salah satunya adalah Latent Dirichlet Allocation (LDA). LDA merupakan salah satu metode yang paling populer dalam pemodelan topik (Alghamdi & Alfalqi, 2015;Bastani et al, 2019;Garbhapu, 2020;Hidayatullah et al, 2019;Jelodar et al, 2018;Kim et al, 2022;Lyu et al, 2021;Madzík & Falát, 2022;Myat Noe Win, Sri Devi Ravana, 2022;Nurlayli & Nasichuddin, 2019;Sutherland et al, 2020;Yokomoto et al, 2012;Zoghbi et al, 2016). Gambar 1 menunjukkan alur metode penelitian pemodelan topik menggunakan LDA.…”

“…Dalam penelitian ini menggunakan metode Latent Dirichlet Allocation (LDA) untuk menganalisis tren terkait PTMT. LDA menerapkan model generative probabilistic untuk pengumpulan data diskrit sebagai korpus, sehingga didapatkan struktur semantik dan mendeteksi topik-topik yang ada pada koleksi data teks yang diproses dan proporsi kemunculan topik tersebut (Garbhapu, 2020;Nurlayli & Nasichuddin, 2019;Pinto & Chahed, 2015). Ilustrasi cara kerja LDA dapat dilihat pada Gambar 2.…”

Pengamatan Tren Ulasan Hotel Menggunakan Pemodelan Topik Berbasis Latent Dirichlet Allocation

“…Model LDA menghasilkan ringkasan yang singkat, jelas, dan koheren [7]. LDA ditemukan sebagai metode komputasi yang efisien dan dapat ditafsirkan dalam mengadopsi bahasa Inggris Kumpulan data Alkitab Versi Internasional Baru yang belum dibuat daripada metode LSA [8]. Dalam sentiment analisis mengenai data twitter tentang kendaraan listrik menunjukan bahwa LDA memberikan yang lebih baik wawasan tentang topik, serta akurasi yang lebih baik daripada LSA [9].…”