SAME but Different

Zhao, Huasha; Jiang, Biye; Canny, John; Jaros, Bobby

doi:10.1145/2783258.2783416

Cited by 18 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Yan et al [34] implements collapsed Gibbs sampling [35] and collapsed variational Bayesian [36] on GPU. BIDMach [30] toolkit implements Monte Carlo Expectation Maximization (MCEM) [37] method on GPU without much GPU specific optimizations thus ends up with moderate performance. SaberLDA [28] proposes the PDOW (partition by document, order by word) strategy to reduce random memory access.…”

Section: A Related Workmentioning

confidence: 99%

ezLDA: Efficient and Scalable LDA on GPUs

Wang,

Liu,

Gaihre

et al. 2023

IEEE Access

View full text Add to dashboard Cite

Latent Dirichlet Allocation (LDA) is a statistical approach for topic modeling with a wide range of applications. Attracted by the exceptional computing and memory throughput capabilities, this work introduces ezLDA which achieves efficient and scalable LDA training on GPUs with the following three contributions: First, ezLDA introduces three-branch sampling method which takes advantage of the convergence heterogeneity of various tokens to reduce the redundant sampling task. Second, to enable sparsity-aware format for both D and W on GPUs with fast sampling and updating, we introduce hybrid format for W along with corresponding token partition to T and inverted index designs. Third, we design a hierarchical workload balancing solution to address the extremely skewed workload imbalance problem on GPU and scale ezLDA across multiple GPUs. Taken together, ezLDA achieves superior performance over the state-of-the-art attempts with lower memory consumption.

show abstract